Job Overview : We are looking for an experienced Senior Data Engineer with strong hands-on expertise in Python-based REST API integration, API data extraction, and AWS-native data engineering. The candidate will be responsible for building scalable and reliable API ingestion pipelines, integrating third-party data sources, and processing data within a Medallion Architecture-based data platform.Key Responsibilities : - Develop and maintain Python-based REST API extraction and ingestion pipelines.- Integrate third-party APIs using API documentation and implement reliable data ingestion.- Handle API pagination, authentication, incremental ingestion, retries, error handling, and logging.- Build and optimize data pipelines using AWS Glue, Amazon Athena, and other AWS services.- Implement Medallion Architecture (Bronze, Silver, and Gold layers).- Work with Apache Iceberg tables,



including schema evolution and table management.- Orchestrate workflows using AWS Step Functions and/or Apache Airflow.- Implement data quality checks and ensure pipeline reliability, scalability, and performance.- Troubleshoot pipeline failures and optimize data processing workflows.Mandatory Skills : - Strong hands-on experience in Python scripting and REST API pipeline development.- Practical experience with REST API extraction, pagination, authentication, incremental ingestion, error handling, and retry mechanisms.- Solid experience with AWS Glue and Amazon Athena.- Good understanding of Medallion Architecture (Bronze, Silver, and Gold).- Working knowledge of Apache Iceberg, schema evolution, and table management.- Experience with AWS Step Functions and/or Apache Airflow.- Understanding of data quality checks and validation processes.Interview Process : L1 + Client Rounds + HR Discussion (Face-to-Face) (ref:hirist.tech)

📌 Apexon - Senior Data Engineer - Python/AWS (Bengaluru)
🏢 Apexon
📍 Bengaluru