Hiring: Senior Data Engineer – Python, REST APIs & AWS
Location: Any Apexon Location
Work Mode: Hybrid
Experience: 7–10 Years
Shift: General Shift

Interview Process: L1 + Client Rounds + HR Discussion (Face-to-Face)

Job Overview
We are looking for an experienced Senior Data Engineer with robust hands-on expertise in Python-based REST API integration, API data extraction, and AWS-native data engineering. The candidate will be responsible for building scalable and reliable API ingestion pipelines, integrating third-party data sources, and processing data within a Medallion Architecture-based data platform.

Key Responsibilities
• Develop and maintain Python-based REST API extraction and ingestion pipelines.
• Integrate third-party APIs using API documentation and implement reliable data ingestion.
• Handle API pagination, authentication, incremental ingestion, retries, error handling, and logging.
• Build and optimize data pipelines using AWS Glue, Amazon Athena, and other AWS services.
• Implement Medallion Architecture (Bronze, Silver, and Gold layers).




• Work with Apache Iceberg tables, including schema evolution and table management.
• Orchestrate workflows using AWS Step Functions and/or Apache Airflow.
• Implement data quality checks and ensure pipeline reliability, scalability, and performance.
• Troubleshoot pipeline failures and optimize data processing workflows.

Mandatory Skills
• Strong hands-on experience in Python scripting and REST API pipeline development.
• Practical experience with REST API extraction, pagination, authentication, incremental ingestion, error handling, and retry mechanisms.
• Strong experience with AWS Glue and Amazon Athena.
• Good understanding of Medallion Architecture (Bronze, Silver, and Gold).
• Working knowledge of Apache Iceberg, schema evolution, and table management.
• Experience with AWS Step Functions and/or Apache Airflow.
• Understanding of data quality checks and validation processes.

📌 AWS Data Engineer (Bengaluru)
🏢 Apexon
📍 Bengaluru