Data Engineer / ETL Developer Python, Airflow, GCP
Experience: 4–6 Years & 6+ Years
Location: Hyderabad
Open Positions: 7
Job Overview
We are looking for Data Engineers / ETL Developers with strong experience in Python, Apache Airflow, and GCP to design and maintain scalable data ingestion and ETL/ELT pipelines.
Key Responsibilities
- Develop scalable ETL/ELT pipelines using Python and Apache Airflow.
- Ingest data from APIs, relational databases, cloud storage, and external files.
- Process formats such as JSON, CSV, TXT, Parquet, XML, SHP, and GeoJSON.
- Build batch and event-driven pipelines on GCP.
- Load, transform, and optimize data in BigQuery.
- Implement data validation, reconciliation, monitoring, logging, and alerting.
- Develop reusable and configurable ingestion frameworks.
- Collaborate with architects, business teams, and data consumers.
- Participate in code reviews, testing, documentation, and production support.
- Required Skills
- Robust Python programming and SQL skills.
- Hands-on experience with Apache Airflow / Cloud Composer.
- Experience with AWS & GCP – BigQuery, GCS, Cloud Functions.
- Experience integrating REST APIs and relational databases such as SQL Server, Oracle, PostgreSQL, or MySQL.
- Experience handling large datasets and multiple file formats.
- Knowledge of data quality, validation, monitoring, and error handling.
- Familiarity with Git, CI/CD, and Agile methodologies.
Ideal Candidate
A hands-on Data Engineer who can independently build reliable data pipelines, troubleshoot production issues, and work effectively with cross-functional teams.
Note: Interested Candidates send your CV to
[email protected]
📌 Technical Lead (Hyderabad)
🏢 Adaequare
📍 Hyderabad