ETL Developer/ Data Engineer - GCP/AWS
HyderabadFull-time4-10 Years Data Engineer / ETL Developer – Python, Airflow, GCP
Experience: 4–6 Years & 6+ Years
Location: Hyderabad
Open Positions: 7
Job Overview
We are looking for Data Engineers / ETL Developers with solid experience in Python, Apache Airflow, and GCP to design and maintain scalable data ingestion and ETL/ELT pipelines.
Key Responsibilities
- Develop scalable ETL/ELT pipelines using Python and Apache Airflow.
- Ingest data from APIs, relational databases, cloud storage, and external files.
- Process formats such as JSON, CSV, TXT, Parquet, XML, SHP, and GeoJSON.
- Build batch and event-driven pipelines on GCP.
- Load, transform, and optimize data in BigQuery.
- Implement data validation, reconciliation, monitoring, logging, and alerting.
- Develop reusable and configurable ingestion frameworks.
- Collaborate with architects, business teams, and data consumers.
- Participate in code reviews, testing,
documentation, and production support.
Required Skills
- Strong Python programming and SQL skills.
- Hands-on experience with Apache Airflow / Cloud Composer.
- Experience with AWS & GCP – BigQuery, GCS, Cloud Functions.
- Experience integrating REST APIs and relational databases such as SQL Server, Oracle, PostgreSQL, or MySQL.
- Experience handling large datasets and multiple file formats.
- Knowledge of data quality, validation, monitoring, and error handling.
- Familiarity with Git, CI/CD, and Agile methodologies.
Ideal Candidate
A hands-on Data Engineer who can independently build reliable data pipelines, troubleshoot production issues, and work effectively with cross-functional teams. Note: Interested Candidates send your CV to:
[email protected]
📌 ETL Developer/ Data Engineer - GCP/AWS (Hyderabad)
🏢 SurgeVector
📍 Hyderabad