- Design, develop, test, deploy and maintain large-scale data pipelines using Airflow to extract, transform, load (ETL) data from various sources into AWS cloud storage systems.
- Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs through ETL processes.
- Develop complex SQL queries to optimize database performance and troubleshoot issues related to data quality and integrity.
- Ensure scalability, reliability, security and efficiency of the ETL process by monitoring its performance metrics.
Job Requirements :
- 6-12 years of experience in Data Engineering with expertise in Airflow, AWS, ETL/Pyspark.
- Solid understanding of big data technologies such as Hadoop ecosystem components including HDFS, MapReduce, Hive etc. .
- Proficiency in writing complex SQL queries for querying relational databases like Postgres or MySQL.
📌 Data Engineer (Hyderabad)
🏢 Mobile Programming
📍 Hyderabad
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.