31 Aug
|
MP Dominic
|
Secunderabad
31 Aug
MP Dominic
Secunderabad
Job Summary
We are looking for an experienced Senior Data Engineer with 7+ years of hands-on experience in designing, developing, monitoring, troubleshooting, and optimizing scalable data pipelines and data architectures.
The ideal candidate should have solid expertise in AWS, PySpark, AWS Glue, Apache Airflow, Amazon S3, Apache Iceberg, Amazon Redshift, and PostgreSQL. The candidate will be responsible for building reliable data pipelines, optimizing data processing workflows, and ensuring high availability and performance of data solutions.
Key Responsibilities
- Design, develop, and maintain scalable and reliable data pipelines using AWS data services and modern data engineering technologies.
- Develop and optimize data processing solutions using PySpark.
- Build and manage ETL/ELT workflows using AWS Glue.
- Design, schedule, monitor, and troubleshoot workflows using Apache Airflow.
- Work with Amazon S3 and Apache Iceberg for scalable data storage and data lake solutions.
- Develop and optimize data solutions using Amazon Redshift.
- Work with PostgreSQL for data storage, querying, and data integration.
- Monitor data pipelines and proactively identify and resolve failures and performance issues.
- Perform troubleshooting, debugging, and root-cause analysis of data pipeline issues.
- Optimize data pipelines, queries, and processing jobs for improved performance and scalability.
- Participate in data architecture and solution design activities.
- Ensure data quality, reliability, consistency, and security across data workflows.
- Collaborate with application developers, data analysts, architects, and other stakeholders to deliver data solutions.
- Follow best practices for coding, testing, deployment, monitoring, and documentation.
If you are interested in this opportunity, please share your updated CV along with the below details to [HIDDEN TEXT]:
Candidate Name
Contact Number
Total Experience
Relevant Experience
Current Location
Preferred Work Location – Hyderabad / Trivandrum / Kochi
Current CTC
Expected CTC
Notice Period
Last Working Day (LWD), if serving notice
Availability for F2F L1 Interview
📌 Tech Lead / Senior Data Engineer (Secunderabad)
🏢 MP Dominic
📍 Secunderabad