We are seeking a high-performing Senior Data Engineer with 6 to 8 years of experience to design, construct, and optimize production-grade ETL/ELT pipelines on AWS. Working onsite at our Chennai office, you will solve complex data challenges, optimize query performance, and ensure operational excellence.
Key Responsibilities :
- Pipeline Engineering: Build, automate, and maintain complex, highly scalable data pipelines using Python and AWS Glue
.
- Data Warehouse Optimization: Manage and optimize data warehouse instances in AWS Redshift for speed, query efficiency, and storage.
- Observability & Monitoring: Implement proactive logging, alerting, and automated monitoring solutions across S3
data lakes and batch/stream processing runs.
- Deployment & Best Practices: Lead onsite deployment activities, perform code reviews, and mentor junior team members.
Technical & Professional Skills :
- Experience: 6–8 years of dedicated hands-on data engineering experience.
- Core AWS Stack: Robust expertise in AWS Cloud
, AWS Glue
, AWS Redshift
, and S3
.
- Programming:
Advanced proficiency in Python
(Pandas, PySpark, data processing libraries) and SQL.
- Observability: Proven experience setting up pipeline observability and operational monitoring tools.
- Good to Have: Exposure to AI pipelines, model feature stores, or AI framework integrations.