We are seeking a high-performing Senior Data Engineer with 6 to 8 years of experience to design, construct, and optimize production-grade ETL/ELT pipelines on AWS. Working onsite at our Chennai office, you will solve complex data challenges, optimize query performance, and ensure operational excellence.
Key Responsibilities :
- Pipeline Engineering: Build, automate, and maintain complex, highly scalable data pipelines using Python and AWS Glue.
- Data Warehouse Optimization: Manage and optimize data warehouse instances in AWS Redshift for speed, query efficiency, and storage.
- Observability & Monitoring: Implement proactive logging, alerting, and automated monitoring solutions across S3 data lakes and batch/stream processing runs.
- Deployment & Best Practices: Lead onsite deployment activities, perform code reviews, and mentor junior team members.
Technical & Professional Skills :
- Experience: 6–8 years of dedicated hands-on data engineering experience.
- Core AWS Stack: Strong expertise in AWS Cloud, AWS Glue, AWS Redshift, and S3.
- Programming: Advanced proficiency in Python (Pandas, PySpark, data processing libraries) and SQL.
- Observability: Proven experience setting up pipeline observability and operational monitoring tools.
- Positive to Have: Exposure to AI pipelines, model feature stores, or AI framework integrations.
- Certificate: AWS Certified Data Engineer – Associate, AWS Certified Solutions Architect – Associate.
- Location: Must be willing to work 100% Onsite in Chennai.