15 Nov
|
Dreamwings Technologies
|
Chennai
15 Nov
Dreamwings Technologies
Chennai
Lead Data Engineer (AWS)
Data Engineering | Chennai / Bangalore | Full-time
Experience: 8+ years in data engineering, including team leadership
Core stack: AWS (Glue, Lambda, Redshift, EMR, Kinesis), Python, PySpark, SQL, Databricks
Team scope: Leads and mentors a team of 5+ data engineers
About the Role
We're looking for a Lead Data Engineer to own the technical architecture, design, and delivery of our AWS-based data engineering solutions. You'll lead a team of engineers building scalable data pipelines and platforms, while staying hands-on with design decisions, code quality, and the toughest technical problems. This role suits someone who enjoys both the technical depth of data architecture and the people side of leading a team.
What You'll Do
Architecture & Design
- Own technical architecture and design for data engineering solutions that power business-critical use cases
- Design scalable, secure, and resilient solutions on AWS, applying modern data warehouse and data lake patterns
- Evaluate and select the right technology stack — cloud-native services, open-source tools, storage, and processing frameworks
Engineering & Delivery
- Lead, mentor, and grow a team of data engineers, ensuring quality, performance, and on-time delivery of data pipelines
- Drive detailed technical design and data mapping specifications
- Set and enforce coding standards and best practices, raising the bar on code quality across the team
- Optimize solutions for performance, cost, and scalability
- Ensure data quality and integrity for downstream systems and applications
Project & Stakeholder Management
- Plan and prioritize data engineering work to hit delivery commitments without sacrificing quality
- Identify risks early, troubleshoot issues,
and own customer escalations
- Partner closely with internal and customer stakeholders to keep priorities aligned
Collaboration & Documentation
- Maintain clear technical documentation — architecture diagrams, HLD/LLD, data mapping specs, and database design
- Work closely with BI engineers and data scientists to enable analytics, ML models, and reporting
What You Bring
- 8+ years of hands-on experience delivering data engineering solutions
- Experience leading a team of 5+ engineers — including stakeholder management, design/code reviews, and mentoring
- Strong hands-on AWS experience: Glue, Lambda, Redshift, EMR, Kinesis, and related data services
- Solid grounding in database concepts, SQL, and relational modeling, plus working knowledge of NoSQL databases
- Robust hands-on experience building data pipelines with Python and PySpark
- Good understanding of data lake and data warehouse concepts, modern data architecture patterns, and industry trends
- Hands-on data modeling experience, covering both ER and dimensional modeling
- Experience implementing data quality management solutions
- Working knowledge of metadata management for data platforms
- Understanding of data governance — stewardship, security, and privacy management
- Experience with Git for source control
- Experience with DevOps practices, including CI/CD for data engineering pipelines
- Strong analytical and problem-solving skills
- Excellent communication and collaboration skills
Nice to Have
- AWS certification(s), ideally data engineering-focused
- Experience with Amazon AppFlow, API Gateway, or DynamoDB
- Experience with BI/visualization tools such as Power BI
Pay: ₹600,000.00 - ₹1,500,000.00 per year
Work Location: In person
📌 AWS Data Lead Engineer (Chennai)
🏢 Dreamwings Technologies
📍 Chennai