Description
We are seeking a highly skilled and proactive Data Engineer to join our team. The ideal candidate will have strong hands-on expertise with AWS cloud services, Databricks, Apache Spark, Python, and SQL, along with excellent communication and stakeholder engagement skills. You will play a key role in designing, building, and optimizing data pipelines and analytics solutions that support critical business initiatives.Key Responsibilities
- Design, develop, and maintain scalable data pipelines and transformation workflows using Databricks and Spark.
- Build and optimize ETL/ELT processes to ingest, cleanse, and prepare large datasets.
- Work with AWS services such as S3, Lambda, IAM, ECS and CloudWatch to support data architecture and operational needs.
- Collaborate with data analysts, data scientists, and business stakeholders to understand requirements and translate them into technical solutions.
- Ensure data quality, reliability, and performance across all data systems.
- Implement and enforce best practices for coding, version control, CI/CD, and workplace management.




- Monitor and troubleshoot data pipelines, ensuring high availability and timely delivery.
- Contribute to architectural decisions, documentation, and process improvements.

Requirements
- Strong hands-on experience with AWS Cloud (S3, Lambda, IAM, EC2 or equivalent).
- Extensive experience with Databricks, Delta Lake, and Unity Catalog.
- Proficiency in Apache Spark (PySpark preferred).
- Strong programming skills in Python.
- Excellent command of SQL, including performance tuning and working with large datasets.
- Experience working in fast-paced, agile environments.
- Strong problem-solving abilities and a proactive approach to identifying improvements.
- Excellent communication and stakeholder management skills; able to collaborate across multiple teams.
- Experience with data governance frameworks and tools (e.g., DataHub, Soda).
- Experience with CI/CD tools (GitHub Actions).
- Av

📌 Team Lead Data Engineer (Chennai)
🏢 Mindera
📍 Chennai