01 Aug
|
Experis
|
Maharashtra
01 Aug
Experis
Maharashtra
Position: Data Engineering Lead
Employment Type: Contract to Hire(C2H)
Experience: 8+ Years
Location: Mumbai
Notice Period: Immediate Joiners Only
Job Summary
We are looking for a Data Engineering Lead with 8+ years of hands-on experience in Data Engineering and technical leadership. The ideal candidate should have robust expertise in Databricks, Python, Spark, SQL, AWS, dbt, and Airflow, with proven experience leading enterprise-scale data engineering projects, driving technical design, mentoring teams, and delivering production-ready cloud-native data platforms.
Key Responsibilities
- Lead end-to-end delivery of data engineering workstreams.
- Define technical direction and ensure high-quality project delivery.
- Design, build, and maintain scalable batch and streaming data pipelines.
- Build and support cloud-native data platforms on AWS.
- Develop high-throughput, low-latency data processing solutions using Databricks and Apache Spark.
- Build data transformation models using dbt.
- Orchestrate data workflows using Airflow or equivalent tools.
- Conduct technical design reviews and provide implementation guidance.
- Ensure solutions are secure, scalable, production-ready, and cost-efficient.
- Optimize data performance, reliability, and data quality.
- Support production systems through troubleshooting and continuous improvements.
- Collaborate with business, product, analytics, platform, and engineering teams.
- Engage directly with clients and stakeholders.
- Mentor engineers and contribute to engineering standards and best practices.
Mandatory Skills
- Databricks
- Apache Spark
- Python
- Java
- Advanced SQL
- AWS
- dbt
- Apache Airflow
- ETL/ELT Development
- Batch and Streaming Data Pipelines
- Data Modeling
- Data Quality
- Cloud-Native Data Platforms
- CI/CD
- Monitoring and Observability
- PostgreSQL or SQL Server
- Technical Leadership
- Solution Design and Architecture
- Stakeholder Management
Required Experience
- 8+ years of hands-on Data Engineering experience.
- Proven experience leading technical delivery for enterprise data platforms.
- Strong experience with Databricks and Apache Spark.
- Strong programming skills in Python, Java, and SQL.
- Experience building and operating production-grade batch and streaming data pipelines.
- Hands-on experience with AWS cloud services.
- Experience using dbt for data transformation and Airflow for workflow orchestration.
- Strong understanding of modern data architectures, data modeling, and data quality.
- Experience conducting technical design reviews and providing governance.
- Experience making architecture and technical design decisions.
- Experience mentoring engineering teams.
- Experience working directly with business stakeholders and customers.
- Experience with production support, troubleshooting, and performance optimization.
- Experience contributing to estimation and delivery planning.
Nice to Have
- Experience supporting ML, AI, or GenAI workloads.
- Exposure to BI and analytics tools.
- Experience working in regulated or security-focused environments.
- Consulting or client-facing delivery experience.
📌 Data Engineering Lead (Maharashtra)
🏢 Experis
📍 Maharashtra