– Senior Data EngineerJob Title

Senior Data Engineer

Work Mode

Hybrid

Location

- Hinjewadi, Pune, Maharashtra
- Gurgaon, India

Experience
- Minimum: 5 Years
- Maximum: 10 Years

CTC
- Minimum: ₹12.17 LPA
- Maximum: ₹25.00 LPA

Key Skills
- Data Engineering
- Databricks
- PySpark
- Data Migration
- ETL/ELT
- Delta Lake
- SQL
- Python
- Spark
- Cloud Platforms (Azure/AWS/GCP)

Roles & ResponsibilitiesData Pipeline Development
- Design, develop, and maintain scalable data pipelines on Databricks.
- Build end-to-end data workflows from data ingestion to transformation and consumption.
- Monitor, optimize, and troubleshoot production pipelines.
- Implement error handling, monitoring, and alerting mechanisms.
- Optimize Spark jobs and cluster performance.
- Manage Databricks Jobs and workflow orchestration.

Legacy Code Modernization
- Refactor legacy ETL pipelines into PySpark.
- Migrate traditional ETL processes to up-to-date ELT architecture.
- Ensure data integrity during migration.
- Prepare migration documentation and best practices.

Data Engineering
- Implement data quality checks and validation frameworks.
- Design and maintain Delta Lake tables.
- Develop reusable data engineering frameworks.
- Follow Git, CI/CD, testing, and code review best practices.
- Resolve production data issues.

Collaboration
- Work closely with Data Architects, Analysts, Infrastructure, Application, and Cyber teams.




- Mentor junior data engineers.
- Maintain technical documentation.
- Share knowledge and engineering best practices.

Required Technical Skills
- Strong Data Engineering fundamentals.
- Hands-on experience with PySpark and Spark SQL.
- Databricks platform experience.
- Delta Lake implementation.
- Python programming.
- SQL.
- Cloud platforms (Azure/AWS/GCP).
- Data Modeling.
- Git and CI/CD.
- Data Governance & Security.
- Structured Streaming (preferred).

Professional Experience
- 8+ years in Data Engineering or related roles.
- 2–3 years of hands-on Databricks experience.
- Experience in large-scale production data pipelines.
- Experience with legacy code modernization.
- Agile development experience.

Mandatory Certification
- Databricks Certified Data Engineer Associate OR
- Databricks Certified Data Engineer Professional

Preferred Certifications
- Databricks Certified Associate Developer for Apache Spark
- Azure Data Engineer Associate
- AWS Certified Data Analytics
- Google Cloud Professional Data Engineer

Soft Skills
- Excellent analytical and problem-solving skills.
- Strong communication.
- Team collaboration.
- Self-motivated and detail-oriented.
- Adaptable to changing technologies.
- Client-focused approach.

Pay: ₹1,217,900.00 - ₹2,500,000.00 per year Work Location: Hybrid remote in Gurgaon, Haryana

📌 Senior Data Engineer (Gurugram)
🏢 Freelancing recruitment
📍 Gurugram