Senior Data Engineer - Databricks (India)

Senior Data Engineer - Databricks (India)

19 Nov
|
ARA Resources
|
India

19 Nov

ARA Resources

India

Role Summary:

The ideal candidate will design, build, and optimize scalable data pipelines using Databricks and related technologies, enabling faster data-driven decisions for the company.

Key Responsibilities:

- Design, develop, and optimize end-to-end batch and streaming data pipelines using Azure Databricks and Spark.
- Apply Medallion Architecture to structure data layers (raw, enriched, curated).
- Ensure data accuracy, consistency, and governance using tools like Azure Purview and Unity Catalog.
- Optimize Spark jobs, Delta Lake tables, and SQL queries for efficiency.
- Collaborate closely with analysts, architects, and business teams to deliver end-to-end data solutions.
- Support and maintain existing data pipelines and solutions.
- Implement data quality rules and principles.
- Participate in code reviews and contribute to best practices.

Must-Have Qualifications:

- Hands-on experience with Databricks, Delta Lake, and Data Factory.
- Proficiency in Python, PySpark, and SQL with strong query optimization skills.




- Deep understanding of Lakehouse architecture and Medallion design patterns.
- Experience building scalable ETL/ELT pipelines.
- Familiarity with Git, CI/CD pipelines, and Agile methodologies.

Nice to Have:

- Knowledge of data quality frameworks and monitoring practices.
- Experience with data visualization tools.
- Experience working in managed services.

Behavioral Competencies:

- Strong problem-solving and analytical skills.
- Attention to detail and commitment to data quality.
- Collaborative mindset and effective communication.
- Proactive and self-driven.

Why Join Us:

- The company offers a dynamic work environment that fosters innovation.
- Recognized as a Great Place to Work in 2021, ensuring a high-trust and high-performance culture.
- Employees have the opportunity to work with cutting-edge technologies.
- Committed to personal and skilled growth.

📌 Senior Data Engineer - Databricks (India)
🏢 ARA Resources
📍 India

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: senior data engineer - databricks (india) / india