13 Oct
|
Ajanta Pharma
|
Mumbai
13 Oct
Ajanta Pharma
Mumbai
Job Description – Databricks Engineer
Location: Andheri, Mumbai
Employment Type: Full-Time | Work from Office
Experience: 5–7 Years
Function: IT
Industry: Pharmaceutical
Note: Experience in SAP is mandatory.
About the Role
We are looking for an experienced Databricks Engineer to join our Data Engineering team and play a key role in designing, developing, and optimizing scalable data solutions.
The ideal candidate will have robust hands-on experience with Databricks, Python, PySpark, SQL, Apache Spark, and Azure cloud data platforms, along with a solid understanding of modern data architecture, governance, and data engineering best practices.
Experience in the pharmaceutical industry or pharma business processes will be an added advantage.
Key Responsibilities
• Design, develop, and maintain scalable and reliable data engineering solutions using Databricks, Python, PySpark, SQL, and Apache Spark.
• Build and optimize Databricks notebooks, clusters, Jobs, Workflows, and SQL Warehouses.
• Develop efficient data pipelines and transformation frameworks for large-scale data processing.
• Work with Delta Lake, Lakehouse architecture, Medallion architecture (Bronze, Silver, Gold), and modern data-modeling practices.
• Optimize Spark jobs, queries, clusters, and data pipelines for performance, scalability, and cost efficiency.
• Develop and maintain data pipelines using Azure Data Factory, Airflow, and dbt.
• Work with Azure storage, identity, networking, and security services to build secure and scalable data solutions.
• Implement and manage Git-based version control and CI/CD pipelines for data engineering workflows.
• Work with Unity Catalog for data governance, access management, lineage, and discoverability.
• Ensure data quality, reliability, security, and compliance across data pipelines and platforms.
• Collaborate with business, analytics, technology, and cross-functional teams to understand requirements and deliver effective data solutions.
• Troubleshoot data p
📌 Databricks engineer (Mumbai)
🏢 Ajanta Pharma
📍 Mumbai