02 Sep
|
Ajanta Pharma
|
Mumbai
02 Sep
Ajanta Pharma
Mumbai
Job Description
Job Description – Databricks Engineer
nLocation: Andheri, Mumbai
nEmployment Type: Full time | Work from Office
nExperience: 5–7 Years
nFunction: IT
nIndustry: Pharmaceutical
nAbout the Role
nWe are looking for an experienced Databricks Engineer to join our Data Engineering team and play a key role in designing, developing, and optimizing scalable data solutions.
nThe ideal candidate will have robust hands-on experience with Databricks, Python, PySpark, SQL, Apache Spark, and Azure cloud data platforms, along with a solid understanding of up-to-date data architecture, governance, and data engineering best practices.
nExperience in the pharmaceutical industry or pharma business processes will be an added advantage.
nKey Responsibilities
n
n
Design, develop, and maintain scalable and reliable data engineering solutions using Databricks, Python, PySpark, SQL, and Apache Spark.n
Build and optimize Databricks notebooks, clusters, Jobs, Workflows, and SQL Warehouses.n
Develop efficient data pipelines and transformation frameworks for large-scale data processing.n
Work with Delta Lake, Lakehouse architecture, Medallion architecture (Bronze, Silver, Gold), and contemporary data-modeling practices.n
Optimize Spark jobs, queries, clusters, and data pipelines for performance, scalability, and cost efficiency.n
Develop and maintain data pipelines using Azure Data Factory, Airflow, and dbt.n
Work with Azure storage, identity, networking, and security services to build secure and scalable data solutions.n
Implement and manage Git-based version control and CI/CD pipelines for data engineering workflows.n
Work with Unity Catalog for data governance, access management, lineage, and discoverability.n
Ensure data quality, reliability, security, and compliance across data pipelines and platforms.n
Collaborate with business, analytics, technology, and cross-functional teams to understand requirements and deliver effective data solution
📌 Databricks Engineer Mumbai
🏢 Ajanta Pharma
📍 Mumbai