21 Aug
|
Ajanta Pharma
|
Mumbai
21 Aug
Ajanta Pharma
Mumbai
Job Description – Databricks Engineer
Location:
Andheri, Mumbai
Employment Type:
Full-Time | Work from Office
Experience:
5–7 Years
Function:
IT
Industry:
Pharmaceutical
About the Role
We are looking for an experienced
Databricks Engineer
to join our Data Engineering team and play a key role in designing, developing, and optimizing scalable data solutions.
The ideal candidate will have strong hands-on experience with
Databricks, Python, PySpark, SQL, Apache Spark, and Azure cloud data platforms
, along with a solid understanding of modern data architecture, governance, and data engineering best practices.
Experience in the
pharmaceutical industry or pharma business processes
will be an added advantage.
Key Responsibilities
- Design, develop, and maintain scalable and reliable data engineering solutions using
Databricks, Python, PySpark, SQL, and Apache Spark
.
- Build and optimize
Databricks notebooks, clusters, Jobs, Workflows, and SQL Warehouses
.
- Develop efficient data pipelines and transformation frameworks for large-scale data processing.
- Work with
Delta Lake, Lakehouse architecture, Medallion architecture (Bronze, Silver, Gold)
, and contemporary data-modeling practices.
- Optimize Spark jobs, queries, clusters, and data pipelines for
performance, scalability, and cost efficiency
.
- Develop and maintain data pipelines using
Azure Data Factory, Airflow, and dbt
.
- Work with Azure storage, identity, networking, and security services to build secure and scalable data solutions.
- Implement and manage
Git-based version control and CI/CD pipelines
for data engineering workflows.
- Work with
Unity Catalog
for data governance, access management, lineage, and discoverability.
- Ensure data quality, reliability, security, and compliance across data pipelines and platforms.
- Collaborate with business, analytics, technology, and cross-functional teams to understand requirements and deliver effective data solutions.
- Troubleshoot data pipeline issues and proac
📌 Databricks engineer (Mumbai)
🏢 Ajanta Pharma
📍 Mumbai