11 Sep
|
Ajanta Pharma
|
Mumbai
11 Sep
Ajanta Pharma
Mumbai
– Databricks Engineer /n Location: Andheri, Mumbai /n Employment Type: Full-Time | Work from Office /n Experience: 5–7 Years /n Function: IT /n Industry: Pharmaceutical /n About the Role /n We are looking for an experienced Databricks Engineer to join our Data Engineering team and play a key role in designing, developing, and optimizing scalable data solutions. /n The ideal candidate will have strong hands-on experience with Databricks, Python, PySpark, SQL, Apache Spark, and Azure cloud data platforms, along with a solid understanding of modern data architecture, governance, and data engineering best practices. /n Experience in the pharmaceutical industry or pharma business processes will be an added advantage. /n Key Responsibilities /n /n
- Design, develop, and maintain scalable and reliable data engineering solutions using Databricks, Python, PySpark, SQL, and Apache Spark.
/n
- Build and optimize Databricks notebooks, clusters, Jobs, Workflows, and SQL Warehouses.
/n
- Develop effective data pipelines and transformation frameworks for large-scale data processing.
/n
- Work with Delta Lake, Lakehouse architecture, Medallion architecture (Bronze, Silver, Gold), and modern data-modeling practices.
/n
- Optimize Spark jobs, queries, clusters, and data pipelines for performance, scalability, and cost efficiency.
/n
- Develop and maintain data pipelines using Azure Data Factory, Airflow, and dbt.
/n
- Work with Azure storage, identity, networking, and security services to build secure and scalable data solutions.
/n
- Implement and manage Git-based version control and CI/CD pipelines for data engineering workflows.
/n
- Work with Unity Catalog for data governance, access management, lineage, and discoverability.
/n
- Ensure data quality, reliability, security, and compliance across data pipelines and platforms.
/n
- Collaborate with business, analytics, technology, and cross-functional teams to understand requirements and deliver effective data solutions.
/n
- Troubleshoot data pipeline issues and proactively identify opportunities for process and performance improvements.
/n
- Contribute to data engineering standards, best practices, documentation, and continuous improvement initiatives.
/n /n Required Skills & Expertise /n /n
- Strong hands-on experience with Databricks and Apache Spark.
/n
- Advanced proficiency in Python, PySpark, and SQL.
/n
- Strong understanding of Delta Lake, Lakehouse architecture, Medallion architecture, and data modelling.
/n
- Experience working with Databricks Notebooks, Clusters, Jobs, Workflows, and SQL Warehouses.
/n
- Good understanding of Azure cloud data services, including storage, identity, networking, and security.
/n
- Experience with Azure Data Factory, Airflow, dbt, Git, and CI/CD.
/n
- Knowledge of Unity Catalog, data governance, lineage, data quality, and performance tuning.
/n
- Strong analytical and problem-solving skills.
/n
- Good communication and stakeholder-management skills.
/n
- Ability to work effectively in a full-time work-from-office environment.
/n /n Experience & Qualification /n Years of Experience: 5–7 Years /n Relevant Experience: Minimum 3–5 years of hands-on data engineering experience, including Databricks implementation and delivery. /n Educational Qualification: /n /n
- BE / B. Tech. / MCA in Computer Science, Information Technology, Engineering, or a related discipline.
/n /n Additional Qualification: /n /n
- Databricks certification is preferred.
/n
- Experience or knowledge of pharmaceutical processes and business functions will be an added advantage.
/n /n What We Offer /n /n
- ?️ Free Gym Facility – Supporting employee health and wellness.
/n
- ? Subsidized Food – Convenient and affordable meals at the workplace.
/n
- ? Opportunity to Work on Meaningful Data Initiatives – Exposure to enterprise-scale data engineering, analytics, and digital transformation projects.
/n
- ? Collaborative Work Environment – Work alongside experienced technology and business teams on impactful projects.
/n /n
📌 Databricks engineer (Mumbai)
🏢 Ajanta Pharma
📍 Mumbai