10 Sep
|
Ajanta Pharma
|
Alibag
10 Sep
Ajanta Pharma
Alibag
Job DescriptionJob Description – Databricks Engineer
NLocation: Andheri, Mumbai
NEmployment Type: Full-Time | Work from Office
NExperience: 5–7 Years
NFunction: IT
NIndustry: Pharmaceutical
NAbout the Role
nWeare looking for an experienced Databricks Engineer to join our Data Engineering team and play a key role in designing, developing, and optimizing scalable data solutions.
NThe ideal candidate will have strong hands-on experience with Databricks, Python, PySpark, SQL, Apache Spark, and Azure cloud data platforms, along with a solid understanding of contemporary data architecture, governance, and data engineering best practices.
NExperience in the pharmaceutical industry or pharma business processes will be an added advantage.
NKey Responsibilities
n
N
Design, develop, and maintain scalable and reliable data engineering solutions using Databricks, Python, PySpark, SQL, and Apache Spark. N
Build and optimize Databricks notebooks, clusters, Jobs, Workflows, and SQL Warehouses. N
Develop productive data pipelines and transformation frameworks for large-scale data processing. N
Work with Delta Lake, Lakehouse architecture, Medallion architecture (Bronze, Silver, Gold), and contemporary data-modeling practices. N
Optimize Spark jobs, queries, clusters, and data pipelines for performance, scalability, and cost efficiency. N
Develop and maintain data pipelines using Azure Data Factory, Airflow, and dbt. N
Work with Azure storage, identity, networking, and security services to build secure and scalable data solutions. N
Implement and manage Git-based version control and CI/CD pipelines for data engineering workflows. N
Work with Unity Catalogfor data governance, access management, lineage, and discoverability. N
Ensure data quality, reliability, security, and compliance across data pipelines and platforms. N
Collaborate with business, analytics, technology, and cross-functional teams to understand requirements and deliver effect
📌 Hiring: Databricks Engineer Alibag
🏢 Ajanta Pharma
📍 Alibag