09 Sep
|
Ajanta Pharma
|
Alibag
09 Sep
Ajanta Pharma
Alibag
Job DescriptionJob Description – Databricks Engineer NLocation: Andheri, Mumbai NEmployment Type: Full-Time | Work from Office NExperience: 5–7 Years NFunction: IT NIndustry: Pharmaceutical NAbout the RolenWeare looking for an experienced Databricks Engineer to join our Data Engineering team and play a key role in designing, developing, and optimizing scalable data solutions. NThe ideal candidate will have strong hands-on experience with Databricks, Python, PySpark, SQL, Apache Spark, and Azure cloud data platforms, along with a solid understanding of modern data architecture, governance, and data engineering best practices. NExperience in the pharmaceutical industry or pharma business processes will be an added advantage. NKey Responsibilitiesn N Design, develop, and maintain scalable and reliable data engineering solutions using Databricks, Python, PySpark, SQL, and Apache Spark. N Build and optimize Databricks notebooks, clusters, Jobs, Workflows, and SQL Warehouses. N Develop efficient data pipelines and transformation frameworks for large-scale data processing. N Work with Delta Lake, Lakehouse architecture, Medallion architecture (Bronze, Silver, Gold), and modern data-modeling practices. N Optimize Spark jobs, queries, clusters, and data pipelines for performance, scalability, and cost efficiency. N Develop and maintain data pipelines using Azure Data Factory, Airflow, and dbt. N Work with Azure storage, identity, networking, and security services to build secure and scalable data solutions. N Implement and manage Git-based version control and CI/CD pipelines for data engineering workflows. N Work with Unity Catalogfor data governance, access management, lineage, and discoverability. N Ensure data quality, reliability, security, and compliance across data pipelines and platforms. N Collaborate with business, analytics, technology,
and cross-functional teams to understand requirements and deliver effective data solutions. N Troubleshoot data pipeline issues and proactively identify opportunities for process and performance improvements. N Contribute to data engineering standards, best practices, documentation, and continuous improvement initiatives. NnRequired Skills & Expertise Nn Strong hands-on experience with Databricks and Apache Spark. N Advanced proficiency inPython, PySpark, and SQL. N Strong understanding ofDelta Lake, Lakehouse architecture, Medallion architecture, and data modelling. N Experience working withDatabricks Notebooks, Clusters, Jobs, Workflows, and SQL Warehouses. N Good understanding of Azure cloud data services, including storage, identity, networking, and security. N Experience with Azure Data Factory, Airflow, dbt, Git, and CI/CD. N Knowledge of Unity Catalog, data governance, lineage, data quality, and performance tuning. N Strong analytical and problem-solving skills. N Good communication and stakeholder-management skills. N Ability to work effectively in a full-time work-from-office environment. NnExperience & Qualification NYears of Experience: 5–7 Years NRelevant Experience: Minimum 3–5 years of hands-on data engineering experience, including Databricks implementation and delivery. NEducational Qualification: Nn BE / B. Tech. / MCA in Computer Science, Information Technology, Engineering, or a related discipline. NnAdditional Qualification: Nn Databricks certification is preferred. N Experience or knowledgeof pharmaceutical processes and business functions will be an added advantage. NnWhat We Offern N Free Gym Facility – Supporting employee health and wellness. N Subsidized Food – Convenient and affordable meals at the workplace. N Opportunity to Work on Meaningful Data Initiatives – Exposure to enterprise-scale data engineering, analytics, and digital transformation projects. N Collaborative Work Setting – Work alongside experienced technology and business teams on impactful projects. N
📌 Databricks Engineer (Alibag)
🏢 Ajanta Pharma
📍 Alibag