16 Sep
|
Virtual Labs
|
Mumbai
16 Sep
Virtual Labs
Mumbai
Data Engineer – Databricks | Pharma Domain Location:
India (Remote) Experience
4+ Years Employment Type:
Contract / Full-Time Domain:
Pharma Domain – Mandatory Job Summary We are looking for an experienced
Data Engineer with robust hands-on experience in
Databricks, PySpark, SQL, CI/CD, and Version Control . The ideal candidate should have experience working on
Pharma domain projects and be comfortable developing and maintaining scalable data pipelines. Key Responsibilities Design, develop, and maintain data pipelines using
Databricks . Work with
Databricks Notebooks and Databricks Pipelines for data processing and transformation. Develop data transformation and processing workflows using
PySpark . Write optimized
SQL queries for data extraction, transformation, and analysis. Build and maintain reliable ETL/ELT pipelines for large datasets. Implement data quality, validation, and error-handling processes. Work with
CI/CD pipelines for deployment and release management. Use
Git/version control for source-code management and collaborative development. Collaborate with business and technical teams to understand data requirements. Follow security, governance, documentation, and data engineering best practices. Mandatory Skills Pharma Domain Experience – MUST Databricks – MUST Databricks Notebooks Databricks Pipelines PySpark – Robust/basic hands-on experience SQL – Strong CI/CD Git / Version Control Strong understanding of
ETL/ELT and data pipeline development Preferred Experience with cloud platforms such as
Azure / AWS Experience working with large-scale datasets Understanding of data quality and data governance Experience working in Agile development environments Key Candidates must have direct Pharma domain/project experience.
Healthcare or non-Pharma experience will not be considered.
📌 Data Engineer – Databricks Pharma Domain Must Mumbai
🏢 Virtual Labs
📍 Mumbai