16 Sep
|
Virtual Labs
|
India
16 Sep
Virtual Labs
India
Job Description
Data Engineer – Databricks | Pharma Domain
n
Location: India (Remote)
n
Experience: 4+ Years
n
Employment Type: Contract / Full time
n
Domain: Pharma Domain – Mandatory
n
Job Summary
n
We are looking for an experienced Data Engineer with strong hands-on experience in Databricks, PySpark, SQL, CI/CD, and Version Control . The ideal candidate should have experience working on Pharma domain projects and be comfortable developing and maintaining scalable data pipelines.
n
Key Responsibilities
n
n
- Design, develop, and maintain data pipelines using Databricks .
n
- Work with Databricks Notebooks and Databricks Pipelines for data processing and transformation.
n
- Develop data transformation and processing workflows using PySpark .
n
- Write optimized SQL queries for data extraction, transformation, and analysis.
n
- Build and maintain reliable ETL/ELT pipelines for large datasets.
n
- Implement data quality, validation, and error-handling processes.
n
- Work with CI/CD pipelines for deployment and release management.
n
- Use Git/version control for source-code management and collaborative development.
n
- Collaborate with business and technical teams to understand data requirements.
n
- Follow security, governance, documentation, and data engineering best practices.
n
n
Mandatory Skills
n
n
- Pharma Domain Experience – MUST
n
- Databricks – MUST
n
- Databricks Notebooks
n
- Databricks Pipelines
n
- PySpark – Strong/basic hands-on experience
n
- SQL – Strong
n
- CI/CD
n
- Git / Version Control
n
- Strong understanding of ETL/ELT and data pipeline development
n
n
Preferred
n
n
- Experience with cloud platforms such as Azure / AWS
n
- Experience working with large-scale datasets
n
- Understanding of data quality and data governance
n
- Experience working in Agile development environments
n
n
Important
n
Candidates must have direct Pharma domain/project experience.
n
n
Healthcare or non-Pharma experience will not be considered.
📌 Data Engineer - Databricks | Pharma Domain(Must) (India)
🏢 Virtual Labs
📍 India