20 Sep
|
Virtual Labs
|
Varanasi
20 Sep
Virtual Labs
Varanasi
Data Engineer – Databricks | Pharma Domain
nLocation: India (Remote)
nExperience: 4+ Years
nEmployment Type: Contract / Full-Time
nDomain: Pharma Domain – Mandatory
nJob Summary
nWe are looking for an experienced Data Engineer with robust hands-on experience in Databricks, PySpark, SQL, CI/CD, and Version Control . The ideal candidate should have experience working on Pharma domain projects and be comfortable developing and maintaining scalable data pipelines.
nKey Responsibilities
n
n
Design, develop, and maintain data pipelines using Databricks .
n
Work with Databricks Notebooks and Databricks Pipelines for data processing and transformation.
n
Develop data transformation and processing workflows using PySpark .
n
Write optimized SQL queries for data extraction, transformation, and analysis.
n
Build and maintain reliable ETL/ELT pipelines for large datasets.
n
Implement data quality, validation, and error-handling processes.
n
Work with CI/CD pipelines for deployment and release management.
n
Use Git/version control for source-code management and team-oriented development.
n
Collaborate with business and technical teams to understand data requirements.
n
Follow security, governance, documentation, and data engineering best practices.
n
nMandatory Skills
n
n
Pharma Domain Experience – MUST
n
Databricks – MUST
n
Databricks Notebooks
n
Databricks Pipelines
n
PySpark – Strong/basic hands-on experience
n
SQL – Solid
n
CI/CD
n
Git / Version Control
n
Strong understanding of ETL/ELT and data pipeline development
n
nPreferred
n
n
Experience with cloud platforms such as Azure / AWS
n
Experience working with large-scale datasets
n
Understanding of data quality and data governance
n
Experience working in Agile development environments
n
nImportant
nCandidates must have direct Pharma domain/project experience.
n
nHealthcare or non-Pharma experience will not be considered.
📌 Data Engineer Databricks Pharma Domain Must Varanasi
🏢 Virtual Labs
📍 Varanasi