22 Sep
|
Virtual Labs
|
Narela
22 Sep
Virtual Labs
Narela
Job Description
Data Engineer – Databricks | Pharma Domain
nLocation: India (Remote)
nExperience: 4+ Years
nEmployment Type: Contract / Full-Time
nDomain: Pharma Domain – Mandatory
nJob Summary
nWe are looking for an experienced Data Engineer with strong hands-on experience in Databricks, PySpark, SQL, CI/CD, and Version Control . The ideal candidate should have experience working on Pharma domain projects and be comfortable developing and maintaining scalable data pipelines.
nKey Responsibilities
n
n
Design, develop, and maintain data pipelines using Databricks .n
Work with Databricks Notebooks and Databricks Pipelines for data processing and transformation.n
Develop data transformation and processing workflows using PySpark .n
Write optimized SQL queries for data extraction, transformation, and analysis.n
Build and maintain reliable ETL/ELT pipelines for large datasets.n
Implement data quality, validation, and error-handling processes.n
Work with CI/CD pipelines for deployment and release management.n
Use Git/version control for source-code management and cooperative development.n
Collaborate with business and technical teams to understand data requirements.n
Follow security, governance, documentation, and data engineering best practices.n
nMandatory Skills
n
n
Pharma Domain Experience – MUST n
Databricks – MUST n
Databricks Notebooksn
Databricks Pipelinesn
PySpark – Robust/basic hands-on experience n
SQL – Strong n
CI/CD n
Git / Version Control n
Robust understanding of ETL/ELT and data pipeline development n
nPreferred
n
n
Experience with cloud platforms such as Azure / AWS n
Experience working with large-scale datasetsn
Understanding of data quality and data governancen
Experience working in Agile development environmentsn
nImportant
nCandidates must have direct Pharma domain/project experience.
n
nHealthcare or non-Pharma experience will not be considered.
📌 Data Engineer Narela
🏢 Virtual Labs
📍 Narela