This role involves leading day-to-day technical delivery of data engineering work, especially modernizing existing ETL and scheduling systems. This role focuses on moving data pipelines from Informatica BDM to Databricks and migrating job schedules from TIDAL to Airflow.
The person will be hands-on, guide a small team and work closely with architects, analysts and stakeholders on healthcare data platforms.
Job Responsibilities
- Lead migration of existing Informatica BDM ETL jobs to Databricks using PySpark.
- Migrate job scheduling and dependencies from TIDAL to Apache Airflow.
- Design, develop and maintain scalable data pipelines on Databricks.
- Work on healthcare data such as claims, prescriptions, patient, provider or sales data.
- Ensure data is accurate through data quality checks and reconciliations, especially during migration.
- Guide and review work done by data engineers and senior associates.
- Break down work into tasks, estimate effort and support sprint delivery.
- Work with architects and BAs to turn requirements into working data solutions.
- Support testing, defect fixes and production releases.
- Maintain clear technical documentation and runbooks.
Education
BE/B.Tech
Master of Computer Application
Work Experience
- 6-8 years of experience in data engineering, with experience leading small teams or workstreams.
- Strong hands-on experience on Databricks (PySpark), Informatica BDM, Informatica IICS / IDMC, Apache Airflow
- Experience migrating:
- BDM Databricks
- TIDAL Airflow
- Valuable SQL skills and understanding of batch data processing.
- Experience working with healthcare or life sciences data.
- Exposure to cloud platforms (AWS, Azure or GCP).
- Good communication and documentation skills.
- Experience in data modernization or platform migration projects.
- Familiarity with Agile delivery, Jira and Confluence.
- Experience working in regulated data environments.
Behavioural Competencies
Ownership
Teamwork Leadership
Cultural Fit
Motivation to Learn and Grow
Technical Competencies
Problem Solving
Lifescience Knowledge
Communication
Informatica
Databricks
Python
Skills
📌 Associate- BIM (Karnataka)
🏢 Axtria
📍 Karnataka
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.