Position OverviewWe are looking for a hands-on Data Engineer with 4 to 6 years of experience to join our core development team. This role focuses heavily on pipeline execution, script implementation, and code deployment. Hands-on mastery of the Databricks platform is mandatory, combined with practical experience working within the Healthcare domain, to execute data transformations and support ongoing data migration activities.
Key Responsibilities
- Pipeline Execution: Write, test, and maintain efficient, scalable data pipelines inside Databricks notebooks using PySpark and optimized ANSI SQL.
- Migration Support: Support data migration initiatives by constructing ingestion scripts to map, validate, and move legacy or source datasets into target Databricks Delta tables.
- Data Transformation: Ingest and transform healthcare datasets (including structured and semi-structured payloads like JSON/XML) into clean, analytical table structures.
- Validation & Troubleshooting:
Perform technical data validation and code unit-testing to quickly identify runtime errors, script bugs, or pipeline refresh execution failures.
- Security & Compliance: Implement functional database access policies, data masking rules, and row-level filtering protocols to ensure compliance with strict healthcare data privacy parameters.
- Version Tracking: Manage setting parameter changes, monitor pipeline schedules, and handle code promotion paths using Git source control structures.
Required Qualifications & Technical Skills
- Experience: 4 to 6 years of dedicated professional experience working as a hands-on data engineer.
- Core Platform (Mandatory): Mandatory, hands-on developer experience utilizing the Databricks platform (writing PySpark logic, configuring Delta tables, and handling notebook tasks).
- Domain Knowledge: Practical engineering experience working inside the Healthcare domain, showing familiarity with the security nuances of processing sensitiv
📌 Data Engineer (Hyderabad)
🏢 SRS Business Solutions (India
📍 Hyderabad
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.