Job Description: Data Engineer (Databricks Focused)
Position Overview
We are looking for a hands-on Data Engineer with 4 to 6 years of experience to join our core development team. This role focuses heavily on pipeline execution, script implementation, and code deployment. Hands-on mastery of the Databricks platform is mandatory, combined with practical experience working within the Healthcare domain, to execute data transformations and support ongoing data migration activities.
Work Location & Schedule
• Location:
Hyderabad, India
• Work Mode:
Working from Office (All 5 days - Mandate)
Key Responsibilities
- Pipeline Execution:
Write, test, and maintain efficient, scalable data pipelines inside Databricks notebooks using PySpark and optimized ANSI SQL.
- Migration Support:
Support data migration initiatives by constructing ingestion scripts to map, validate, and move legacy or source datasets into target Databricks Delta tables.
- Data Transformation:
Ingest and transform healthcare datasets (including structured and semi-structured payloads like JSON/XML) into clean,
analytical table structures.
- Validation & Troubleshooting:
Perform technical data validation and code unit-testing to quickly identify runtime errors, script bugs, or pipeline refresh execution failures.
- Security & Compliance:
Implement functional database access policies, data masking rules, and row-level filtering protocols to ensure compliance with strict healthcare data privacy parameters.
- Version Tracking:
Manage environment parameter changes, monitor pipeline schedules, and handle code promotion paths using Git source control structures.
Required Qualifications & Technical Skills
- Experience:
4 to 6 years of dedicated skilled experience working as a hands-on data engineer.
- Core Platform (Mandatory):
Mandatory, hands-on developer experience utilizing the Databricks platform (writing PySpark logic, configuring Delta tables, and handling notebook tasks).
- Domain Knowledge:
Pra
📌 Data Engineer (Hyderabad)
🏢 SRS Consulting
📍 Hyderabad
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.