Role Summary: This job involves design and develop data pipeline using Databricks, Pyspark to deliver CMS compliance initiatives. Job will involve extensive interfacing co-ordination with other senior tech folks (across India US) and complete development activities without any follow-ups required
Responsibilities
- Understand the overall requirement design of the Project engaged
- Work closely with tech leads in India US to understand the existing data pipeline developed in Databricks,Pyspark GCP
- Own development and enhancement work in the data pipeline (Databricks) and provide regular updates to leads
- Collaborate closely with product managers, data engineers, and stakeholders to translate business requirements into technical solution.
Requirements
- Bachelors degree or higher from a reputed university
- 3 to 6 years total experience with majority of that experience related to ETL experience with Strong Hands on experience in PySpark Databricks
- Positive hands on experience in any Cloud Data platform, GCP is preferred.
- Experience in processing streaming data using Kafka / Pub-Sub
- Experience designing and deploying data pipelines orchestration using Apache Airflow.
- Healthcare industry experience
Good to Have
- Extensive experience in GCP associated Data services
📌 Consultant - Databricks Pyspark Developer (Chennai)
🏢 enGen Global
📍 Chennai
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.