Role Summary: This job involves design and develop data pipeline using Databricks, Pyspark to deliver CMS compliance initiatives. Job will involve extensive interfacing co-ordination with other senior tech folks (across India US) and complete development activities without any follow-ups required
Responsibilities
Understand the overall requirement design of the Project engaged
Work closely with tech leads in India US to understand the existing data pipeline developed in Databricks,Pyspark GCP
Own development and enhancement work in the data pipeline (Databricks) and provide regular updates to leads
Collaborate closely with product managers, data engineers, and stakeholders to translate business requirements into technical solution.
Requirements
Bachelors degree or higher from a reputed university
3 to 6 years total experience with majority of that experience related to ETL experience with Robust Hands on experience in PySpark Databricks
Valuable hands on experience in any Cloud Data platform, GCP is preferred.
Experience in processing streaming data using Kafka / Pub-Sub
Experience designing and deploying data pipelines orchestration using Apache Airflow.
Healthcare industry experience
Valuable to Have
Extensive experience in GCP associated Data services
📌 Consultant Databricks Pyspark Developer Chennai
🏢 enGen Global
📍 Chennai
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.