As a Custom Software Engineer, a typical day involves creating tailored software solutions by designing, coding, and improving various components within systems or applications. The role requires working with modern development frameworks and following agile methodologies to ensure the delivery of scalable and efficient software that meets unique business requirements. Collaboration with different teams and continuous refinement of software elements to enhance performance and functionality are key aspects of the daily routine.
Roles & Responsibilities:
- Expected to be an SME, collaborate and manage the team to perform.
- Understand the overall requirement & design of the Project engaged
- Work closely with tech leads in India & US to understand the existing data pipeline developed in Databricks,Pyspark & GCP- Own development and enhancement work in the data pipeline (Databricks) and provide regular updates to leads
- Collaborate closely with product managers, data engineers,
and stakeholders to translate business requirements into technical solution.
Skilled & Technical Skills:
- Must To Have Skills: Proficiency in Databricks Unified Data Analytics Platform.
- Experience in developing and optimizing data pipelines and workflows within cloud-based environments.
- 3 to 6 years total experience with majority of that experience related to ETL experience with Strong Hands on experience in PySpark & Databricks
- Good hands on experience in any Cloud Data platform, GCP is preferred.
- Experience in processing streaming data using Kafka / Pub-Sub
- Experience designing and deploying data pipelines orchestration using Apache Airflow.
- Healthcare industry experience
Additional Information
- The candidate should have minimum 5 years of experience in Databricks Unified Data Analytics Platform.
- This position is based at our Hyderabad office.
- A 15 years full time education is required.