- Join a collaborative data engineering team where your work directly powers trusted analytics and smarter business decisions
- In this role you ll build and optimize cloud based data pipelines using Azure Data Factory and Databricks helping teams move from raw data to meaningful insights with speed and reliability
- You ll partner closely with stakeholders data engineers and platform teams to understand data needs design scalable solutions and ensure smooth automated data movement across systems
- If you enjoy solving real world data challenges improving performance and bringing structure to complex datasets while working in a supportive learning focused environment this opportunity will help you grow your impact and deepen your expertise in modern Azure data platforms
Key Responsibilities:
- Key Responsibilities
- Design develop and maintain end to end data pipelines using Azure Data Factory for batch and scheduled workloads
- Build and orchestrate data transformations and processing workflows using Databricks aligned to business requirements
- Implement robust pipeline monitoring alerting and failure handling to ensure reliable and repeatable executions
- Perform data validation and reconciliation checks to ensure accuracy completeness and consistency across sources and targets
- Optimize pipeline performance by tuning ADF activities improving orchestration logic and streamlining transformations in Databricks
- Collaborate with cross functional teams to gather requirements estimate effort and deliver solutions within timelines
- Maintain technical documentation for pipelines datasets schedules dependencies and operational runbooks
- Support deployments and setting promotions by following structured release and change management practices
- Minimum Qualifications
- Education BTECH MTECH MCA MSC
- Overall experience 3 5 years in data engineering data integration roles
- Hands on experience with Azure Data Factory including pipeline development scheduling triggers and integration patterns
- Hands on experience with Databricks for data processing and transformation workflows
- Ability to troubleshoot pipeline failures analyze logs and implement corrective actions to improve stability
Technical Requirements:
- Azure Synapse Analytics Azure Data Lake Storage ADLS PySpark Delta Lake CI CD for data pipelines AZURE DATAFACTORY
Additional Responsibilities:
- Experience designing scalable orchestration patterns in ADF parameterization reusable components dependency handling
- Strong understanding of data transformation best practices and implementing efficient processing in Databricks
- Exposure to building data quality checks and operational dashboards for pipeline health and SLA tracking
- Experience collaborating with stakeholders to translate business requirements into technical pipeline designs and delivery plans
- Familiarity with performance tuning approaches for cloud data pipelines and distributed processing workloads
Preferred Skills:
Technology->Cloud Integration->Azure Data Factory (ADF)