" – Data Engineer (Azure Synapse | PySpark)
Role: Data Engineer
Experience: 5–12 years
Location: [Pune / India / Hybrid ]
Engagement Type: Contract
Role Summary
We are seeking a highly skilled Data Engineer with robust hands‐on experience in Azure Synapse Analytics and PySpark to design, develop, and optimize scalable cloud‐based data pipelines. The role involves working on large‐scale analytical platforms, enabling advanced reporting, analytics, and data‐driven decision‐making in enterprise (preferably banking or financial services) environments.
Key Responsibilities
- Data Engineering & Pipeline Development
Design, build, and maintain scalable data pipelines using Azure Synapse Analytics and PySpark.
Develop batch and incremental ingestion pipelines from multiple source systems (RDBMS, flat files, APIs, cloud sources).
Implement robust data transformation frameworks following ELT/ETL best practices.
2.
Azure
Synapse & Spark Development
Develop high‐performance data transformations using PySpark (DataFrames, Spark SQL).
Work with Synapse Dedicated SQL Pools and Serverless SQL Pools for analytical workloads.
Optimize Spark jobs through partitioning, caching, and performance tuning techniques."
ECMS REQ ID
560739
Project Location 1
MAH | PUNE
Project Location 2
TELANGANA | HYDERABAD
Project Location 3
(No Value)
Project Location 4
(No Value)
Delivery SPOC
Aravind Zaware
Relevant Experience
Min 5 yrs
Mandatory skills
Azure Synapse with Pyspark
Desired skills
Agile
Domain (Industry)
Financial domain
BGC (Before onboarding / After onboarding)
PreOB
Total Experience (Ex. 5-7 Years)
5-8 yrs
BGC Details
Account Specific
BGC Vendor
Account Specific
Mode of Interview
Face to Face
WFO / WFH / Hybrid
Hybrid
Please enter shift timings
General
Shift Timings
General
📌 DNAFS_WESTPAC_Azure Synapse with Pyspark (India)
🏢 Clifyx
📍 India