21 Aug
|
Valam Solutions
|
Chennai
21 Aug
Valam Solutions
Chennai
Azure Data Engineer – Offshore, India
Experience: 8–10+ years
Engagement: 3 months
Location: Offshore, India
Role Summary We are looking for an experienced Azure Data Engineer to design, develop, and optimize data integration and ETL/ELT pipelines using Microsoft Azure technologies. The resource will work with the CIT Data Team to build scalable data solutions and integration feeds across various applications.
Key Responsibilities
- Design and develop data pipelines using Azure Data Factory (ADF).
- Build and optimize integrations across ADLS, Azure Synapse, Databricks, Azure SQL, SAP, XML, flat files, and databases.
- Develop ETL/ELT solutions using SQL, Python/PySpark, Spark, and Azure services.
- Perform data modeling, data warehousing, data governance, metadata, and data quality activities.
- Optimize pipeline performance and ensure adherence to IFC technical standards.
- Develop unit/integration test cases and support application feed testing.
- Prepare technical/functional design documents and other project artifacts.
- Work in an Agile/SDLC setting and collaborate with project leads and business/data teams.
Mandatory Skills
- Strong hands-on experience with Azure Data Factory, Azure Databricks, ADLS, Azure Synapse, Azure SQL.
- Strong SQL Server/Oracle and complex SQL query skills.
- Experience with Python/PySpark and Spark.
- Strong ETL/ELT and data warehouse/data lake experience.
- Experience with Informatica and/or SSIS is an advantage.
- Knowledge of Azure Functions, Logic Apps, Automation, PowerShell, AzCopy, Azure DevOps/ARM templates.
- Strong understanding of data architecture, modeling, ingestion, curation, and raw/enriched/curated data layers.
- Experience delivering end-to-end data warehousing, BI, and analytics projects.
- Bachelor’s degree in Computer Science, Engineering, MIS, or related field.
Preferred: Experience with real-time/near-real-time data warehousing and enterprise data integration. Skills: data,sql,azure,data warehousing,etl
📌 Azure Data Engineer (Chennai)
🏢 Valam Solutions
📍 Chennai