10 Sep
|
Mastech Digital
|
Chennai
10 Sep
Mastech Digital
Chennai
POSITION: Reltio MDM Developer
LOCATION: Chennai/Hyderabad/Bangalore- Hybrid.
DURATION: Full Time.
Notice Period: Immediate joiner/ Serving notice less than 45 days
Must have skills (Hand's on)
Azure Synapse Analytics- 3 years
Pyspark- 4+ years
Python- 1+ years
Fabric- 6+ months
This is a migration project from Azure Synapse Analytics to Fabric
Experience: 8+ Years
Job Summary
We are seeking a highly skilled Senior Data Engineer to join the Data Cloud team supporting client. The ideal candidate should possess strong data engineering expertise with hands-on experience in Python, Azure Synapse Analytics, Microsoft Fabric, Databricks, and contemporary cloud-based data platforms.
The candidate should be capable of independently designing, developing, optimizing, and supporting scalable data solutions while working closely with business and technical stakeholders.
Key Responsibilities
- Analyze business requirements and design scalable data engineering solutions. - Design, develop, and maintain robust data pipelines and ETL/ELT frameworks. - Build and optimize data ingestion, transformation, and processing workflows using Python and PySpark. - Develop data solutions using Azure Synapse Analytics, Microsoft Fabric, and Databricks. - Implement scalable data lake and data warehouse architectures. - Develop reusable, metadata-driven, and parameterized data pipelines. - Perform complex data transformations, aggregations, joins, and data quality validations.
- Optimize pipeline performance and troubleshoot data processing issues. - Implement monitoring, logging, and error-handling frameworks. - Work with structured and semi-structured data sources across cloud and on-premise platforms. - Support production incidents, root cause analysis, and performance tuning activities. - Collaborate with cross-functional teams to deliver high-quality data solutions. - Participate in code reviews and follow engineering best practices.
Required Skills
- Strong Python programming experience - PySpark - Azure Synapse Analytics - Microsoft Fabric - Databricks - SQL - Azure Data Factory (ADF) - Azure Data Lake Storage (ADLS) - Delta Lake - Data Warehousing Concepts - ETL / ELT Development - Data Modeling - CI/CD and DevOps practices - Performance Optimization and Troubleshooting
Preferred Experience
- Banking or Financial Services domain experience - Regulatory reporting and analytics platforms - Medallion Architecture (Bronze, Silver, Gold) - Large-scale cloud data migration and modernization projects
Key Expectations
- Strong engineering and problem-solving capabilities - Ability to work independently with minimal supervision - Experience handling complex data transformation and integration scenarios - Strong debugging, troubleshooting, and optimization skills - Excellent communication and stakeholder management skills
📌 Senior Data Engineer (Chennai)
🏢 Mastech Digital
📍 Chennai