30 Aug
|
Mastech Digital
|
Chennai
30 Aug
Mastech Digital
Chennai
POSITION: Reltio MDM DeveloperLOCATION: Chennai/Hyderabad/Bangalore- Hybrid.DURATION: Full Time.Notice Period: Immediate joiner/ Serving notice less than 45 daysMust have skills (Hand's on)Azure Synapse Analytics- 3 yearsPyspark- 4+ yearsPython- 1+ yearsFabric- 6+ monthsThis is a migration project from Azure Synapse Analytics to FabricExperience: 8+ YearsJob SummaryWe are seeking a highly skilled Senior Data Engineer to join the Data Cloud team supporting client. The ideal candidate should possess robust data engineering expertise with hands-on experience in Python, Azure Synapse Analytics, Microsoft Fabric, Databricks, and modern cloud-based data platforms.The candidate should be capable of independently designing, developing, optimizing, and supporting scalable data solutions while working closely with business and technical stakeholders.Key ResponsibilitiesAnalyze business requirements and design scalable data engineering solutions.Design, develop, and maintain robust data pipelines and ETL/ELT frameworks.Build and optimize data ingestion, transformation, and processing workflows using Python and PySpark.Develop data solutions using Azure Synapse Analytics, Microsoft Fabric, and Databricks.Implement scalable data lake and data warehouse architectures.Develop reusable, metadata-driven, and parameterized data pipelines.Perform complex data transformations, aggregations, joins,
and data quality validations.Optimize pipeline performance and troubleshoot data processing issues.Implement monitoring, logging, and error-handling frameworks.Work with structured and semi-structured data sources across cloud and on-premise platforms.Support production incidents, root cause analysis, and performance tuning activities.Collaborate with cross-functional teams to deliver high-quality data solutions.Participate in code reviews and follow engineering best practices.Required SkillsStrong Python programming experiencePySparkAzure Synapse AnalyticsMicrosoft FabricDatabricksSQLAzure Data Factory (ADF)Azure Data Lake Storage (ADLS)Delta LakeData Warehousing ConceptsETL / ELT DevelopmentData ModelingCI/CD and DevOps practicesPerformance Optimization and TroubleshootingPreferred ExperienceBanking or Financial Services domain experienceRegulatory reporting and analytics platformsMedallion Architecture (Bronze, Silver, Gold)Large-scale cloud data migration and modernization projectsKey ExpectationsStrong engineering and problem-solving capabilitiesAbility to work independently with minimal supervisionExperience handling complex data transformation and integration scenariosStrong debugging, troubleshooting, and optimization skillsExcellent communication and stakeholder management skills
📌 Senior Data Engineer (Chennai)
🏢 Mastech Digital
📍 Chennai