About the Role
We are seeking a dedicated and skilled developer to join our team of Data Engineers and Data Analysts working with various stakeholders.
We are looking for an experienced Azure Data Engineer with 4–5 years of hands-on experience in building, optimizing, and maintaining scalable data solutions on Microsoft Azure and good knowledge of US Insurance terminologies. The ideal candidate will have solid expertise in Azure data services, Databricks, SQL, and modern data engineering practices, with a focus on performance, reliability, and data quality.
You will also leverage various AI Agents like Azure Open AI, Databricks Genie Code, Genie and Copilot to improve productivity.
About the Team:
Team is tech hub for rest of the organization and hence working across multiple domains – US Healthcare, Insurance, Government etc.
Team primarily works on data extraction, manipulation, loading, and analytics using technologies like Python, PySpark, Bigdata – HPCC, language ECL, Talend, Azure tools (Synapse, ADF etc), Power BI, Essbase etc.
Key Responsibilities
1.
Data Engineering & Pipeline Development
• Design, develop, and maintain scalable ETL/ELT data pipelines using Azure Data Factory, Databricks, and Azure storage services.
• Ingest data from multiple sources including relational databases, APIs, and file-based systems into Azure data platforms.
• Implement data transformations on HPCC using ECL and on Azure platform using SparkSQL and PySpark in Azure Databricks.
2. Azure Databricks & Distributed Processing
• Develop and optimize notebooks and jobs using Azure Databricks.
• Write efficient Spark jobs for large-scale data processing.
• Implement best practices for cluster configuration, job scheduling, and cost optimization.
3. Data Modeling & Storage
• Design and implement data models on HPCC using ECL and also using Delta Lake, Parquet, or other columnar storage formats.
• Build and maintain curated, analytics-ready datasets (bronze, silver, gold layers).
•
📌 Software Engineer III (Mumbai)
🏢 Relx
📍 Mumbai