31 Aug
|
Omnicom Global Solutions
|
Karnataka
31 Aug
Omnicom Global Solutions
Karnataka
Job DescriptionJoin us at OGS NWe are OGS—Omnicom's Integrated Solutions Engine that brings together a global talent community and connected capabilities in data, creative, media, commerce, and technology to build adaptive, future-ready solutions. NWe are redefining the global capability center - not as an offshoring hub, but as a true inside edge. OGS is the place where the future is tested, built, and scaled for the world’s most ambitious agencies and clients. NWith over 4300+ talented professionals in India, we are proud to be a diverse, inclusive, and collaborative community that thrives on innovation and excellence. Our teams work with some of the world’s most iconic brands, helping them move faster and achieve more—everywhere. We are growing rapidly and looking for passionate individuals to be part of this journey. NnYOUR ROLE NWe want to ensure that OGS continues to be the first choice for customers seeking innovative marketing technology, data, and analytics solutions. Our goal is to be recognized as a leader in technical excellence, delivering scalable and modern data platforms that drive business value for our clients. NThis role sits within theData & Technology arm of our business, specifically within the Tech Delivery team. NWe are seeking a highly skilled and hands-on Senior Databricks Data Engineer to join a strategic data transformation programme focused on migrating a large-scale enterprise data platform from Informatica to Azure Databricks. The successful candidate will play a critical role in modernizing data ingestion, transformation, orchestration, and analytics capabilities while ensuring continuity of business-critical data processes. NThis role requires strongtechnical expertise in Azure Databricks, PySpark, SQL, Oracle databases, and modern Data Lakehouse architectures. The ideal candidate will be capable of independently delivering complex solutions from design through implementation while collaborating with architects, business stakeholders, and cross-functional delivery teams. NnYOUR RESPONSIBILITIES Nn Lead the analysis, design,
development, testing, and deployment of data engineering solutions on Azure Databricks. N Participate in the migration of existing ETL/ELT workloads from Informatica to Azure Databricks. N Analyse Informatica mappings, workflows, and dependencies and translate them into scalable Databricks solutions. N Design and develop performant batch and streaming data pipelines using PySpark and SQL. N Build and maintain dataingestion frameworks for structured and semi-structured data sources. N Develop, optimize, and maintain Delta Lake-based data architectures using Medallion Architecture principles (Bronze, Silver, Gold). N Work closely with Solution Architects and Business Analysts to understand business requirements and translate them into technical solutions. N Implement data quality,reconciliation, validation, and monitoring processes throughout the migration lifecycle. N Create technical specifications, design documents, and operational support documentation. N Participate in code reviews and enforce engineering best practices and development standards. N Support deployment activities through CI/CD pipelines and Infrastructure-as-Code frameworks. N Collaborate with stakeholders, project managers, and delivery teams to ensure successful project outcomes. N Mentor junior engineersand provide technical leadership across the project team. N Support production releases and troubleshoot complex data issues when required. NnnSKILLS AND EXPERIENCE Nn 4-6 yearsof hands-on experience with Azure Databricks in enterprise environments. N Proven experience delivering large-scale data migration and modernization projects.
N Strong experience migrating ETL processes from Informatica or similar ETL platforms to cloud-native architectures. N Strong understanding ofLakehouse architecture and modern data engineering principles. N Extensive experience inData Modelling, Data Warehousing, and Data Lake design. N Experience working withlarge-scale enterprise data platforms. N Robust analytical and problem-solving abilities. N Experience working withAgile delivery methodologies. N Ability to communicate complex technical concepts to both technical and non-technical stakeholders. N Experience working in client-facing environments and collaborating with business stakeholders. N Strong understanding ofsoftware development lifecycle and engineering best practices. NnnESSENTIAL SKILLS NDatabricks & DataEngineering NAzure Databricks, Databricks Genie AI, PySpark, Spark SQL, Delta Lake, Unity Catalog, Databricks Workflows, Databricks Asset Bundles, Lakehouse Architecture, Medallion Architecture, Advanced Data Engineering patterns and best practices NnAzure Services NAzure Data Lake Storage Gen2 (ADLS Gen2), Azure Data Factory, Azure Synapse Analytics, Azure Key Vault, Azure Entra ID, Azure Monitor, Azure DevOps, Azure Functions NnDatabase Technologies NOracle Database (Must Have), Oracle SQL, Oracle Stored Procedures, Oracle Data Modelling, Oracle Data Warehouse Concepts and Ms SQL server NnMigration & Integration Nn Informatica PowerCenter or Informatica Intelligent Cloud Services (IICS) N ETL to ELT migration methodologies N Data Validation and Reconciliation N Data Quality Frameworks N Source-to-Target Mapping Analysis N Data Integration Design NnnEngineering Practices Nn Gitn CI/CD N Terraformn Infrastructure as Code N Unit Testing and Automated Testing N Performance Optimization NnnDESIRABLE / BENEFICIAL SKILLS / CERTIFICATIONS Nn Experience with Databricks LakeBridge, GPT, Claude AI. N Databricks certification(s). N Microsoft Azure certification(s). NnnLocation - Bangalore, Chennai & Hyderabad NShift - 2 to 11 pm NHybrid model N
📌 Sr Databricks Data Engineer (Karnataka)
🏢 Omnicom Global Solutions
📍 Karnataka