16 Oct
|
Innova ESI
|
India
— Architect | Azure Databricks | CPG | MARS - CPG experienced is mandate
Role: Data Architect / Azure Databricks Architect
Industry: Consumer Packaged Goods (CPG)
Experience: 10–15+ years
Technology: Azure | Databricks | Data & AI
Role Overview
We are looking for an experienced Azure Databricks Architect to lead the design and implementation of modern, scalable data platforms for MARS, with a strong focus on CPG business and analytics use cases.
The architect will be responsible for defining the end-to-end data architecture, leveraging Azure and Databricks/Lakehouse technologies, and translating complex business requirements across sales, marketing, supply chain, manufacturing, finance, and commercial functions into robust data solutions.
The role requires a combination of hands-on technical expertise, architecture leadership, CPG domain knowledge, and strong stakeholder management skills.
Key Responsibilities
- Define and own the end-to-end data architecture for MARS data and analytics platforms.
- Design scalable Azure Databricks Lakehouse architectures supporting batch, near-real-time and streaming workloads.
- Establish architecture patterns for:
- Data ingestion
- Data lake/lakehouse
- Data engineering
- Data transformation
- Data warehousing
- Data serving and consumption
- Architect solutions using Azure Databricks, Delta Lake, Azure Data Lake Storage (ADLS), Azure Data Factory, Azure Synapse and Azure services.
- Define data models and architecture patterns for enterprise, domain and analytical data products.
- Drive modernization of legacy data platforms and migration to Azure Databricks/Lakehouse.
- Establish best practices for Medallion Architecture – Bronze, Silver and Gold layers.
- Design and implement data pipelines using PySpark, SQL and Python.
- Define standards for performance optimization, scalability, reliability and cost management in Databricks.
- Establish data governance, security, access control, lineage and data quality frameworks.
- Work with business and product stakeholders to convert CPG requirements into technical architecture and data products.
- Provide technical leadership to data engineers and development teams.
- Review solution designs, conduct architecture reviews and ensure adherence to enterprise architecture standards.
- Evaluate current Azure/Databricks capabilities and recommend appropriate technologies and patterns.
- Collaborate with enterprise, solution, security, integration and application architects.
CPG Domain Experience Strong understanding of CPG business processes and data is highly desirable, particularly across:
- Sales & Distribution
- Retail / Modern Trade / General Trade / E-commerce
- Trade Promotion Management (TPM)
- Consumer & Shopper Analytics
- Demand Forecasting
- Supply Chain & Inventory
- Manufacturing
- Product / SKU / Brand analytics
- Pricing & Promotion
- Revenue Growth Management (RGM)
- Customer / Retailer analytics
- Marketing analytics
- Finance and commercial analytics
Experience working with data from retailers, distributors, syndicated data providers,
POS, ERP, CRM and e-commerce platforms would be an advantage.
Required Technical Skills
Azure
- Azure Databricks
- ADLS Gen2
- Azure Data Factory
- Azure Synapse Analytics
- Azure Key Vault
- Azure Functions / Event Hubs
- Azure Monitor
Databricks
- Databricks Lakehouse architecture
- Delta Lake
- Unity Catalog
- PySpark
- Spark SQL
- Databricks Workflows
- Delta Live Tables / Lakeflow
- Databricks SQL
- Performance tuning and cost optimization
Data Engineering
- Advanced SQL
- Python / PySpark
- ETL/ELT architecture
- Batch and streaming data processing
- API and file-based ingestion
- Data modelling
- Data quality frameworks
Data Architecture & Governance
- Enterprise data architecture
- Dimensional modelling
- Data mesh / data products
- Metadata and data lineage
- Master Data Management
- Data governance
- RBAC and security
- PII / sensitive data management
- CI/CD and DevOps
Preferred Experience
- 10–15+ years of experience in data engineering / data architecture.
- 5+ years working with Azure and/or Databricks.
- Proven experience designing enterprise-scale Lakehouse/Data Platform architectures.
- Strong CPG/FMCG domain experience.
- Experience leading large-scale cloud data transformation programs.
- Experience working with global teams and multiple business stakeholders.
- Strong communication, presentation and stakeholder-management skills.
- Ability to balance strategic architecture with hands-on technical problem solving.
Qualifications
- Azure Solutions Architect / Azure Data Engineer certification preferred.
- Databricks Data Engineer / Data Architect certification preferred.
📌 Cloud Architect (India)
🏢 Innova ESI
📍 India