Required Skills & Experience

5-8+ years of hands-on experience in data architecture and engineering delivery.

Proven success in building up-to-date data platforms on cloud (Azure, AWS, GCP).

Deep knowledge of data lakehouse architectures (e.g., Databricks, Fabric).

Proficiency with Python, SQL, Spark, and orchestration frameworks.

Experience with ETL/ELT tools (e.g., Informatica, Talend, Fivetran) and containerization (Docker, Kubernetes).

Strong background in Data Modeling (ERD, star/snowflake, canonical models).

Familiarity with REST APIs, GraphQL, and event-driven design.

Demonstrated experience integrating AI/ML and GenAI components into data platforms.

Exposure to DataOps and DevOps practices for CI/CD and platform automation.

Nice to Have Skills & Experience
- Working knowledge of code management and CI/CD systems (Azure DevOps or GitHub).
- Familiarity with NoSQL databases (e.g., MongoDB).
- Exposure to IoT Data Standards like Project Haystack, Brick Schema, Real Estate Core.

Job Description

Essential Duties And Responsibilities Architecture & Strategy





Define and continuously evolve the data architecture across the Digital Products and Platforms

Translate business and technical goals into scalable and resilient platform designs.

Own and maintain architectural roadmaps, standards, and decision frameworks.

Act as the bridge between architects, SME/Analysts, data engineers, and analytics teams to ensure alignment and compliance with platform standards.

Data Engineering & Platform Delivery

Design and implement modern ELT/ETL pipelines using tools like Spark, Python, SQL, Scala, and cloud-native components (e.g., Databricks).

Design AI ready Data Models (e.g., RAG, agent orchestration, multimodal pipelines) with working reference implementations.

Build reusable AI components, templates, and accelerators to enable consistent adoption across teams.

Implement and optimize scalable, secure, and resilient AI pipelines, aligned with enterprise data and

📌 Azure Data Engineer (Bengaluru)
🏢 Insight Global
📍 Bengaluru