01 Sep
|
The HEINEKEN
|
Hyderabad
01 Sep
The HEINEKEN
Hyderabad
The Data Engineer is responsible for designing, building, and operating high-quality, scalable, and reusable data services that support analytics, AI, and Gen AI use cases across business domains. In this role, you will design and work hands-on with data pipelines, data models, orchestration frameworks, storage layers, and observability tooling. You will collaborate closely with AI Engineers, Data Scientists, Product Owners, and Platform teams to deliver reliable, well-governed, and self-service data products.
Key Responsibilities
Data Platform & Services Engineering
• Build and maintain scalable data pipelines and ingestion frameworks for batch, streaming, and event-driven data.
• Develop and maintain modular data models and semantic layers optimized for analytics, BI self-service and AI use cases.
• Implement and operate orchestration workflows (e.g., Databricks Workflows) and compute engines (Spark, SQL, Python).
• Work with storage technologies such as Delta Lake, ADLS, feature and vector stores.
Data Quality, Governance & Observability
• Implement data quality checks, validations,
and monitoring to ensure reliability and trust in data products.
• Contribute to data lineage, metadata management, and documentation.
• Apply observability practices using tools such as Great Expectations or Monte Carlo.
• Ensure compliance with data governance standards and regulations (e.g., GDPR) in collaboration with data governance teams.
Enablement for AI & Analytics Use Cases
• Deliver curated datasets and reusable data assets for analytics, machine learning, and Gen AI applications.
• Build pipelines that process structured, graph, and unstructured data (e.g., text, documents, images).
• Support AI Engineering teams with data preparation for embeddings, vector stores, and retrieval-augmented generation (RAG) pipelines.
Tooling & Self-Service
• Contribute to data engineering tooling and frameworks that enable productive development and deployment of pipelines.
• Develop data pi
📌 Data engineer (Hyderabad)
🏢 The HEINEKEN
📍 Hyderabad