19 Nov
|
Moolya
|
Hyderabad
: Senior Data Modeler (Data Modeling & Governance)
The Role
You will own the data model for our lakehouse. Your models are the contract that batch pipelines, Kafka event streams, AI agents and MCP tools read from and write to. You will design for structured, semi-structured and unstructured data, set the standards and governance around it, and keep the model evolving without breaking its consumers.
Role type: Individual contributor, hands-on.
Reports to: Director, Data Platform & AI.
Location: Hyderabad, India
What You Will Do
- Design and own the canonical data model across batch and event-driven systems within the lakehouse architecture (Bronze, Silver, Gold or equivalent layers), using Databricks, Snowflake and Delta Lake.
- Model structured entities, semi-structured data (JSON, Kafka events) and unstructured assets (documents, text, embeddings and associated metadata).
- Define schema evolution and versioning standards to ensure incremental changes, including new fields, sources and events, do not break downstream pipelines, AI agents or MCP tools.
- Establish enterprise-wide data modelling standards covering naming conventions, data types, keys, SCD patterns, partitioning, clustering and data contracts.
- Implement end-to-end data governance, including data cataloguing, column-level lineage, business and technical data dictionaries, ownership, classification and access policies.
- Ensure data is AI-ready through stable identifiers, semantically meaningful entities, well-documented columns and metadata that LangGraph agents and FastMCP tools can reliably discover and query.
- Review data pipeline designs and pull requests to ensure compliance with established data models and standards.
- Collaborate with Data Engineering, Platform,
Analytics and AI teams to drive data modelling initiatives.
- Maintain logical and physical data model documentation, conduct model reviews and manage the deprecation and migration of legacy data structures.
Must-Have Qualifications
- 6+ years of experience in Data Engineering, including at least 3 years designing and implementing production-grade data models used by multiple consuming teams.
- Proven experience evolving canonical data models incrementally, ensuring backward and forward compatibility, versioned contracts and controlled deprecation without disrupting downstream systems.
- Strong expertise in dimensional modelling, Data Vault, 3NF and event/entity modelling, with the ability to select the appropriate approach based on business requirements.
- Hands-on experience with Delta Lake on Spark or Databricks, along with Snowflake or an equivalent data warehouse.
- Experience designing data models for both batch and streaming architectures, including Kafka, CDC and event schemas (Avro, Protobuf or JSON Schema).
- Strong programming skills in Python or Scala with Spark, along with expert-level SQL. Ability to independently prototype, implement and validate data models.
- Hands-on experience with data cataloguing and lineage tools such as Unity Catalog, OpenLineage, DataHub, Collibra, Atlan or equivalent platforms.
- Proven ownership of data dictionaries and governance standards,
with demonstrated adoption across engineering teams.
Good to Have
- Experience modelling data for AI applications, including vector databases, embedding metadata, RAG corpora, semantic layers and feature stores.
- Exposure to LangGraph agents, FastMCP servers, tool schemas and agent-facing data access patterns.
- Experience working with high-volume time-series, metering, IoT or sensor data.
- Familiarity with data quality and data contract tools such as Outstanding Expectations, Deequ or Soda.
- Experience with cross-cloud or cross-organisation data sharing, such as Delta Sharing, along with AWS or Azure cloud platforms.
- Prior experience in the Energy and Utilities domain.
Technology Stack
- Platforms - Databricks and Snowflake
- Table format - Delta
- Streaming - Kafka
- Processing - Spark, in Python or Scala
- Agents - LangGraph
- Agent tool access - MCP servers built with FastMCP
Expected Outcomes – First 12 Months
- Publish the canonical data model and drive its adoption across all core data pipelines.
- Establish a live data catalog, lineage framework and data dictionary with agreed coverage for critical datasets.
- Implement a structured schema change management process, reducing breaking changes impacting downstream consumers to near zero.
- Enable AI agents and MCP tools to consume governed, documented datasets without relying on ad-hoc table access.
This Role May Not Be the Right Fit If
- You primarily create data model diagrams without hands-on SQL or coding experience.
- You have experience administering data cataloguing tools but have not owned data models through multiple schema evolution and breaking-change cycles.
📌 Senior Data Engineer (Hyderabad)
🏢 Moolya
📍 Hyderabad