We are looking for an experienced Data Engineer / Data Lead to design and implement the data layer supporting a Data Normalization Engine .
The ideal candidate will have strong experience in data modeling, ETL pipelines, AWS DynamoDB, AWS Glue, data validation, and embedding storage patterns , with the ability to build scalable data structures that support complex normalization and matching workflows.
Key Responsibilities
- Design and implement a canonical data schema to normalize structurally varied builder documents into a standardized field set.
- Design and implement the community profile data model , including rules, mandates, waste factors, and builder attributes.
- Build hierarchical data models across Lot → Community → Builder Region → Builder National → Global levels.
- Develop the synonym pool and embedding store supporting a 3-tier learning cascade.
- Build data validation and quality-scoring pipelines to ensure data accuracy and consistency.
- Integrate data workflows with the existing SAP Material Master to support fuzzy matching.
- Ensure clean and reliable data flow into the existing Phase 1 extraction, matching, and takeoff pipeline .
- Design scalable data storage and retrieval patterns using AWS services.
- Collaborate with engineering and product teams to translate data requirements into robust technical solutions.
Required Skills ✅ Data Engineering – Level 3
✅ AWS DynamoDB – Level 3
✅ AWS Glue – Level 3
✅ Robust experience in data modeling and schema design
✅ Experience building ETL/ELT pipelines
✅ Experience with data validation and quality frameworks
✅ Understanding of embedding storage / vector data patterns
✅ Experience integrating data with enterprise systems such as SAP
✅ Strong understanding of data normalization and hierarchical data models
Preferred Experience
- Experience with fuzzy matching and similarity-based data processing
- Experience working with AI/ML-enabled data pipelines
- Familiarity with embeddings, synonym management, and learning systems
- Experience designing data architectures for document processing or data normalization platforms
Engagement Details ? Hyderabad, India
?️ Level: L5
⏱️ 30 hours/week
? 16-week engagement
? Interested candidates can share their updated CV/profile for consideration.