19 Nov
|
iMerit
|
Bengaluru
iMerit is a leader in expert data solutions for training, tuning, and evaluating AI models and computer vision systems. iMerit helps frontier AI labs, AI-native companies, and enterprises build more accurate, reliable, and domain-aware models. iMerit delivers high-quality multimodal data across industries such as high-tech Generative AI, autonomous mobility, healthcare AI, and robotics. Through Scholars, its global network of specialists such as linguists, physicians, scientists, engineers, and other subject matter experts, iMerit powers high-quality data creation, reasoning evaluation, model alignment, and human feedback workflows for next-generation AI systems. Its proprietary Ango Hub platform allows customers and experts to collaborate on complex multimodal data to generate highly curated and validated training artifacts for high-stakes models. iMerit's client base includes 3 of the top 7 GenAI labs, 8 leading AV companies, leaders in healthcare AI, and several robotics startups. In 2026, iMerit was acquired by EXL (NASDAQ:EXLS), a global data and AI solutions company. For more information, visit imerit.ai.
About the Role
iMerit’s Data & Analytics Platform is the company’s single source of truth for annotation operations, workforce productivity, project performance, and business reporting. It brings together data from operations, workforce, project, and finance systems into an AWS medallion lakehouse (Bronze, Silver, and Gold layers) and serves trusted metrics and dashboards to delivery, finance, and leadership teams. We are transforming the platform into an AI-driven ecosystem anchored by three core initiatives: a knowledge graph connecting customers, projects, people, and metrics; a conversational AI assistant that answers business questions using RAG and text-to-SQL; and AI-assisted data platform automation to monitor, troubleshoot, and improve pipelines. We are seeking a hands-on Senior Data & AI Engineer to build our knowledge graph, RAG workflows, and AI agents on top of our AWS lakehouse alongside senior engineers, while contributing to end-to-end production data pipelines. Robust data engineering skills are mandatory, because every AI capability we build depends on reliable pipelines and well-modelled data.
This role focuses on building AI applications on top of existing large language models and our data platform, rather than training models from scratch.
Key Responsibilities
• Conversational AI & Knowledge Graph: Build and evaluate text-to-SQL and RAG pipelines for the conversational AI assistant, and build the knowledge graph end to end.
• AI Agents & Platform Automation: Design and prototype AI agents that monitor data pipelines, diagnose failures, and propose fixes with human-in-the-loop approval before deployment.
• AI-Ready Data & Semantic Context: Curate high-signal AI inputs, including standardized metric definitions, golden question-and-answer datasets with verified SQL, and well-documented Gold tables.
• Lakehouse Pipelines & Data Modelling: Build and maintain Glue/PySpark and Lambda jobs moving data across Bronze, Silver, and Gold Apache Iceberg tables (queried via Athena), and model business-ready facts and dimensions.
• Change Data Capture (CDC) & Reliability: Build and support CDC pipelines into Iceberg using AWS DMS or Debezium with Amazon MSK, managing schema evolution, late events, and reconciliation checks.
• Orchestration & Cost Tuning: Orchestrate workflows with Airflow, Step Functions, or Glue Workflows, owning SLAs, backfills, partitioning, compaction, and query performance.
• Data Quality, Security & Governance: Implement automated data quality checks, lineage, catalog documentation, PII masking, KMS encryption, and Lake Formation access controls.
• Engineering Best Practices: Validate all AI features and data pipelines in Dev with automated tests and LLM evaluations before production release using Git, code reviews, CI/CD, and Terraform.
• Cross-Functional Collaboration: Partner with delivery, finance, and workforce teams to translate business questions into AI workflows and data models, supporting BI developers (QuickSight, Looker).
Qualifications
• Data Engineering Experience (Mandatory): 5–8 years in data engineering, including at least 4 years building and operating production data pipelines on the cloud.
• Applied AI & LLM Systems: Hands-on experience building and evaluating LLM applications, in production or as a working pilot, such as RAG, text-to-SQL, or vector search.
• Core Programming: Strong hands-on proficiency in Python, SQL, and PySpark, with a focus on debugging, performance tuning, and maintainable production code.
• AWS Data Stack: At least 2 years hands-on with core AWS data services: Amazon S3, AWS Glue, Amazon Athena, and AWS Lambda.
• Modern Table Formats & CDC: Experience with Apache Iceberg, Delta Lake, or Apache Hudi (upserts, schema evolution), and hands-on experience building CDC or streaming pipelines (AWS DMS, Debezium, Kafka, or Amazon MSK).
• Security & DevOps: Sound understanding of data governance, PII protection, access control, Git, CI/CD, and infrastructure as code (Terraform).
• Communication & Ownership: Strong communication and ownership, with the ability to work directly with business stakeholders. Additional Qualifications
• Knowledge Graphs & AI Agents: Experience with graph databases and ontology modelling (e.g., Neo4j, Amazon Neptune) or agent frameworks (e.g., LangGraph, Amazon Bedrock Agents).
• LLM Evaluation & Observability: Experience building golden evaluation datasets and using LLM observability/eval frameworks (e.g., Langfuse, Ragas).
• Semantic Layers & Catalogs: Familiarity with dbt Semantic Layer, Amazon DataZone, or OpenLineage.
• Cloud Architecture: AWS certifications or experience operating in a multi-account AWS environment. Why Join Us? At iMerit, you will build the intelligent Data & Analytics Platform powering some of the world’s most advanced AI programs. You will help drive the platform’s evolution into AI, building the knowledge graph, conversational AI assistant, and AI pipeline agents, and see the direct impact of your work in how delivery, finance, and leadership teams make decisions every day. Join us to build the foundations for AI-driven analytics at iMerit, an EXL company.
📌 Senior Data (Bengaluru)
🏢 iMerit
📍 Bengaluru