What you'll own

Synthetic data generation
- Design, extend, and evaluate our agentic pipeline for generating domain-specific pre-training and instruction-tuning data from public datasheets, reference manuals, and open-source embedded codebases
- Invent and test data generation strategies: specification-to-code synthesis, compliance annotation, formal requirement extraction from natural language, multi-step reasoning trace generation from hardware documentation
- Evaluate data quality rigorously — not just statistical measures, but whether models trained on the data actually improve on real embedded engineering tasks
- Identify the highest-value data gaps in our training corpus and design generation pipelines to fill them

Domain-specific model training and adaptation
- Own continued pre-training and instruction-tuning runs across H2Loop's domain-specific model families
- Design and evaluate training recipes: data mixture, tokenizer configuration, instruction format, curriculum, and RLHF/RLAIF alignment approaches
- Benchmark model families rigorously — not just perplexity,



but task-level accuracy on hardware-specific code generation, compliance repair, and specification-grounded reasoning
- Maintain H2Loop's model evaluation infrastructure: curated benchmark suites, regression pipelines, and human eval protocols tied to real customer tasks

RL with hardware feedback
- Design and run reinforcement learning experiments using real hardware boards as the reward workplace — generated code that either works on the hardware or doesn't, producing ground-truth training signal no synthetic benchmark can replicate
- Develop reward models and preference data pipelines from hardware pass/fail signals, user feedback, and formal verification outcomes
- Investigate and prototype sample-efficient RL approaches suitable for the low-throughput, high-cost signal that physical hardware evaluation provides

Neurosymbolic methods and formal verification
- Research and prototype approac

📌 AI Research Engineer (Bangalore Metropolitan Area)
🏢 Soch Street
📍 Bangalore Metropolitan Area