Turn CAD intelligence into real-time, low-latency MR overlays usable on the shop floor. You own the layer between computed alignment data and what an operator actually sees through their headset. If overlays lag, flicker, or misalign – operators won't trust it, and the product is dead.
System Ownership
- Primary: MR rendering pipeline (alignment transform → holographic overlay → operator display)
- Primary: Spatial anchoring system (persistent world mapping, anchor drift compensation)
- Primary: Industrial UX layer (heatmaps, tolerance visualisation, contextual guidance, gesture/voice interaction)
- Secondary interface: 3D Perception team (you consume their alignment transforms + deviation maps)
- Secondary interface: SaaS Backend (multi-user session state, anchor sync across devices)
- Does NOT own: Point cloud registration (CV team), edge inference models (Edge AI team), cloud analytics dashboards (Backend team)
What You Will Build
Real-time 3D overlay rendering – Render CAD geometry holographically overlaid on physical structures at 90 Hz.
The operator must see design intent superimposed on the real object with < 2mm positional error.- Spatial anchors & persistent world mapping – Place anchors that survive across sessions, device restarts, and multiple users. Handle anchor drift in large open industrial sites (> 500m²).
- Deviation heatmap visualisation – Colour-coded deviation overlays (green/yellow/red) mapped directly onto physical surfaces. Operators must instantly see where a structure deviates from CAD tolerance.
- Contextual guidance system – Directional arrows guiding operators to inspection points. Step-by-step measurement sequences. Voice-activated annotation.
- Industrial device UX – Interface designed for gloved hands, noisy environments, bright sunlight. Not consumer AR – this is factory-grade.
- Multi-user shared MR sessions – Multiple operators viewing the same holographic overlay simultaneously with consistent spatial state.
- Apple Vi