Compiler Engineer (GPU Backend)

Hyderabad, India | On-site

Experience: 5+ Years

About OXMIQ

OXMIQ provides complete hardware and software GPU IP, so our customers can build their own AI silicon. Our OxCore architecture combines scalar, tensor and SIMT engines on one platform. It delivers CUDA compatibility alongside a flexible, fully programmable architecture.

OxPython, our software stack, runs on top of it and lets CUDA-optimized models run unmodified on Oxmiq’s GPU IP, giving day-zero support for new AI models. We have an established software team and a working stack. We’re now moving from development to production delivery, hardening the platform and scaling it to meet real customer demands.

You’ll join the OXMIQ compiler team, building the MLIR/LLVM-based compiler that lowers AI models and kernels onto Oxmiq hardware. We hire at multiple levels - Final job title, internal leveling, and compensation will be determined based on the candidate's total relevant experience, technical expertise, and interview performance.

Key Responsibilities

- Design and implement compiler infrastructure for GPU-accelerated workloads, including lowering pipelines, optimization passes, and code generation backends.
- Develop and optimize compilation passes targeting Oxmiq hardware IP and GPU architectures.
- Design and implement segmentation and scheduling strategies for the Oxmiq hardware backend to maximize hardware utilization, throughput, and execution efficiency.
- Develop compiler optimizations for operator fusion, tiling, memory planning, and workload partitioning across GPU hardware.
- Collaborate with architecture and hardware teams to translate performance requirements into efficient compiler transformations and code generation strategies.
- Work with kernel engineers to support Triton-based programming models, custom operator lowering,



and integration with modern LLM serving frameworks such as vLLM and SGLang.
- Optimize compiler output for throughput, latency, memory efficiency, and scalability across AI workloads.
- Participate in architecture discussions, design reviews, and code reviews.
- Support compiler performance profiling, benchmarking, debugging, and root cause analysis.

Required Qualifications

- 5+ years of experience in compiler engineering, with a focus on GPU, NPU, or AI accelerator software stacks.
- Strong proficiency in C++.
- Hands-on experience with at least one modern compiler framework such as MLIR, LLVM, TVM, or IREE.
- Experience designing or implementing compiler optimizations, scheduling algorithms, segmentation/partitioning strategies, or lowering pipelines for GPU/NPU hardware.
- Solid understanding of compiler concepts including IR transformations, code generation, instruction scheduling, register allocation, vectorization, and memory hierarchy optimization.
- Familiarity with GPU programming models such as CUDA or Triton.
- Understanding of GPU architecture fundamentals including thread execution models, memory systems, occupancy, synchronization, and performance bottlenecks.
- Experience optimizing compiler-generated code for performance on modern GPU or AI accelerator hardware.
- Strong debugging, profiling, and performance analysis skills.




- Hands-on experience with Claude Code or equivalent AI-assisted software development workflows.

Preferred Qualifications

- Experience developing compiler backends for custom AI accelerators, NPUs, or GPU IP.
- Experience with Triton compiler internals or other high-level GPU kernel frameworks.
- Familiarity with kernel fusion, operator tiling, graph partitioning, auto-tuning, and workload scheduling.
- Exposure to quantization, mixed precision, sparsity-aware compilation, or memory optimization techniques.
- Experience integrating compiler technology with LLM serving frameworks such as vLLM or SGLang.
- Experience with performance modeling, roofline analysis, or hardware-aware optimization.
- Contributions to open-source compiler projects such as LLVM, MLIR, TVM, Triton, or IREE.
- Python scripting experience for compiler tooling, testing, automation, or benchmarking.

Education

B.E./B.Tech/M.E./M.Tech/MS/Ph.D. in Computer Science, Computer Engineering, Electrical Engineering, or a related field.

Working Environment The successful candidate will work within a compact, senior team comprising compiler engineers, hardware architects, and kernel authors. You’ll collaborate directly on MLIR, LLVM backend development, and GPU code generation for production silicon, alongside the people designing the hardware.

Compensation & Advantages

OXMIQ offers a competitive compensation package, including base salary, equity participation, comprehensive medical coverage, and the opportunity to contribute to foundational silicon and software technology

OXMIQ is an equal opportunity employer. We evaluate qualified applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or any other legally protected characteristic.

📌 Compiler Engineer (GPU Backend) (Hyderabad)
🏢 Oxmiq Labs
📍 Hyderabad