SecNinjaz Technologies LLP
Openings: 1 | Experience: around 2 years
Location / work mode: Delhi
About the role
Build the data, evaluation and model-improvement capability behind AI-powered cybersecurity systems.
Turn reviewed security work into trustworthy datasets, measure performance on unseen cases, and run
reproducible language-model post-training experiments.
You will develop and test Python pipelines, working with cybersecurity specialists and an agent/runtime
engineer. You need robust applied AI/ML engineering and practical cybersecurity ability to judge
evidence, understand labels and determine whether an experiment improves a security workflow.
What you will do
- Turn approved workflow traces, tool outputs, failures, expert corrections and verified outcomes into
versioned datasets, with provenance, permitted-use tracking, sensitive-data handling, deduplication and
separate training, validation and held-out test cases, grouping related applications, engagements and
near-duplicate traces to prevent leakage between splits.
- Work with security specialists to define tasks,



labels, negative cases and independently checked
outcomes; investigate ambiguous labels, false positives and data leakage.
- Build repeatable evaluations for task success, finding quality, tool use, regressions, latency and cost.
Compare model and harness changes against versioned baselines, isolate changes where practical,
and document interactions, uncertainty and evaluation limitations.
- Run reproducible language-model post-training experiments using supervised fine-tuning,
preference-based methods or reinforcement learning where appropriate; explain the chosen method
and investigate misleading reward signals.
- Jointly define versioned trace and tool interfaces, evaluation criteria and release checks with the
agent/runtime engineer and cybersecurity specialists. Security specialists review domain labels and
validate findings.
- Work with the runtime engineer on controlled execution envir

📌 AI/ML Engineer — Data, Evaluation (Vijayawada)
🏢 SecNinjaz Technologies
📍 Vijayawada