Providence is seeking an exceptional Principal Cybersecurity Architect to lead the research, development, and deployment of Small Language Models (SLMs) specialized for healthcare and cybersecurity applications. This role combines cutting-edge machine learning research with practical implementation, requiring deep expertise in model architecture design, advanced fine-tuning techniques, graph-based knowledge systems, and vector-based retrieval augmentation.

The ideal candidate will architect and train efficient, domain-specialized language models using state-of-the-art techniques including LoRA/QLoRA, graph neural networks, vector embeddings, and hybrid retrieval systems. This position requires both depth in machine learning and hands-on implementation skills to deliver high-impact solutions for healthcare operations, clinical workflows, and security applications.

Key Responsibilities

Design, develop, and optimize Small Language Models for healthcare and cybersecurity domains using advanced architectures (effective transformers, MoE, sparse attention),



compression techniques (quantization: INT8/INT4/GPTQ/AWQ, pruning, knowledge distillation), and emerging SLM architectures (Phi-3, Gemma, Mistral 7B variants) with rigorous ablation studies balancing model size, inference speed, accuracy, and resource requirements

Implement parameter-efficient fine-tuning (PEFT) techniques including LoRA, QLoRA, prefix tuning, prompt tuning, and adapter layers; design instruction tuning pipelines aligning SLMs with clinical terminology and security protocols; develop multi-task learning frameworks; and deploy continuous learning strategies using DPO, RLHF, and active learning while optimizing hyperparameters to prevent overfitting on limited healthcare datasets

Implement knowledge graphs capturing domain relationships and build graph-augmented language models integrating Neo4j/Cosmos DB with unstructured text processing, leveraging GNN components (PyTorch Geometric, DGL, GraphSAGE

📌 Principal Cybersecurity Architect (Hyderabad)
🏢 providence
📍 Hyderabad