16 Aug
|
Ellkay Software
|
India
16 Aug
Ellkay Software
India
Role & responsibilities
AWS SageMaker Operations & Orchestration
- Design and implement SageMaker Pipelines with complex DAG authoring for end-to-end ML workflows including data preprocessing, training, evaluation, and deployment
- Configure and optimize SageMaker Processing Jobs, Training Jobs (PyTorch/HuggingFace containers), and Managed Spot Instances for cost-effective model training
- Manage SageMaker Model Registry with versioning, lineage tracking, and approval workflows for model governance
- Implement sophisticated endpoint deployment strategies including blue/green traffic routing, canary deployments, and A/B testing configurations
- Configure and maintain SageMaker Model Monitor for continuous data quality monitoring, model quality assessment, bias detection, and feature drift alerting
GenAI Model Lifecycle Management
- Build operational frameworks for Amazon Bedrock model deployments including provisioned throughput management, guardrail configuration, and usage monitoring
- Implement automated evaluation pipelines for foundation model outputs with quality gates and human-in-the-loop review workflows
- Design prompt versioning systems integrated with model registry for reproducible GenAI deployments
- Monitor GenAI model performance including latency, cost per inference, hallucination rates, and guardrail trigger metrics
Model Lifecycle Automation
- Develop automated retraining trigger systems based on data drift, performance degradation, scheduled intervals, or manual triggers
- Implement evaluation gates as code with configurable thresholds for metrics (F1, precision, recall, AUC, etc.) before model promotion
- Build automated model promotion workflows from dev staging prod with approval gates and rollback capabilities
- Design rollback automation with traffic shifting strategies to quickly revert to previous model versions upon performance degradation
Training Data Engineering
- Build AWS Glue ETL pipelines for training corpus assembly, transforma
📌 Sr. MLOps/GenAI Ops Engineer (India)
🏢 Ellkay Software
📍 India