Senior Platform Quality and Observability Engineer (Hyderabad)

Senior Platform Quality and Observability Engineer (Hyderabad)

18 Nov
|
Coforge
|
Hyderabad

18 Nov

Coforge

Hyderabad

•

Experience:
9+ years in software or quality engineering, including 6+ years building test automation, performance testing or observability for production distributed systems, with ownership of the results. Experience limited to manual testing or tool administration does not meet this requirement.
• Observability: OpenTelemetry instrumentation, collectors, context propagation and the GenAI semantic conventions. Structured logging and metrics. Cloud monitoring platforms such as Azure Monitor and Application Insights, with log query languages such as KQL at depth, dashboards and alert design. LLM observability platforms such as Langfuse or LangSmith, including SDK integrations and management APIs.
• Performance engineering: Load, soak and stress test design, workload modeling, percentiles rather than averages, bottleneck analysis across CPU, memory, connection pools and rate limits, capacity statements, and tooling such as Locust, k6, JMeter or Azure Load Testing.
• Benchmarking and measurement: Experimental design with controls, labeled datasets with expected results, precision, recall, F1 and confusion matrices, the limits of small samples, reproducibility, and controlled comparison of detectors, models or prompts.
• Test engineering: Unit, integration, contract and end-to-end suites designed from requirements, mocking and test data strategy, integration into CI, and the discipline to keep suites deterministic.
• LLM evaluation and agent fluency: LLM API mechanics, tokens and cost, agent loops and tool calls as they appear in a trace, retrieval, evaluation with golden datasets and judge rubrics using tools such as promptfoo, DeepEval or RAGAS, and the role of an AI gateway and guardrails such as PII detection.




• Technical specification and writing: Writing technical specifications, acceptance criteria and test plans from product requirements, maintaining traceability between them, and producing design documents, findings and runbooks that are accurate, concise, state numbers with their limits, and are usable by engineers, reviewers and AI coding tools.
• Python engineering: Typed, asynchronous Python with production HTTP clients, package design and publishing, pytest with fixtures and mocks, command-line tooling, and data analysis libraries such as pandas. Ability to work productively in other languages when the work requires it, using AI coding tools to accelerate the transition while holding the same engineering standard.
• Distributed systems literacy: Working knowledge of the request lifecycle across gateway, service and store, including retries, timeouts and idempotency, queues and caches, sufficient to instrument services correctly, interpret traces and contribute to design discussions.
• Identity and access: OAuth 2.0, OpenID Connect and JWT, managed identities and workload identity, sufficient to authenticate test clients, scheduled jobs and dashboards, and to diagnose authentication and authorization failures.
• Data and storage: SQL, log and time-series stores, the backing stores of observability tooling,



such as PostgreSQL, ClickHouse, Redis and object storage, at an operational level, and immutable storage and retention concepts.
• Cloud and delivery: Docker, Kubernetes including scheduled jobs with workload identity, CI/CD pipelines such as Azure DevOps, working proficiency in Terraform or comparable infrastructure-as-code tooling, and working inside private networks with no internet egress.
• AI-native delivery: Fluent use of AI coding agents to accelerate harness and tooling development, with every output reviewed, tested and understood before it is submitted.
• Communication: Skilled command of spoken and written English, with the ability to explain designs, problems and trade-offs clearly to technical and non-technical audiences, give and receive feedback articulately, restate technical direction accurately, and raise risks early and in writing. PREFERRED
• LLM observability platforms: Self-hosting, scaling and upgrading an LLM observability platform such as Langfuse, including its scoring and dataset APIs.
• Evaluation tooling: Extending an evaluation framework such as promptfoo with custom providers and assertions, and deploying its self-hosted or enterprise edition with pipeline integration.
• Guardrail evaluation: Benchmarking PII detection or content safety services on labeled data.
• Cost attribution: Chargeback or showback reporting for a shared platform service.
• Reliability engineering: Service level objectives, error budgets and alert tuning for a shared platform.
• Regulated industry: Financial services or another regulated industry, including audit and record-keeping obligations.

📌 Senior Platform Quality and Observability Engineer (Hyderabad)
🏢 Coforge
📍 Hyderabad

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: senior platform quality and observability engineer (hyderabad) / hyderabad