Role Summary :

We are looking for an experienced ELK Expert (6 - 12 years) to architect, optimize, secure, and operate large-scale Elasticsearch clusters and logging/observability platforms. The role involves designing scalable data pipelines, ensuring high search performance, managing upgrades, and maintaining compliance-driven logging standards.

Key Responsibilities :

Platform Architecture &

- Design :
- Define and optimize Elasticsearch cluster architecture, including node roles, shard allocation, replication strategy, and hot-warm-cold tiering (ILM).
- Design index patterns, mappings, and retention policies to support scalability and compliance.

Performance Optimization :

- Tune queries, analyzers, indexing pipelines, and caching strategies.
- Maintain low-latency search SLAs by optimizing cluster load, heap, GC, and resource allocation.
- Oversee performance benchmarking and capacity planning.

Security &

- Compliance :
- Implement TLS/mTLS, encryption at rest, and RBAC/permission models.
- Ensure continuous compliance with enterprise audit frameworks (e.g., ICIF, CSLO).
- Maintain secure configuration baselines and monitor for deviations or vulnerabilities.

Upgrades &

- Maintenance :
- Lead upgrades and patching for Elasticsearch, Kibana, Logstash, and supporting components.




- Remediate CVEs with minimal downtime using rolling upgrades or blue/green patterns.
- Maintain cluster health and stability through routine maintenance tasks.

Data Pipeline Management :

- Configure and optimize Logstash pipelines, Beats ingestion, and enrichment processors.
- Integrate ELK with Kafka for scalable and resilient data ingestion.
- Troubleshoot ingestion delays, mapping conflicts, or pipeline bottlenecks.

Monitoring &

- Troubleshooting :
- Build and manage Kibana dashboards, alerts, and visualizations for operational visibility.
- Diagnose and resolve slow queries, cluster instability, failed ingestion pipelines, and shard imbalance issues.
- Implement proactive alerting for node health, disk usage, heap pressure, and indexing failures.

Required Skills &

Experience :

- 8 - 11 years of experience with ELK Stack architecture, operations, and tuning.
- Solid in Elasticsearch internals: shards, replicas, clusters, ILM, node roles, and performance tuning.
- Hands-on with Logstash, Beats, Kibana visualization, and alerting.
- Experience integrating ELK with Kafka, including offset management and delivery guarantees.
- Solid understanding of TLS/mTLS, RBAC, encryption, and enterprise security standards.
- Expertise in troubleshooting distributed systems and query performance.

📌 ELK Expert - Platform Engineering (India)
🏢 Upcruit
📍 India