Consultant | ETL | Bengaluru | Engineering

Description

ELK Stack Consultant: Admin and Architect

Role Overview:

As an ELK Stack Consultant with expertise in both administration and development, you will play a pivotal role in implementing, managing, and optimizing Elasticsearch-based solutions. Your role will encompass configuring and maintaining infrastructure, developing pipelines, creating insightful dashboards, and troubleshooting issues to ensure system efficiency and reliability.

Experience:

3 to 8 years of experience working with ELK Stack or similar technologies, with a combination of hands-on administration and development expertise.

Key Responsibilities:

Technical Skills:

- ELK Stack Administration & Development:
- Deploy, configure, and maintain Elasticsearch, Logstash, Kibana, and Beats infrastructure to ensure system reliability and scalability. Monitor Elasticsearch cluster health, node performance, and usage metrics, optimizing for performance. Develop and maintain Logstash pipelines for effective data ingestion and transformation from diverse sources. Create, manage, and optimize Kibana dashboards, including Spaces, Data Views, Canvas, alerting, and reporting, to deliver actionable business insights.
- Elasticsearch Expertise:
- Proficient in Query DSL, templates, data streams, Index Lifecycle Management (ILM), Cross-Cluster Replication (CCR), snapshots, and shard management.
- Pipelines & Ingestion:
- Hands-on experience with Logstash, Beats (Filebeat, Metricbeat, Auditbeat), Kafka/Redis/JDBC ingestion methods, and Elasticsearch ingest pipelines.
- System Maintenance & Security:
- Perform routine updates, upgrades, and backups for all ELK components. Implement robust security policies, including X-Pack features, LDAP/SAML authentication, TLS encryption, Role-Based Access Control (RBAC), audit logging, and compliance frameworks.




- Troubleshooting & Performance Optimization:
- Diagnose and resolve system issues such as performance bottlenecks and scalability challenges. Optimize resource utilization through JVM tuning, Linux internals, disk I/O, Host Bus Adapter (HBA)/storage management, network stack optimization, garbage collection (GC), and cluster state recovery.
- Infrastructure & DevOps:
- Experience with Kubernetes, Docker, Helm, Terraform, Ansible, Puppet, and CI/CD pipeline automation.
- Cloud & Hybrid Environments:
- Skilled in AWS OpenSearch/Elastic Cloud, Azure Elastic, GCP integrations, and cloud migration playbooks.
- Ecosystem Integration & Monitoring:
- Integrate databases, APIs, and custom applications with the ELK stack. Working knowledge of monitoring tools like Grafana, Prometheus, and Elastic-native solutions.
- Collaboration & Documentation:
- Work closely with stakeholders to gather requirements and develop tailored ELK-based solutions. Collaborate with development teams to integrate ELK with application pipelines and data workflows. Document system configurations, workflows, and troubleshooting procedures for effective knowledge sharing.

Soft Skills:

- Strong problem-solving and analytical skills.
- Excellent communication and collaboration abilities for cross-functional team interaction.
- Flexibility to meet critical deadlines as needed.

Preferred Qualifications:

- Proficient in Elasticsearch Query DSL, Logstash pipeline development, and Kibana dashboarding.
- Strong scripting skills in Python, Shell, or similar languages.
- Familiarity with Linux/Unix system administration and basic networking protocols (e.g., HTTP, TCP).
- Knowledge of security best practices for ELK Stack.
- Experience with monitoring tools like Grafana, Prometheus, or ELK-native solutions.
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- Certification in ELK Stack or relevant technologies is highly desirable.

📌 ELK Stack Consultant: Admin and Architect (Bengaluru)
🏢 Arminus
📍 Bengaluru