Key Responsibilities

1. Splunk Deployment & Configuration

- Install, configure, and maintain Splunk Enterprise / Splunk Cloud
- Design Splunk architecture (Forwarders, Indexers, Search Heads, Clusters)
- Configure:
- Universal Forwarders on SAS servers
- Index management and retention policies
- Source types for SAS logs

2. SAS Platform Integration

- Integrate Splunk with:
- SAS Metadata Server logs
- SAS Workspace Server logs
- SAS Grid Manager logs
- SAS Web/Application Server logs

- Enable ingestion of:

- SAS batch logs
- User activity logs
- Authentication and access logs

- Build parsing logic for SAS-specific log formats

3. Monitoring & Observability

- Develop real-time dashboards for:
- SAS job performance
- Grid utilization and workload monitoring
- System resource usage (CPU, memory, I/O)

- Create alerts for:

- Job failures and abnormal terminations
- Performance degradation
- Unauthorized access attempts

- Implement SLA/SLO monitoring aligned to SRE practices

4. Logging & Analytics

- Define log ingestion strategy (structured/unstructured data)
- Develop Splunk queries (SPL) for:
- Root cause analysis
- Trend analysis
- Incident investigation

- Create reusable dashboards and reports for operations teams

5. Security & Compliance (GxP / Audit Readiness)

- Implement audit logging for:
- User activity tracking
- Data access monitoring

- Ensure compliance with:

- GxP regulations
- 21 CFR Part 11 requirements

- Support audit readiness by:

- Maintaining traceability of logs
- Generating audit reports via Splunk

- Integrate Splunk with security tools (e.g., SIEM use cases)

6. Automation & Optimization

- Automate log onboarding workflows




- Optimize indexing performance and data retention
- Implement log filtering to reduce noise and cost
- Enable predictive analytics for capacity planning

7. Incident & Problem Management (ITIL Aligned)

- Support Incident, Problem, and Change Management processes
- Use Splunk insights to:
- Reduce mean time to resolution (MTTR)
- Identify recurring issues

- Collaborate with SAS administrators and infrastructure teams

8. Documentation & Governance

- Maintain:
- Architecture diagrams
- Log onboarding documentation
- Dashboard catalogs

- Define standard operating procedures (SOPs)
- Ensure configuration and validation documentation for audits

Required Skills & Experience

Technical Skills

- Hands-on experience with:
- Splunk SPL (Search Processing Language)
- Forwarders, Indexers, and clustering

- Experience with SAS Platform (SAS 9.4 highly preferred)
- Knowledge of:

- Linux/Unix systems
- Shell scripting / Python

Domain Expertise

- Experience in Life Sciences / Pharma / GxP environments
- Understanding of:
- Audit logging requirements
- Regulatory compliance standards

Process & Framework Knowledge

- ITIL (Incident, Problem, Change Management)
- SRE practices (Monitoring, Alerting, Reliability)
- DevOps and observability concepts

Key Deliverables

- Fully integrated Splunk solution for SAS monitoring
- Real-time dashboards and alerts
- Audit-ready logging and reporting framework
- Performance and capacity insights for SAS workloads

Success Metrics

- Reduced incident detection and resolution time
- Improved SAS platform uptime and performance visibility
- Audit compliance readiness (zero audit findings)

📌 Splunk Engineer (Telangana)
🏢 Cerebra
📍 Telangana