We are seeking a Vector Developer to design, implement, and optimize high-performance data pipelines using Vector. The role involves migrating and managing log/metric pipelines from platforms like Splunk, ensuring productive data collection, transformation, and routing to downstream systems such as Datadog or other storage/analytics platforms.
The ideal candidate will have robust experience in observability systems, log processing, and pipeline optimization, with a focus on reliability, performance, and cost efficiency.
Key Responsibilities
Design and build data pipelines using Vector (sources transforms sinks)
Migrate existing pipelines from Splunk or similar tools to Vector
Implement data transformations using Vector Remap Language
Filter, enrich,
and route logs/metrics efficiently to downstream systems
Handle edge cases such as: Oversized records, Malformed data, High-throughput ingestion scenarios
Optimize pipelines for: Performance (low latency, high throughput), Cost (reduce unnecessary log ingestion)
Configure buffering, retries, and backpressure handling for reliability
Monitor and troubleshoot pipeline failures and data inconsistencies
Collaborate with data engineering and platform teams to enforce data contracts
Valuable to have worked in Rust and any cybersecurity domain
Disclaimer : This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
📌 Senior Analyst Chennai
🏢 Latentview
📍 Chennai
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.