Senior Engineering Lead – Data Connectors & Ingestion Platform (Pune)

Senior Engineering Lead – Data Connectors & Ingestion Platform (Pune)

06 Aug
|
NorthStar HR Consultants
|
Pune

06 Aug

NorthStar HR Consultants

Pune

Job Title - Senior Engineering / Technical Lead – Data Connectors & Ingestion Platform (70% technical & 30% people mgmt)

Job Location - Pune, Maharashtra

MUST Have Skills - Golang or Python, data pipeline , data connectors / collectors experience, Exp with SaaS products, Strong experience building API integrations Product The product is heavily driven by data analytics as well as AI/ML. The core idea is to analyze events & logs from enterprise systems & networks to enable the use cases we are trying to solve in the area of identity & access security.

Position

Overview

As customers adopt hundreds of SaaS applications, cloud platforms, IAM providers, security products, and infrastructure technologies, building reliable integrations becomes one of the most critical engineering investments.

Our client is looking for an experienced Senior Technical Lead to own this platform. You will own the engineering team responsible for building, maintaining, and evolving ecosystem of third-party integrations.

Your team develops scalable, reliable, and high-performance connectors that ingest security and identity data from cloud providers, IAM systems, SaaS applications, endpoint platforms, SIEMs, networking products, and enterprise infrastructure.

You will own engineering execution—from roadmap planning through production operations—while partnering closely with Product Management, Architecture, Security Data Engineering, Solutions Engineering, and Customer Success.

This role combines technical leadership, software architecture, execution excellence, and people leadership. Responsibilities

Engineering Leadership

Lead and grow a team of backend engineers responsible for data collection, ingestion and analytics platform.

Own engineering execution, planning, estimation, delivery, and operational excellence.

Drive technical decisions and architectural direction for the integrations platform.

Mentor engineers and establish a strong engineering culture focused on quality, ownership, and continuous improvement.

Hire, coach,



and develop high-performing engineers.

Product & Delivery Ownership

Own the delivery roadmap for new connectors, enhancements, and platform capabilities.

Work closely with Product Management to prioritize integrations based on customer needs and business priorities.

Balance feature development with technical debt reduction and platform scalability.

Ensure predictable delivery through effective sprint planning and execution.

Data Ingestion Pipeline Architecture

Design scalable frameworks for building and maintaining hundreds of third-party connectors.

Improve connector architecture to maximize code reuse, consistency, and maintainability.

Drive standardization of authentication mechanisms, API clients, data ingestion pipelines, retries, rate limiting, observability, and error handling.

Ensure the platform supports REST APIs, GraphQL, webhooks, event streaming, log collection, SDKs, and file-based ingestion.

Engineering Excellence

Establish engineering best practices around:

Code quality

Automated testing

CI/CD

Reliability

Performance

Monitoring

Documentation

Improve deployment automation and release confidence.

Drive operational metrics such as availability, MTTR, connector reliability, and engineering productivity.

Cross-functional Collaboration

Partner closely with

Product Management

Security Data Engineering

Solutions Engineering

Customer Success

Platform Engineering

Architecture

Translate customer onboarding requirements into scalable engineering solutions.

Operational Ownership

Own production health of all integration services.

Lead incident management and postmortems.





Improve system observability and monitoring.

Ensure integrations continue to perform as third-party APIs evolve.

Drive proactive improvements to reliability and scalability.

Innovation

Continuously evaluate new technologies, APIs, and integration patterns to improve developer productivity and platform capabilities.

Drive automation / AI based development wherever possible to reduce the engineering effort required to build and maintain integrations. Requirements

Experience

15+ years of software engineering experience building distributed backend systems.

3+ years leading engineering teams or acting as a technical lead.

Experience delivering enterprise SaaS products.

Strong experience building API integrations with third-party platforms.

Experience owning engineering roadmaps and delivery.

Technical

Skills

Strong experience with

Distributed systems

Backend services

REST APIs

GraphQL

Webhooks

Event-driven architectures

Microservices

Asynchronous processing

Message queues

Data ingestion pipelines

Cloud-native applications

Preferred technologies

Go (Preferred), Java, or Python

Kubernetes

Docker

AWS/Azure/GCP

Kafka or similar messaging systems

PostgreSQL, Click House, Elasticsearch, or similar databases

Leadership Skills

Strong engineering leadership and execution skills.

Excellent project planning and prioritization.

Experience mentoring senior engineers.

Strong communication and stakeholder management.

Ability to balance speed with engineering quality.

Comfortable working in a fast-paced startup workplace.

Nice to Have

Experience building connector platforms or integration frameworks.

Familiarity with IAM, identity security, cybersecurity, or SIEM technologies.

Experience working with APIs from cloud providers such as Microsoft, Google, AWS, Okta, Duo, CrowdStrike, Zscaler, Palo Alto, or Microsoft Defender.

Experience building multi-tenant SaaS platforms.

Exposure to large-scale data processing and streaming systems.

📌 Senior Engineering Lead – Data Connectors & Ingestion Platform (Pune)
🏢 NorthStar HR Consultants
📍 Pune

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: senior engineering lead – data connectors & ingestion platform (pune) / pune

Subscribe to this job alert:

Get the latest job offers by email for: senior engineering lead – data connectors & ingestion platform (pune) / pune