Job Title - Senior Engineering / Technical Lead – Data Connectors & Ingestion Platform (70% technical & 30% people mgmt)

Job Location - Pune, Maharashtra

MUST Have Skills - Golang or Python, data pipeline , data connectors / collectors experience, Exp with SaaS products, Strong experience building API integrations

Product

The product is heavily driven by data analytics as well as AI/ML. The core idea is to analyze events & logs from enterprise systems & networks to enable the use cases we are trying to solve in the area of identity & access security.

Position Overview

As customers adopt hundreds of SaaS applications, cloud platforms, IAM providers, security products, and infrastructure technologies, building reliable integrations becomes one of the most critical engineering investments.

Our client is looking for an experienced Senior Technical Lead to own this platform.

You will own the engineering team responsible for building, maintaining, and evolving ecosystem of third-party integrations.

Your team develops scalable, reliable, and high-performance connectors that ingest security and identity data from cloud providers, IAM systems, SaaS applications, endpoint platforms, SIEMs, networking products, and enterprise infrastructure.

You will own engineering execution—from roadmap planning through production operations—while partnering closely with Product Management, Architecture, Security Data Engineering, Solutions Engineering, and Customer Success.

This role combines technical leadership, software architecture, execution excellence, and people leadership.

Responsibilities

Engineering Leadership

- Lead and grow a team of backend engineers responsible for data collection, ingestion and analytics platform.
- Own engineering execution, planning, estimation, delivery, and operational excellence.
- Drive technical decisions and architectural direction for the integrations platform.
- Mentor engineers and establish a strong engineering culture focused on quality, ownership, and continuous improvement.
- Hire, coach, and develop high-performing engineers.





Product & Delivery Ownership

- Own the delivery roadmap for new connectors, enhancements, and platform capabilities.
- Work closely with Product Management to prioritize integrations based on customer needs and business priorities.
- Balance feature development with technical debt reduction and platform scalability.
- Ensure predictable delivery through effective sprint planning and execution.

Data Ingestion Pipeline Architecture

- Design scalable frameworks for building and maintaining hundreds of third-party connectors.
- Improve connector architecture to maximize code reuse, consistency, and maintainability.
- Drive standardization of authentication mechanisms, API clients, data ingestion pipelines, retries, rate limiting, observability, and error handling.
- Ensure the platform supports REST APIs, GraphQL, webhooks, event streaming, log collection, SDKs, and file-based ingestion.

Engineering Excellence

- Establish engineering best practices around:
- Code quality
- Automated testing
- CI/CD
- Reliability
- Performance
- Monitoring
- Documentation
- Improve deployment automation and release confidence.
- Drive operational metrics such as availability, MTTR, connector reliability, and engineering productivity.

Cross-functional Collaboration

Partner closely with:

- Product Management
- Security Data Engineering
- Solutions Engineering
- Customer Success
- Platform Engineering
- Architecture
- Translate customer onboarding requirements into scalable engineering solutions.

Operational Ownership

- Own production health of all integration services.
- Lead incident management and postmortems.
- Improve system observability and monitoring.




- Ensure integrations continue to perform as third-party APIs evolve.
- Drive proactive improvements to reliability and scalability.

Innovation

Continuously evaluate new technologies, APIs, and integration patterns to improve developer productivity and platform capabilities.

Drive automation / AI based development wherever possible to reduce the engineering effort required to build and maintain integrations.

Requirements

Experience

- 15+ years of software engineering experience building distributed backend systems.
- 3+ years leading engineering teams or acting as a technical lead.
- Experience delivering enterprise SaaS products.
- Strong experience building API integrations with third-party platforms.
- Experience owning engineering roadmaps and delivery.

Technical Skills

Robust experience with:

- Distributed systems
- Backend services
- REST APIs
- GraphQL
- Webhooks
- Event-driven architectures
- Microservices
- Asynchronous processing
- Message queues
- Data ingestion pipelines
- Cloud-native applications

Preferred technologies:

- Go (Preferred), Java, or Python
- Kubernetes
- Docker
- AWS/Azure/GCP
- Kafka or similar messaging systems
- PostgreSQL, Click House, Elasticsearch, or similar databases

Leadership Skills

- Strong engineering leadership and execution skills.
- Excellent project planning and prioritization.
- Experience mentoring senior engineers.
- Strong communication and stakeholder management.
- Ability to balance speed with engineering quality.
- Comfortable working in a fast-paced startup environment.

Nice to Have

- Experience building connector platforms or integration frameworks.
- Familiarity with IAM, identity security, cybersecurity, or SIEM technologies.
- Experience working with APIs from cloud providers such as Microsoft, Google, AWS, Okta, Duo, CrowdStrike, Zscaler, Palo Alto, or Microsoft Defender.
- Experience building multi-tenant SaaS platforms.
- Exposure to large-scale data processing and streaming systems.

📌 Senior Engineering Lead Data Connectors & Ingestion Platform (Pune)
🏢 NorthStar HR Consultants
📍 Pune