25 Sep
|
Innocap
|
Coimbatore
25 Sep
Innocap
Coimbatore
ABOUT INNOCAP
Innocap is the leading Dedicated Managed Account Platform (DMAP) globally, providing institutional allocators with a superior way to structure, access, and oversee their alternative investments. With over US$125 billion on the platform and more than 530 employees across the globe, we are transforming how allocators access and manage alternative investments.
Powered by our people, processes and purpose‑built technology, Innocap is seeking forward-thinking individuals to join us on our exciting journey. At Innocap, you won't just manage what’s here today. You’ll build what comes next. Here, careers are about building, not maintaining.
We give our people the freedom to think boldly, move quickly, and create real impact with less red tape. Driven by transformation, trust and collaboration, we never settle for the status quo and are constantly finding better ways to serve our clients and actively shape the future of the investment industry.
At Innocap, your work makes a difference every day – and helps build what’s next for our clients, the industry, and your career.
Because the future doesn’t build itself. We do.
About the Role
We are looking for a highly skilled Lead Data Ingestion Engineer with 7–10+ years of experience in designing and leading scalable, secure, and automated data ingestion frameworks. This role requires deep expertise in SSIS, Databricks, Python, Azure Functions, as well as solid foundational skills in C#, .NET, DevOps, CI/CD, and Azure cloud. You will mentor a team of data engineers, define architectural best practices, ensure reliability of ingestion ecosystems, and collaborate closely with data platform, analytics, and business teams.
Key Responsibilities
Technical Leadership & Architecture
· Lead the design and development of enterprise-grade ingestion architectures using Databricks, SSIS, Azure Functions and cloud services.
· Define standards, frameworks, and reusable components for ingestion across the organization.
· Drive modernization initiatives such as SSIS-to-ADF migration, batch-to-real-time ingestion, and automation improvements.
· Ensure cost optimization, observability,
data quality, and governance best practices.
Hands-On Engineering
· Build and enhance ETL/ELT workflows using Python, Databricks (PySpark), SQL, and Azure components.
· Develop C#/.NET services or functions for ingestion, validation, and integration with APIs/microservices.
· Optimize ingestion workflows for performance, cost, and scalability.
· Troubleshoot ingestion failures, production issues, and provide RCA.
Team & Stakeholder Collaboration
· Mentor and guide junior and mid-level data engineers.
· Conduct architectural reviews, code reviews, and provide technical coaching.
· Partner with Architects, DevOps Engineers, QA, and business stakeholders to align ingestion solutions with enterprise strategy.
Operations & Delivery
· Own the CI/CD deployment process for ingestion components using Azure DevOps.
· Ensure monitoring, alerting, automated validation, and recovery frameworks are in place.
· Lead production releases, incident management, and lifecycle maintenance.
· Design ingestion and data engineering frameworks with AI-powered monitoring and anomaly detection to automatically flag ingestion failures and propose remediation steps.
· automate unit test and integration test generation using AI agents to expand test coverage, detect edge cases proactively, and speed up QA cycles.
Qualifications
· Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or related field.
· 7–10+ years of experience in data engineering/data ingestion, with at least 2–3 years in a lead role.
· Deep experience with Databricks, Azure Functions, SSIS, and Python.
· Strong programming background in Python and C#/.NET.
· Solid hands-on experience with SQL Server, T-SQL,
and performance tuning.
· Experience building CI/CD pipelines with Azure DevOps.
· Strong leadership, communication, and stakeholder management skills.
Must-Have Skills
· Strong Python development skills for ingestion, automation, and transformation.
· Experience migrating SSIS workloads to Azure-native tools.
· Proficiency with Azure Functions for serverless ingestion pipelines.
· Hands-on experience with Databricks (PySpark) for distributed data processing.
· Solid C#, .NET background for integration and ingestion services.
· Strong SQL and relational database ingestion experience.
· Experience with Git, CI/CD, and DevOps automation.
Nice-to-Have Skills
· Experience with Delta Lake, Lakehouse architecture, or Synapse.
· Experience with Docker/Kubernetes for containerized workloads.
· Knowledge of data governance, lineage, and security practices.
· Domain knowledge in BFSI or financial datasets.
Our Offerings
Hybrid work culture: Flexible working environment to promote a healthy work-life balance.
A smart, talented & agile team: International collaboration across locations and time zones, with a focus on learning, sharing, and fun.
Competitive compensation package: Attractive salary, comprehensive insurance, fitness discounts, and employee assistance programs.
Continuous learning opportunities: Access to professional development platforms and resources.
Diversity and Inclusion: Commitment to fostering a diverse and inclusive environment for all employees.
#Lihybrid
Innocap is an equal opportunity employer. We are dedicated to hiring diverse talent and fostering an inclusive, equitable, and people-first culture where everyone feels valued, respected, and empowered to contribute fully – regardless of their background. With employees across the globe, we firmly believe that the unique perspectives and strengths of our people help us grow stronger and allow us to better serve our clients.
If you require accommodation at any stage during your application process, please let us know.
Innocap's Global Privacy Notice
📌 Lead Software Developer (Coimbatore)
🏢 Innocap
📍 Coimbatore