Lead Data Engineer

Broad areas of responsibility:

Own and evolve the enterprise data architecture supporting operational, analytical, and AI workloads.

- Design scalable data platforms for transactional databases, analytical data warehouses/lakehouses, and AI/ML data pipelines.
- Define data models, integration standards, metadata management, and data lifecycle strategies.
- Establish best practices for data engineering, architecture, performance optimization, scalability, reliability, and maintainability.
- Evaluate and recommend emerging technologies and architectural improvements.
- Design and maintain data platforms supporting Business Intelligence, advanced analytics, and machine learning workloads.
- Build data pipelines that enable AI/ML model training, feature engineering, vector databases, Retrieval-Augmented Generation (RAG), and LLM/SLM applications.
- Design, develop, and optimize robust ETL/ELT pipelines for structured and unstructured data.
- Build reliable batch and real-time data integration pipelines from EHRs, Practice Management Systems, APIs, flat files, and third-party healthcare applications.




- Lead, mentor, and develop a team of Data Engineers.
- Conduct code reviews, architecture reviews, and technical design discussions.

Personal Profile:

- Bachelor’s degree in computer science, Information Technology, Engineering, or related discipline.

- 6+ years of experience in Data Engineering, Data Platform Engineering, or Data Architecture.

- Experience with Apache NiFi, Airflow, dbt, Spark, Kafka, or equivalent modern data engineering tools.

- Experience with Power BI or other enterprise BI platforms.

- Familiarity with healthcare interoperability standards such as HL7 and FHIR.

- Experience implementing data platforms for AI/ML and Generative AI workloads.

- Knowledge of CI/CD, Infrastructure as Code, and DevOps practices.

- Experience with containerized workloads (Docker, Kubernetes).

Pay: ₹1,500,000.00 - ₹2,400,000.00 per year

Benefits:

- Adaptable schedule
- Provident Fund
- Work from home

Work Location: Remote

📌 Lead Data Engineer (India)
🏢 Kerner Norland
📍 India