Job highlights

- B.Tech in Computer Science with 5+ years in Data Engineering and 1+ year experience using Gen AI LLM models for agentic data solutions

- Design, develop, test, and maintain ETL pipelines and data applications; leverage Gen AI & LLM models; improve DevOps and automation; ensure data platform quality and scalability; maintain production environments

Primary Responsibilities

- Work with solution architects and other software engineers to evaluate functional and non-functional requirements and deliver creative, high-quality solutions

- Design, develop, test and maintain data intensive applications including ETL, relational and non-relational data storage, data application development

- Leverage AIDLC & design Agentic data engineering solution by using available Gen AI & LLM models

- Follow and improve on processes for continuous delivery and DevOps within your team

- Build and main configuration management and automation tools, deployment strategies/processes, monitoring tools

- Collaborate on quality strategies that ensure our data platform is correct, resilient, scalable and secure

- Participate in and provide input for system analysis, design walkthroughs and code reviews

- Participating in defect review and triage

- Adhere to design/coding standards and constantly improve the way we build and deliver software

- Technical analysis of existing reporting solutions to identify opportunities for improvement both from a best practice and quality/ performance improvement perspective

- Drive continuous improvement and automation solutions and processes

- Maintain production products, solutions, documentation, and environments to ensure optimal health, including resolving production issues and responding quickly to priority problems

- Comply with all applicable Company policies, procedures,



and business directives, changes including those relating to work location, team assignments, work schedules, and versatile work arrangements

Required Qualifications

- B.Tech required in computer science or similar field with minimum 5 years' experience of Data Engineering and at least 1 years' experience leveraging Gen AI LLM models to design agentic solutions in data engineering space

- Experience in ETL/Pipeline Development using tools such as Azure Databricks/Apache Spark and Azure Data Factory with development expertise on batch and real-time data integration

- Experience in programming using Python

- Experience in data ingestion, preparation, integration and operationalization techniques in optimally addressing the data requirements

- Experience in Cloud data warehouse like Azure Synapse, Snowflake analytical warehouse

- Experience with Orchestration tools, Azure DevOps and GitHub

- Experience in building end to end architecture for Data Lakes, Data Warehouses and Data Marts

- Experience in relational data processing technology like MS SQL, Delta Lake, Spark SQL

- Experience to own end-to-end development, including coding, testing, debugging and deployment

- Experienced in Software Engineering practices like Reliability Engineering, Deployment planning, Fault Tolerant architecture, Test Automation

- Extensive knowledge of ETL and Data Warehousing concepts, strategies, methodologies

- Ability to provide solutions that are forward-thinking in data and analytics

- Proven team oriented with solid collaboration, prioritization, and adaptability skills

- Proven excellent written and verbal communication skills including presentation skills

- Familiarity with Azure services like Azure functions, Azure Data Lake Store, Azure Cosmos

- Familiarity with Healthcare business data models

📌 Data Engineering Lead (Bengaluru)
🏢 Optum
📍 Bengaluru