Senior Data Engineer (India)

Senior Data Engineer (India)

20 Nov
|
DCM Shriram
|
India

20 Nov

DCM Shriram

India

Position Title

Data Engineer

Purpose of the Position (Job Summary)

The Data Engineer will design, develop and maintain scalable data architectures, pipelines and data products that enable enterprise analytics and data-driven decision-making. The role requires robust expertise in Python, SQL, PySpark, cloud data platforms and ETL/ELT processes, along with hands-on experience in Generative AI and AI-driven solutions. The candidate will work closely with cross-functional teams to build reliable data solutions, integrate AI capabilities and deliver scalable applications and insights.

Key Individual Accountabilities

- Design, develop and optimise scalable data pipelines, ETL/ELT workflows and data architectures.

- Build and maintain data lakes, data warehouses and data products using technologies such as Python, SQL, PySpark, Azure Databricks and other cloud platforms.

- Implement data modelling, data integration, data quality, governance and performance optimisation practices.

- Develop and deploy AI/GenAI solutions using LLMs, RAG architectures, vector databases and AI agents.

- Build backend services, APIs and application integrations to operationalise data and AI solutions.

- Contribute to frontend development and end-to-end application delivery wherever required.

- Establish reusable engineering practices, CI/CD pipelines, monitoring and deployment standards.

- Collaborate with business analysts, data scientists, solution architects and other stakeholders to translate business requirements into technical solutions.

- Mentor team members and drive adoption of emerging data engineering and AI technologies.

Key Interactions

- Data & Analytics / Centre of Excellence teams

- Business stakeholders and functional teams

- IT and OT teams

- Data Scientists, Business Analysts and Solution Architects

- External technology partners and service providers

Technical & Behavioral Skills & Knowledge





- Bachelor's degree in Computer Science, Information Technology, Engineering or a related discipline; Computer Science preferred.

- 4-7 years of relevant experience in Data Engineering or Data Architecture, with a strong and continuous Data Engineering career.

- Strong proficiency in Python, SQL, PySpark and data engineering frameworks.

- Hands-on experience in building and maintaining scalable ETL/ELT pipelines, data warehouses, data lakes and enterprise data platforms.

- Experience with cloud platforms and services, preferably Microsoft Azure, including Azure Data Factory, Azure Databricks, ADLS and Synapse.

- Practical experience in Generative AI, LLMs, RAG, embeddings, vector databases and AI agents; experience with Azure AI Foundry or comparable platforms is desirable.

- Backend development experience using Python frameworks such as FastAPI or Flask, REST APIs and application integrations.

- Familiarity with frontend technologies such as React, Angular or Java Script/Type Script is an added advantage.

- Knowledge of Git, Docker, CI/CD, Azure Dev Ops and deployment practices.

- Strong analytical, problem-solving, communication and collaboration skills.

Key Performance Indicators

- Timely development and delivery of reliable, scalable data pipelines and data products.

- Data pipeline performance, availability, reliability and reduction in processing failures.

- Improvement in data quality, accuracy, governance and accessibility.

- Successful development and deployment of AI/GenAI use cases and solutions.

- Reusability, scalability and maintainability of engineering solutions.

- Adherence to development, documentation, security and deployment standards.

Competencies

Agile Towards Change and Innovation, PL1Builds a Performance & Development Culture , PL1Builds Partnership with Stakeholders, PL1Executes Efficiently , PL1Focused on Achieving Results, PL1Thinks Strategically and Acts Decisively, PL1

📌 Senior Data Engineer (India)
🏢 DCM Shriram
📍 India

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: senior data engineer (india) / india