Sr Data Engineer

Responsibilities:

- Collaborate with teams of experienced actuaries, developers and business experts to deliver projects

- Design and propose end-to-end data pipelines ((ingestion to storage to consumption) for data projects as well as databases to support web-based applications

- Design and implement data warehouses and data marts to serve data consumers

- Execute implementation of the designs and bring it from design stages to implementation followed by operationalization to maintenance

- Database design and modelling. To be able to organize data at both macro and micro level and provide logical data models for the consumers

- Database performance tuning and data lifecycle management

- Assist in support and enhancements of existing data pipelines and databases

Requirements:

- 8+ years of total experience working with data integration teams.

- 3+ years of in-depth experience developing data pipelines within an Apache Spark environment (preferably Databricks).

- 2+ years of active hands-on work with Databricks, demonstrating in-depth experience.





- Good experience in building data pipelines that ingests various types of data sources into a database or data lake and populating a structured warehouse or data mart that fuels the data consumer.

- Fluent in both complex SQL query performance tuning and database performance tuning

- Highly knowledgeable in ETL/ELT processes, both design and implementation via SSIS or some other ELT/ETL tool.

- Positive knowledge of data modelling, database technologies, data warehousing.

- Have experience in building and designing data warehouses/data marts

- Understand the importance of performance and able to implement best practices in ensuring performance and maintainability for data-centric projects

- This person is required to be dynamic and be a quick eager learner as knowledge about new technologies will need to be acquired on the spot

- Practical experience integrating with AI/LLM platforms and frameworks (e.g., Azure OpenAI, OpenAI, Hugging Face, vector databases).

Nice to haves:

- Certifications in Databricks, cloud computing or database management.

- Experience developing data solutions using native IaaS and PaaS solutions on AWS (RDS, S3).

- Experience in any object-oriented programming language.

📌 Sr Data Engineer (Bengaluru)
🏢 Aon
📍 Bengaluru