Sr Data Engineer

Responsibilities:
Collaborate with teams of experienced actuaries, developers and business experts to deliver projects
Design and propose end-to-end data pipelines ((ingestion to storage to consumption) for data projects as well as databases to support web-based applications
Design and implement data warehouses and data marts to serve data consumers
Execute implementation of the designs and bring it from design stages to implementation followed by operationalization to maintenance
Database design and modelling. To be able to organize data at both macro and micro level and provide logical data models for the consumers
Database performance tuning and data lifecycle management
Assist in support and enhancements of existing data pipelines and databases

Requirements:
8+ years of total experience working with data integration teams.
3+ years of in-depth experience developing data pipelines within an Apache Spark setting (preferably Databricks).
2+ years of active hands-on work with Databricks, demonstrating in-depth experience.




Good experience in building data pipelines that ingests various types of data sources into a database or data lake and populating a structured warehouse or data mart that fuels the data consumer.
Fluent in both complex SQL query performance tuning and database performance tuning
Highly knowledgeable in ETL/ELT processes, both design and implementation via SSIS or some other ELT/ETL tool.
Positive knowledge of data modelling, database technologies, data warehousing.
Have experience in building and designing data warehouses/data marts
Understand the importance of performance and able to implement best practices in ensuring performance and maintainability for data-centric projects
This person is required to be dynamic and be a quick eager learner as knowledge about recent technologies will need to be acquired on the spot
Practical experience integrating with AI/LLM platforms and frameworks (e.g., Azure OpenAI, OpenAI, Hugging Face, vector databases).

Nice to haves:
Certifications in Databricks, cloud computing or database management.
Experience developing data solutions using native IaaS and PaaS solutions on AWS (RDS, S3).
Experience in any object-oriented programming language.

📌 Sr Data Engineer Bengaluru (India)
🏢 Aon
📍 India