Are you passionate about transforming raw data into powerful insights that drive real business decisions? Do you thrive at the intersection of cutting-edge technology, AI innovation, and large-scale data engineering? As a Senior Data Engineer , you will be at the heart of our ambition to become a truly data-driven organisation. You will design and deliver best-in-class data engineering capabilities, architect scalable solutions on modern cloud platforms, and help democratise data for business stakeholders and customers alike. This is a role for someone who embraces AI-assisted development, loves solving complex problems, and is energised by working in a fast-paced, collaborative, global environment.

Drive end-to-end analytics delivery — design, develop, and implement analytics models and visualisations that provide actionable, business-ready data insights

Collaborate with stakeholders — work closely with Product Owners and Architects to understand requirements, formulate solutions, and evaluate implementation effort

Build scalable data pipelines — design, develop, and maintain robust transformation logic using Python/PySpark, SQL , and modern analytics platforms such as Palantir Foundry

Leverage AI technologies — utilise Palantir AIP and generative AI to enhance analytics solutions, automate workflows, and improve user experiences where appropriate

Champion AI-assisted development — apply tools such as GitHub Copilot or equivalent to improve development efficiency while upholding high engineering standards





Optimise Spark-based solutions — oversee architecture design and performance tuning of Spark-based data solutions at enterprise scale

Set engineering standards — define and drive the adoption of best practices, coding standards , and quality frameworks across the team

Innovate and prototype — evaluate new platform capabilities, develop prototypes, and draw conclusions on their applicability to the solution landscape

Mentor and lead — provide knowledge, guidance, and technical leadership to a team of developers in an agile, collaborative workplace

Stay ahead of the curve — continuously track emerging data engineering tools, frameworks, and industry trends, driving innovation within the team

The L&H; Data & Analytics Engineering team is a key technical partner for our Life & Health (L&H;) Reinsurance division, supporting the transformation of the data landscape and the creation of innovative analytical products and capabilities. We are a large, globally distributed team operating in an agile development environment, delivering solutions that make better use of reinsurance data and enhance data-driven decision-making across the entire business value chain. You are a curious, driven, and technically sharp data engineering professional who thrives on solving complex big data challenges using leading-edge technologies.



You have a clear ability to learn and adopt new tools quickly — particularly in AI, modern analytics platforms, and cloud-native data engineering. 9+ years of experience designing and developing large-scale software systems, with a strong focus on platforms such as Palantir Foundry and Azure Databricks

- Proficiency in Python/PySpark and SQL , including experience designing performant queries, data models, and dimensional modelling/data warehousing concepts
- Hands-on experience with enterprise data platforms and distributed computing (Spark/Hive/Hadoop), working with large datasets in Cloud environments such as AWS or Azure
- Experience leading an Agile development team , with familiarity in agile software delivery practices and collaborative development using Git
- Bachelor's degree or equivalent in Computer Science, Data Science, or a related discipline, combined with the ability to work effectively in a global, multicultural environment

Proficiency in full-stack design and implementation on Palantir Foundry, Databricks, Microsoft Fabric, or Snowflake

Spark performance and optimisation expertise at scale

Experience using Palantir AIP or other AI/LLM frameworks to develop analytics applications

Experience integrating Large Language Models (LLMs) into analytics workflows

Knowledge of the Insurance domain, Financial Industry , or Finance functions in other industries

Our company has a hybrid work model where the expectation is that you will be in the office at least three days per week.

📌 Senior Data Engineer : Big Data (Hyderabad)
🏢 Swiss Re
📍 Hyderabad