04 Nov
|
Swiss Re
|
Hyderabad
04 Nov
Swiss Re
Hyderabad
Location: Hyderabad, TG, IN
Senior Data Engineer
Are you passionate about transforming raw data into powerful insights that drive real business decisions? Do you thrive at the intersection of cutting-edge technology, AI innovation, and large-scale data engineering? If so, we have an exciting opportunity for you to make a meaningful impact on a global scale.
About the Role
As a Senior Data Engineer , you will be at the heart of our ambition to become a truly data-driven organisation. You will design and deliver best-in-class data engineering capabilities, architect scalable solutions on up-to-date cloud platforms, and help democratise data for business stakeholders and customers alike. This is a role for someone who embraces AI-assisted development, loves solving complex problems, and is energised by working in a fast-paced, collaborative, global environment.
Key Responsibilities
- Drive end-to-end analytics delivery — design, develop, and implement analytics models and visualisations that provide actionable, business-ready data insights
- Collaborate with stakeholders — work closely with Product Owners and Architects to understand requirements, formulate solutions, and evaluate implementation effort
- Build scalable data pipelines — design, develop, and maintain robust transformation logic using Python/PySpark, SQL , and modern analytics platforms such as Palantir Foundry
- Leverage AI technologies — utilise Palantir AIP and generative AI to enhance analytics solutions, automate workflows, and improve user experiences where appropriate
- Champion AI-assisted development — apply tools such as GitHub Copilot or equivalent to improve development efficiency while upholding high engineering standards
- Optimise Spark-based solutions — oversee architecture design and performance tuning of Spark-based data solutions at enterprise scale
- Set engineering standards — define and drive the adoption of best practices, coding standards , and quality frameworks across the team
- Innovate and prototype — evaluate new platform capabilities, develop prototypes, and draw conclusions on their applicability to the solution landscape
- Mentor and lead — provide knowledge, guidance, and technical leadership to a team of developers in an agile, collaborative environment
- Stay ahead of the curve — continuously track emerging data engineering tools, frameworks, and industry trends, driving innovation within the team
- Deliver as a global team — collaborate across a globally distributed development team to design and deliver impactful solutions
About the Team
The L&H; Data & Analytics Engineering team is a key technical partner for our Life & Health (L&H;) Reinsurance division, supporting the transformation of the data landscape and the creation of innovative analytical products and capabilities. We are a large, globally distributed team operating in an agile development environment, delivering solutions that make better use of reinsurance data and enhance data-driven decision-making across the entire business value chain. Joining this team means being part of a energetic, forward-thinking group that values collaboration, continuous learning, and technical excellence.
About You
You are a curious, driven, and technically sharp data engineering professional who thrives on solving complex big data challenges using leading-edge technologies. You have a clear ability to learn and adopt new tools quickly — particularly in AI,
modern analytics platforms, and cloud-native data engineering. You are a self-starter who takes ownership of solutions from inception to delivery and communicates effectively across technical and business audiences. You bring a collaborative mindset, a passion for engineering excellence, and the ability to lead and inspire those around you.
We are looking for candidates who meet these requirements:
- 9+ years of experience designing and developing large-scale software systems, with a strong focus on platforms such as Palantir Foundry and Azure Databricks
- Proficiency in Python/PySpark and SQL , including experience designing performant queries, data models, and dimensional modelling/data warehousing concepts
- Hands-on experience with enterprise data platforms and distributed computing (Spark/Hive/Hadoop), working with large datasets in Cloud environments such as AWS or Azure
- Experience leading an Agile development team , with familiarity in agile software delivery practices and collaborative development using Git
- Bachelor's degree or equivalent in Computer Science, Data Science, or a related discipline, combined with the ability to work effectively in a global, multicultural environment
These are additional nice to haves:
- Proficiency in full-stack design and implementation on Palantir Foundry, Databricks, Microsoft Fabric, or Snowflake
- Spark performance and optimisation expertise at scale
- Experience using Palantir AIP or other AI/LLM frameworks to develop analytics applications
- Experience integrating Large Language Models (LLMs) into analytics workflows
- Knowledge of the Insurance domain, Financial Industry , or Finance functions in other industries
Our company has a hybrid work model where the expectation is that you will be in the office at least three days per week.
📌 Senior Data Engineer (Hyderabad)
🏢 Swiss Re
📍 Hyderabad