This role would suit someone with a valuable depth of experience gained as a Data Engineer as well as the following Degree MSc or PhD in a numerate or scientific discipline e g Computer Science Physics Mathematics etc A good understanding of data warehousing concepts including data warehouse technical architectures infrastructure components ETL ELT and reporting analytic tools Azure experience including expert understanding of Azure Data Lakes Experience in the extraction of data from SQL servers Must have experience in at least two programming languages among Java Scala or Python Experience in wider financial services or insurance sector is preferred High level of accuracy and attention to detail and the ability to simplify problems into component parts and deal with them systematically Understanding of Meta-data driven data ingestion using Kafka Experience in coaching mentoring less experienced engineers through technical problem solving Strong customer value focus Driven to deliver business value Desirable but not essential - understanding of Postgres databases Desirable but not essential - experience of data visualization tools QlikSense etc Duties and Responsibilities 4 years of experience in developing scalable solutions using big data technologies Analyse and organize raw data from a wide variety of data sources to build data systems and pipelines Evaluate business needs and objectives to create and maintain optimal data pipeline architecture Understand the technical environment platforms and other dependencies of the project Assemble large complex data sets that meet functional non-functional business requirements Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition operational efficiency and other key business performance metrics Hands-on development experience on Hadoop spark Hive H-Base Kafka Experience in ELK stack Experience in NoSQL databases like Cassandra MongoDB etc Cloud experience Azure preferre

📌 Senior Software Engineer 750 (India)
🏢 Allianz
📍 India