Senior Specialist - Data Engineering (Bengaluru)

Senior Specialist - Data Engineering (Bengaluru)

01 Oct
|
LTM
|
Bengaluru

01 Oct

LTM

Bengaluru

We are looking for a Senior Data Engineer to join the SML Warehouse Management Team.

In this role you will work in a global team alongside experienced colleagues building and improving modern data solutions using Databricks PySpark SQL batch and streaming technologies workflows and Unity Catalog.

You will contribute to strategic warehouse and supply chain priorities in a fast growing area using the latest data engineering technologies in an international and collaborative environment.

This role can be offered as an employee or consultant assignment with potential for a longer term opportunity for the right candidate

We are looking for Azure Data Engineers

Are you interested in being involved in the biggest data driven transformation of transport solutions in history. We are in the middle of our digitalization journey and you are welcome to join and help us drive analytics and artificial intelligence initiatives which enable recent business models

We are looking for Data Engineers 8 years of relevant experience with possible DevOps skills to develop and optimize data pipelines and work together with Data Scientists and other experts who focus on generating business value out of data. You will work with the latest technology in agile product teams which discover data to create innovative services latest technology in agile product teams which discover data to create innovative services

These are challenges waiting for you

You ingest and process data coming from our business application factory equipment Industrial Internet of Things products Vehicle Logged Data as well as external sources.



You will organize both structured and unstructured data to enable development of new services such as preventive maintenance of vehicle fuel consumption and battery lifetime optimization and many more innovative services which are changing our business models

Your typical day at work will be filled with the following activities

Build complex data pipelines in Microsoft Azure

Optimize existing data pipelines

Support in building the infrastructure required for optimal extraction transformation and loading of data from a wide variety of data sources to Azure

Work closely with data analysts and data scientists to provide required data structures and enable new insights

Able to provision resources on Azure

Keep the data secure across the end to end solutions

Evaluate and improve existing data analytics solutions

Develop your competences learn new tools and ways of working

This is you

We are looking for experienced data engineer with 8 years of experience and relevant education background

You have good handson skills on Azure Data Analytics Spark Databricks Cost Optimization Techniques Cluster Optimization Performance Tuning

You have strong hands on ETL skills and experience in building data pipelines using Databricks with good knowledge of spark and orchestrating Data workloads on Azure Data Factory

Experience in handling realtime streamingtransactional data preferably SparkStreaming Kafka Event Hubs Event Grid Stream Analytics Service Bus etc





You have significant experience in processing data in scripting languages Python Pyspark Scala

Working with Git and following Git workflow Branching Managing conflicts etc

Databases like SQL server or Netezza dont have any secret for you

You are comfortable with DevOps or DevSecOps and are able to provision resources in Azure

You are comfortable working in a diverse complex and fastchanging landscape of data sources

You communicate fluently in English You are proactive problem solver with innovative thinking and a strong team player

Extras good to have

Experience in AGILE project methodology and practice with ARM Templates Bicep on the DevOps front

Understanding the DevOps Architecture Agent Pools Accounts Var Groups Templating etc

Azure Networking model public and private connectivity VNET injection etc

Familiarity with Microsoft Power BI or other data visualization tools such as Qlik SAP Business Objects

Knowledge of other services and tools used to ETL workflows like Informatica IICS

Experience with business intelligence platforms such as Microsoft SSISSSASSSRS Teradata IBM Netezza

Familiarity with database management systems online analytical processing OLAP

This is what we can offer you

Being a part of a product team focusing both on maintenance and innovations A steep learning curve with a state of the art and individualized training program

Collaborative environment

Worklife balance we make sure you enjoy quality time away from work

Candidate needs to travel to client office C V Raman Nagar Bagmane for 2 to 3 days or all days wherever applicable

Mandatory Skills : Azure DevOps, Databricks, MySQL, Python for DATA

📌 Senior Specialist - Data Engineering (Bengaluru)
🏢 LTM
📍 Bengaluru

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: senior specialist - data engineering (bengaluru) / bengaluru

Subscribe to this job alert:

Get the latest job offers by email for: senior specialist - data engineering (bengaluru) / bengaluru