Role description

We are looking for a Senior Data Engineer to join the SML Warehouse Management Team.

In this role you will work in a global team alongside experienced colleagues building and improving modern data solutions using Databricks PySpark SQL batch and streaming technologies workflows and Unity Catalog.

You will contribute to strategic warehouse and supply chain priorities in a fast growing area using the latest data engineering technologies in an international and collaborative environment.

This role can be offered as an employee or consultant assignment with potential for a longer term opportunity for the right candidate

We are looking for Azure Data Engineers

Are you interested in being involved in the biggest data driven transformation of transport solutions in history. We are in the middle of our digitalization journey and you are welcome to join and help us drive analytics and artificial intelligence initiatives which enable new business models

We are looking for Data Engineers 8 years of relevant experience with possible DevOps skills to develop and optimize data pipelines and work together with Data Scientists and other experts who focus on generating business value out of data. You will work with the latest technology in agile product teams which discover data to create innovative services latest technology in agile product teams which discover data to create innovative services

These are challenges waiting for you

You ingest and process data coming from our business application factory equipment Industrial Internet of Things products Vehicle Logged Data as well as external sources. You will organize both structured and unstructured data to enable development of new services such as preventive maintenance of vehicle fuel consumption and battery lifetime optimization and many more innovative services which are changing our business models

Your typical day at work will be filled with the following activities

Build complex data pipelines in Microsoft Azure

Optimize existing data pipelines

Support in building the infrastructure required for optimal extraction transformation and loading of data from a wide variety of data sources to Azure





Work closely with data analysts and data scientists to provide required data structures and enable new insights

Able to provision resources on Azure

Keep the data secure across the end to end solutions

Evaluate and improve existing data analytics solutions

Develop your competences learn new tools and ways of working

This is you

We are looking for experienced data engineer with 8 years of experience and relevant education background

You have good handson skills on Azure Data Analytics Spark Databricks Cost Optimization Techniques Cluster Optimization Performance Tuning

You have strong hands on ETL skills and experience in building data pipelines using Databricks with good knowledge of spark and orchestrating Data workloads on Azure Data Factory

Experience in handling realtime streamingtransactional data preferably SparkStreaming Kafka Event Hubs Event Grid Stream Analytics Service Bus etc

You have significant experience in processing data in scripting languages Python Pyspark Scala

Working with Git and following Git workflow Branching Managing conflicts etc

Databases like SQL server or Netezza dont have any secret for you

You are comfortable with DevOps or DevSecOps and are able to provision resources in Azure

You are comfortable working in a diverse complex and fastchanging landscape of data sources

You communicate fluently in English You are proactive problem solver with innovative thinking and a strong team player

Extras good to have

Experience in AGILE project methodology and practice with ARM Templates Bicep on the DevOps front

Understanding the DevOps Architecture Agent Pools Accounts Var Groups Templating etc

Azure Networking model public and private connectivity VNET injection etc

Familiarity with Microsoft Power BI or other data visualization tools such as Qlik SAP Business Objects





Knowledge of other services and tools used to ETL workflows like Informatica IICS

Experience with business intelligence platforms such as Microsoft SSISSSASSSRS Teradata IBM Netezza

Familiarity with database management systems online analytical processing OLAP

This is what we can offer you

Being a part of a product team focusing both on maintenance and innovations

A steep learning curve with a state of the art and individualized training program

Cooperative environment

Worklife balance we make sure you enjoy quality time away from work

Candidate needs to travel to client office C V Raman Nagar Bagmane for 2 to 3 days or all days wherever applicable

Skills

Mandatory Skills : Azure DevOps, Databricks, MySQL, Python for DATA

About LTM
LTM is an AI-centric global technology services company and the Business Creativity partner to the world’s largest and most disruptive enterprises. We bring human insights and intelligent systems together to help clients create greater value at the intersection of technology and domain expertise. Our capabilities span integrated operations, transformation, and business AI — enabling new ways of working, current productivity paradigms, and new roads to value. Together with over 87,000 employees across 40 countries and our global network of partners, LTM — a Larsen & Toubro company — owns business outcomes for our clients, helping them not just outperform the market, but to Outcreate it. Please also note that neither LTM nor any of its authorized recruitment agencies/partners charge any candidate registration fee or any other fees from talent (candidates) towards appearing for an interview or securing employment/internship. Candidates shall be solely responsible for verifying the credentials of any agency/consultant that claims to be working with LTM for recruitment. Please note that anyone who relies on the representations made by fraudulent employment agencies does so at their own risk, and LTM disclaims any liability in case of loss or damage suffered as a consequence of the same. Recruitment Fraud Alert - https://www.ltm.com/careers/recruitment-fraud-alert

📌 Senior Specialist - Data Engineering (India)
🏢 LTM
📍 India