We are looking for a Senior Data Engineer to join the SML Warehouse Management Team.
In this role you will work in a global team alongside experienced colleagues building and improving modern data solutions using Databricks PySpark SQL batch and streaming technologies workflows and Unity Catalog.
You will contribute to strategic warehouse and supply chain priorities in a fast growing area using the latest data engineering technologies in an international and collaborative environment.
This role can be offered as an employee or consultant assignment with potential for a longer term opportunity for the right candidate
We are looking for Azure Data Engineers
Are you interested in being involved in the biggest data driven transformation of transport solutions in history. We are in the middle of our digitalization journey and you are welcome to join and help us drive analytics and artificial intelligence initiatives which enable recent business models
We are looking for Data Engineers 8 years of relevant experience with possible DevOps skills to develop and optimize data pipelines and work together with Data Scientists and other experts who focus on generating business value out of data. You will work with the latest technology in agile product teams which discover data to create innovative services latest technology in agile product teams which discover data to create innovative services
These are challenges waiting for you
You ingest and process data coming from our business application factory equipment Industrial Internet of Things products Vehicle Logged Data as well as external sources.
You will organize both structured and unstructured data to enable development of new services such as preventive maintenance of vehicle fuel consumption and battery lifetime optimization and many more innovative services which are changing our business models
Your typical day at work will be filled with the following activities
Build complex data pipelines in Microsoft Azure
Optimize existing data pipelines
Support in building the infrastructure required for optimal extraction transformation and loading of data from a wide variety of data sources to Azure
Work closely with data analysts and data scientists to provide required data structures and enable new insights
Able to provision resources on Azure
Keep the data secure across the end to end solutions
Evaluate and improve existing data analytics solutions
Develop your competences learn new tools and ways of working
This is you
We are looking for experienced data engineer with 8 years of experience and relevant education background
You have good handson skills on Azure Data Analytics Spark Databricks Cost Optimization Techniques Cluster Optimization Performance Tuning
You have strong hands on ETL skills and experience in building data pipelines using Databricks with good knowledge of spark and orchestrating Data workloads on Azure Data Factory
Experience in handling realtime streamingtransactional data preferably SparkStreaming Kafka Event Hubs Event Grid Stream Analytics Service Bus etc
You have significant experience in processing data in scripting languages Python Pyspark Scala
Working with Git and following Git workflow Branching Managing conflicts etc
Databases like SQL server or Netezza dont have any secret for you
You are comfortable with DevOps or DevSecOps and are able to provision resources in Azure
You are comfortable working in a diverse complex and fastchanging landscape of data sources
You communicate fluently in English You are proactive problem solver with innovative thinking and a strong team player
Extras good to have
Experience in AGILE project methodology and practice with ARM Templates Bicep on the DevOps front
Understanding the DevOps Architecture Agent Pools Accounts Var Groups Templating etc
Azure Networking model public and private connectivity VNET injection etc
Familiarity with Microsoft Power BI or other data visualization tools such as Qlik SAP Business Objects
Knowledge of other services and tools used to ETL workflows like Informatica IICS
Experience with business intelligence platforms such as Microsoft SSISSSASSSRS Teradata IBM Netezza
Familiarity with database management systems online analytical processing OLAP
This is what we can offer you
Being a part of a product team focusing both on maintenance and innovations A steep learning curve with a state of the art and individualized training program
Collaborative environment
Worklife balance we make sure you enjoy quality time away from work
Candidate needs to travel to client office C V Raman Nagar Bagmane for 2 to 3 days or all days wherever applicable
Mandatory Skills : Azure DevOps, Databricks, MySQL, Python for DATA
📌 Senior Specialist - Data Engineering (Bengaluru)
🏢 LTM
📍 Bengaluru