JD software engineering principles to deploy and maintain fully automated data transformation pipelines that combine a large variety of storage and computation technologies to handle a distribution of data types and volumes in support of data architecture design An IT System Support Analyst designs and develop data pipelines that are resilient to change modular flexible scalable reusable and cost effective .
The expectation for this role is 3-5 years of relevant experience
Key responsibilities
Design develop and maintain data pipelines and ETL processes using Microsoft Azure services eg Azure Data Factory Azure Synapse Azure Databricks Azure Fabric
Utilize Azure data storage accounts for organizing and maintaining data pipeline outputs eg Azure Data Lake Storage Gen 2 Azure Blob storage
Experience in utilizing SQL DML to query modern RDBMS in an efficient manner eg SQL Server PostgreSQL
Good Handson in PowerApps Power Automate Power BI
Knowledge of RESTAPI OAuth
Collaborate with data architects and other stakeholders to understand data requirements and deliver highquality data solutions
Optimize data pipelines in the Azure environment for performance scalability and reliability
Collect clean and validate data from multiple sources to ensure accuracy and reliability
Ensure data quality and integrity through data validation techniques and frameworks
Monitor and troubleshoot data pipeline issues to ensure timely resolution
Stay current with industry trends and emerging technologies to ensure our data solutions remain cuttingedge
Manage the CICD process for deploying and maintaining data solutions
Positive to have knowledge of any programming language like C Java JavaScript Python etc
Required Qualifications
Bachelors degree in computer science xxEngineering or a related field or equivalent experience
35 years of proven experience as a Data Engineer or similar role dealing with data and ETL processes
Strong knowledge of Microsoft Azure services including Azure Data Factory Azure Synapse Azure Databricks Azure Blob Storage and Azure Data Lake Gen 2
Experience utilizing SQL DML to query modern RDBMS in an efficient manner eg SQL Server PostgreSQL
Strong understanding of Software Engineering principles and how they apply to Data Engineering eg CICD version control testing
Experience with Data Analysis tools
Strong problemsolving skills and attention to detail
Excellent communication and collaboration skills
Preferred Qualifications
Learning agility
Experience efficiently querying API endpoints as a data source
Understanding of the Azure environment and related services such as subscriptions resource groups etc
Understanding of Git workflows in software development
Using Azure DevOps pipeline and repositories to deploy and maintain solutions
Understanding of Ansible and how to use it in Azure DevOps pipelines
global operations supporting business requirements across the world Accordingly the work hours for employees will be aligned to support business requirements
The standard work week will be MondayWFH and Tuesday to FridayWFO
Skills
Mandatory Skills : PowerBI, Python for DATA
About LTM
LTM is an AI-centric global technology services company and the Business Creativity partner to the world’s largest and most disruptive enterprises. We bring human insights and intelligent systems together to help clients create greater value at the intersection of technology and domain expertise. Our capabilities span integrated operations, transformation, and business AI — enabling new ways of working, new productivity paradigms, and new roads to value. Together with over 87,000 employees across 40 countries and our global network of partners, LTM — a Larsen & Toubro company — owns business outcomes for our clients, helping them not just outperform the market, but to Outcreate it. Please also note that neither LTM nor any of its authorized recruitment agencies/partners charge any candidate registration fee or any other fees from talent (candidates) towards appearing for an interview or securing employment/internship. Candidates shall be solely responsible for verifying the credentials of any agency/consultant that claims to be working with LTM for recruitment. Please note that anyone who relies on the representations made by fraudulent employment agencies does so at their own risk, and LTM disclaims any liability in case of loss or damage suffered as a consequence of the same. Recruitment Fraud Alert - https://www.ltm.com/careers/recruitment-fraud-alert
📌 Associate Principal - Data Engineering (Bengaluru)
🏢 LTM
📍 Bengaluru
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.