Location- Bellandure bangalore
Experience- 12- 16 years
Shift- 1.30pm- 10.30pm JD Utilizes software engineering principles to deploy and maintain fully automated data transformation pipelines that combine a large variety of storage and computation technologies to handle a distribution of data types and volumes in support of data architecture design An IT System Support Analyst designs and develop data pipelines that are resilient to change modular adaptable scalable reusable and cost effective
The expectation for this role is 12- 16 years of relevant experience Key responsibilities Design develop and maintain data pipelines and ETL processes using Microsoft Azure services eg Azure Data Factory Azure Synapse Azure Databricks Azure Fabric Utilize Azure data storage accounts for organizing and maintaining data pipeline outputs eg Azure Data Lake Storage Gen 2 Azure Blob storage Experience in utilizing SQL DML to query modern RDBMS in an efficient manner eg SQL Server PostgreSQL Good Handson in PowerApps Power Automate Power BI Knowledge of RESTAPI OAuth Collaborate with data architects and other stakeholders to understand data requirements and deliver highquality data solutions Optimize data pipelines in the Azure environment for performance scalability and reliability Collect clean and validate data from multiple sources to ensure accuracy and reliability Ensure data quality and integrity through data validation techniques and frameworks Monitor and troubleshoot data pipeline issues to ensure timely resolution Stay current with industry trends and emerging technologies to ensure our data solutions remain cuttingedge Manage the CICD process for deploying and maintaining data solutions Good to have knowledge of any programming language like C Java JavaScript Python etc Required Qualifications Bachelors degree in computer science Engineering or a related field or equivalent experience
810 years of proven experience as a Data Engineer or similar role dealing with data and ETL processes
Strong knowledge of Microsoft Azure services including Azure Data Factory Azure Synapse Azure Databricks Azure Blob Storage and Azure Data Lake Gen 2
Experience utilizing SQL DML to query modern RDBMS in an effective manner eg SQL Server PostgreSQL
Strong understanding of Software Engineering principles and how they apply to Data Engineering eg CICD version control testing
Experience with Data Analysis tools
Strong problemsolving skills and attention to detail
Excellent communication and collaboration skills
Preferred Qualifications
Learning agility
Experience efficiently querying API endpoints as a data source
Understanding of the Azure environment and related services such as subscriptions resource groups etc
Understanding of Git workflows in software development Using Azure DevOps pipeline and repositories to deploy and maintain solutions Understanding of Ansible and how to use it in Azure DevOps pipelines supports global operations supporting business requirements across the world Accordingly the work hours for employees will be aligned to support business requirements The standard work week will be Monday WFH and Tuesday to Friday WFO
<
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.