Key Responsibilities

- Design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Services.

- Build and optimize data ingestion and transformation workflows using Azure Data Factory (ADF) and Azure Databricks.

- Develop data processing solutions using PySpark and Delta Lake architecture.

- Implement and manage data storage solutions using Azure Data Lake Storage (ADLS).

- Create and manage data pipelines using Delta Live Tables (DLT).

- Implement data governance, security, and access controls using Unity Catalog.

- Write complex SQL queries, stored procedures, and optimize database performance.

- Collaborate with business stakeholders, architects, and development teams to understand data requirements.

Overview

- We are seeking an experienced Azure Data Engineer to join our consulting team in Bangalore, focusing on designing and optimizing data solutions on the Azure cloud platform.

- This role is critical for developing and maintaining robust data pipelines and ensuring data integrity and security.

- The ideal candidate will have significant hands-on experience with Azure data services, including Databricks and PySpark, and will demonstrate the ability to lead projects and collaborate with cross-functional teams.

- As a senior engineer, you will be instrumental in driving the adoption of modern data engineering practices and tools within the organization.

- Your expertise will support the creation of scalable, efficient, and secure data solutions that meet the complex needs of our clients.

- This position requires a deep understanding of data engineering concepts, data modeling,



and ETL frameworks.

- You will be responsible for managing large-scale datasets and ensuring optimal performance of data processing workflows.

- The role also involves a significant amount of stakeholder interaction, requiring excellent communication and problem-solving skills.

- The position offers the opportunity to work with cutting-edge technologies and contribute to high-impact projects that transform data into actionable insights for clients.

- You will be part of a dynamic team, fostering an environment of innovation, growth, and continuous learning.

- Candidates should be prepared to demonstrate their ability to independently manage projects and collaborate effectively within a team.

- The role is suited for individuals who thrive in rapid-paced environments and are eager to engage with the latest data engineering technologies.

Requirements

- 7-9 years of experience in data engineering, with at least 6 years of relevant experience in Azure technologies.

- Proficiency in Azure Data Factory (ADF), Azure Databricks, and Azure Data Lake Storage (ADLS).

- Strong experience with PySpark, Delta Live Tables (DLT), and Unity Catalog.

- Excellent SQL skills for writing queries, developing stored procedures, and optimizing performance.

- Experience in implementing data governance, security, and access controls.

- Positive-to-have skills include Azure Functions, CI/CD using Azure DevOps/GitHub Actions, Python, Scala, and knowledge of Azure Synapse Analytics.

- Exposure to other cloud platforms such as AWS, GCP, or Snowflake is a plus.

📌 Azure Data Engineer (Bengaluru)
🏢 Net Connect
📍 Bengaluru