Roles and Responsibilities: We are looking for a skilled Azure Data Engineer with 4–6 years of experience in designing, developing, and maintaining scalable data solutions. The ideal candidate should possess strong expertise in Data Warehousing, PySpark, Spark, Azure Data Services, SQL, Azure Data Factory (ADF), Data Engineering, and Data Analysis. This role involves building robust data pipelines, optimizing data processing frameworks, and supporting analytics initiatives across the organization.

Design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Factory (ADF), PySpark, and Apache Spark.

Build and enhance enterprise Data Warehouse solutions and dimensional data models.

Develop complex data transformations and processing frameworks using PySpark and Databricks.

Create, optimize, and troubleshoot advanced SQL queries, stored procedures, and database objects.

Integrate data from multiple structured and unstructured data sources.

Perform data profiling, cleansing, validation, and reconciliation activities.

Work closely with Data Analysts, Business Teams,



and Solution Architects to translate business requirements into data solutions.

Ensure data quality, integrity, security, and governance standards are maintained.

Monitor and optimize data pipelines for scalability, reliability, and performance.

Support reporting, advanced analytics, and business intelligence initiatives.

Participate in code reviews, design discussions, and implementation of best practices.

Required Skills &

Experience

Strong hands-on experience in Data Engineering (4–6 years).

Expertise in PySpark and Apache Spark.

Strong experience with Azure Databricks.

Experience with Azure Data Factory (ADF).

Robust understanding of Data Warehousing concepts and dimensional modeling.

Advanced proficiency in SQL and query optimization.

Experience working with Azure Data Lake Storage (ADLS).

Knowledge of Azure Synapse Analytics.

Experience building and maintaining ETL/ELT pipelines.

Strong data analysis and troubleshooting skills.

Skills

azuredata engineeringMS Fabric

📌 Senior Consultant - Azure Data (Bengaluru)
🏢 Gate Gourmet Switzerland
📍 Bengaluru