Job Description
Design, develop, and maintain data engineering solutions on the Azure Cloud platform.
Build and manage batch and real-time data pipelines.
Develop ETL/ELT pipelines using Azure Data Factory (ADF).
Design and maintain data solutions using Azure Synapse Analytics.
Develop scalable data processing solutions using Azure Databricks and Apache Spark.
Implement event-driven and streaming solutions using Azure Event Hub and Azure Stream Analytics.
Design and manage data storage using ADLS Gen2, Blob Storage, SQL Data Warehouse (SQL DW), and Cosmos DB.
Develop Azure Functions using Python for data processing and automation.
Build and optimize data models and data warehouses.
Implement data governance and cataloging using Azure Purview.
Work with Spark (PySpark/Scala) for large-scale data processing.
Collaborate with cross-functional teams to deliver scalable and reliable data solutions.
Monitor, troubleshoot, and optimize Azure data engineering workloads.
Ensure data quality, security, and performance across Azure data platforms.
Utilize open-source tools such as Apache Airflow and dbt for workflow orchestration and data transformation.

📌 Data Engineer Azure Data Platform Bengaluru (India)
🏢 Net Connect
📍 India