Job Description

- Design, develop, and maintain data engineering solutions on the Azure Cloud platform.
- Build and manage batch and real-time data pipelines.
- Develop ETL/ELT pipelines using Azure Data Factory (ADF).
- Design and maintain data solutions using Azure Synapse Analytics.
- Develop scalable data processing solutions using Azure Databricks and Apache Spark.
- Implement event-driven and streaming solutions using Azure Event Hub and Azure Stream Analytics.
- Design and manage data storage using ADLS Gen2, Blob Storage, SQL Data Warehouse (SQL DW), and Cosmos DB.
- Develop Azure Functions using Python for data processing and automation.
- Build and optimize data models and data warehouses.
- Implement data governance and cataloging using Azure Purview.
- Work with Spark (PySpark/Scala) for large-scale data processing.
- Collaborate with cross-functional teams to deliver scalable and reliable data solutions.
- Monitor, troubleshoot, and optimize Azure data engineering workloads.
- Ensure data quality, security, and performance across Azure data platforms.
- Utilize open-source tools such as Apache Airflow and dbt for workflow orchestration and data transformation.

📌 Data Engineer-Azure Data Platform (Bengaluru)
🏢 Net Connect
📍 Bengaluru