Senior Consultant | Azure Data Engineer | Bengaluru | Engineering | Data Modernization & Migration
- Job requisition ID : 108351
- Location: Bengaluru
- Entity: Deloitte Touche Tohmatsu India LLP

Job Description:

We are seeking a skilled and motivated Azure Data Engineer Years of experience to join our energetic team. The ideal candidate will have a strong background in Databricks, Azure Data Services, and data engineering practices. You will be responsible for designing, developing, and maintaining scalable data pipelines, optimizing data workflows, and ensuring the integrity and availability of data for analytics and business intelligence.

Work Profile

1) Design and Development:
- Design, develop, and deploy scalable data pipelines using Databricks (PySpark, Spark SQL), Azure Data Factory, and other Azure data services.
- Implement ETL/ELT processes to ingest, transform, and load data from various sources into data lakes and data warehouses.
- Optimize and tune data pipelines for performance and scalability.

2) Data Processing:




- Write and optimize complex SQL queries for data extraction, transformation, and analysis.
- Use PySpark for large-scale data processing and analytics.
- Implement data partitioning, bucketing, and indexing strategies for efficient data retrieval.

3) Data Integration:
- Integrate data from multiple sources, including structured, semi-structured, and unstructured data.
- Work with APIs, streaming data, and batch processing to ensure seamless data integration.

4) Data Governance and Quality:
- Implement data governance practices to ensure data quality, consistency, and security.
- Monitor and troubleshoot data pipelines to ensure data accuracy and availability.

5) Collaboration:
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
- Work closely with DevOps teams to deploy and monitor data pipelines in production environments.

6) Documentation:
- Document data pipe

📌 Senior Consultant | Azure Data Engineer | Bengaluru | Engineering | Data Modernization
🏢 Deloitte
📍 Bengaluru