30 Sep
|
KODEKRAFTERS BUSINESS AND TECHNOLOGY CONSULTING
|
Bengaluru
30 Sep
KODEKRAFTERS BUSINESS AND TECHNOLOGY CONSULTING
Bengaluru
About the role:
We are looking for an experienced Azure Data Engineer with strong expertise in designing, building, and maintaining scalable data engineering solutions on Microsoft Azure.
The ideal candidate should have hands-on experience in developing end-to-end data pipelines, data ingestion, transformation, processing, and data warehousing using modern Microsoft technologies such as Microsoft Fabric, OneLake, Azure Databricks, Azure Synapse Analytics, and Azure Data Factory.
Key Responsibilities
- Design, build, and maintain scalable data solutions on Microsoft Azure.
- Develop and manage end-to-end data pipelines for ingesting, transforming, and integrating data from multiple sources.
- Design scalable and reliable data models and Data Warehouse solutions.
- Develop ETL/ELT pipelines using Azure Data Factory, Fabric, Databricks, Synapse, and related Azure services.
- Implement data ingestion, transformation, and processing frameworks using Spark.
- Work with Microsoft Fabric, OneLake, Azure Databricks, Azure Synapse Analytics, Azure Data Factory, and ADLS.
- Implement data security, governance, privacy, and access controls across Azure data platforms.
- Monitor, troubleshoot, and optimize data workflows for reliability, performance, and cost efficiency.
- Optimize data storage and processing solutions using Azure best practices.
- Collaborate with clients and internal stakeholders to understand business requirements and translate them into scalable technical solutions.
- Provide technical leadership and contribute to solution design, implementation, client discussions, demos, and presentations.
- Mentor junior team members and contribute to Data Engineering best practices.
Mandatory Skills & Experience
- Minimum 6+ years of overall professional experience, with significant focus on Azure Data Engineering.
- Minimum 4+ years of experience designing and building data ingestion, processing, and analytical pipelines.
- Strong hands-on experience with:
- Microsoft Fabric
- OneLake
- Azure Databricks
- Azure Synapse Analytics
- Azure Data Factory
- ADLS / Azure Blob Storage
- Azure Functions
- Strong expertise in:
- ETL / ELT
- Python
- SQL
- PySpark
- Spark SQL
- Data Engineering
- Data Warehousing
- Data Modelling
- Experience working with RDBMS technologies.
- Understanding of Big Data file formats and compression techniques.
- Experience with Azure DevOps, Git, and VSTS.
Preferred Skills
- Robust hands-on experience with Microsoft Fabric, including:
- Medallion Architecture
- Fabric Notebooks
- Metadata-driven ingestion frameworks
- Data Quality frameworks
- SCD Type 1 and Type 2 transformations
- Experience designing and deploying scalable ETL pipelines using Azure Data Factory, Synapse Analytics, Azure Functions, and Databricks.
- Strong knowledge of Data Warehouse architecture and large-scale Data Modelling.
- Experience with Azure RBAC and IAM, including access controls and security compliance.
- Experience with Data Governance, performance optimization, and cost-efficient data solutions.
- Experience working in consulting or client-facing environments.
- Ability to provide technical leadership and mentor junior team members.
- Strong communication and presentation skills.
- Exposure to Microsoft Copilot and Generative AI concepts.
- Experience with Power BI for dashboard development, KPI reporting, and business insights.
Preferred Certifications Relevant Microsoft certifications would be an added advantage:
- DP-600
- DP-700
- DP-203
- DP-900
- AI-102
- AI-900
- PL-300
Educational Qualification Bachelor's or Postgraduate degree in Computer Science, Computer Engineering, Information Technology, or a related discipline.
📌 Azure data engineer Manager (Bengaluru)
🏢 KODEKRAFTERS BUSINESS AND TECHNOLOGY CONSULTING
📍 Bengaluru