22 Aug
|
Everforth Quinnox
|
Bengaluru
22 Aug
Everforth Quinnox
Bengaluru
****We are looking for Azure Data Engineer who can join us immediately at our Bangalore Office **
Job Description:
We are seeking a highly skilled ETL Data Migration Engineer with experience in designing, developing, and implementing large-scale data migration and data integration solutions on the Azure platform. The ideal candidate will have solid hands-on expertise in Azure Data Factory (ADF), Azure Databricks, SQL, PySpark, Python, and Azure DevOps. The candidate will be responsible for migrating data from legacy systems to modern Azure-based data platforms while ensuring data quality, performance, and reliability.
Key Responsibilities:
- Design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Factory (ADF).
- Build and optimize data transformation processes using Azure Databricks and PySpark.
- Perform end-to-end data migration activities from legacy systems to Azure-based data lakes and data warehouses.
- Analyze source-to-target mappings and implement complex business transformation logic.
- Develop reusable data ingestion frameworks and automation solutions.
Write efficient and optimized SQL queries, stored procedures, and performance tuning solutions.
- Implement data validation, reconciliation, and data quality checks during migration activities.
- Collaborate with Business Analysts, Architects, QA teams, and stakeholders to understand data requirements.
- Support deployment, release management, and CI/CD processes using Azure DevOps. Troubleshoot production issues and provide timely resolutions.
- Participate in code reviews and ensure adherence to development best practices.
- Create and maintain technical documentation, migration runbooks, and deployment guides. Support Agile ceremonies including Sprint Planning,
- Daily Scrum, Retrospectives, and Release activities.
Required Technical Skills
Must Have
- Azure Data Factory (ADF)
- Azure Databricks
- PySpark
- SQL Server / DB2 / Relational Databases
- Python
- Azure DevOps
-
📌 Azure Data Engineer (Bengaluru)
🏢 Everforth Quinnox
📍 Bengaluru