24 Aug
|
Everforth Quinnox
|
Bengaluru
24 Aug
Everforth Quinnox
Bengaluru
We are looking for Azure Data Engineer who can join us immediately at our Bangalore Office
:
We are seeking a highly skilled ETL Data Migration Engineer with experience in designing, developing, and implementing large-scale data migration and data integration solutions on the Azure platform. The ideal candidate will have robust hands-on expertise in Azure Data Factory (ADF), Azure Databricks, SQL, PySpark, Python, and Azure DevOps. The candidate will be responsible for migrating data from legacy systems to modern Azure-based data platforms while ensuring data quality, performance, and reliability.
Key Responsibilities:
- Design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Factory (ADF).
- Build and optimize data transformation processes using Azure Databricks and PySpark.
- Perform end-to-end data migration activities from legacy systems to Azure-based data lakes and data warehouses.
- Analyze source-to-target mappings and implement complex business transformation logic.
- Develop reusable data ingestion frameworks and automation solutions. Write efficient and optimized SQL queries, stored procedures, and performance tuning solutions.
- Implement data validation, reconciliation, and data quality checks during migration activities.
- Collaborate with Business Analysts, Architects, QA teams, and stakeholders to understand data requirements.
- Support deployment, release management, and CI/CD processes using Azure DevOps. Troubleshoot production issues and provide timely resolutions.
- Participate in code reviews and ensure adherence to development best practices.
- Create and maintain technical documentation, migration runbooks, and deployment guides. Support Agile ceremonies including Sprint Planning,
- Daily Scrum, Retrospectives, and Release activities.
Required Technical Skills
Must Have
- Azure Data Factory (ADF)
- Azure Databricks
- PySpark
- SQL Server / DB2 / Relational Databases
- Python
- Azure DevOps
- ETL/ELT Development
- Data Migration & Data Integration
- Source-to-Target Mapping
- Data Validation and Reconciliation
- CI/CD Pipelines
- Medallion Architecture (Bronze, Silver, Gold)
Key Competencies
- Strong analytical and problem-solving skills.
- Excellent communication and stakeholder management skills.
- Ability to work in Agile/Scrum environments. Ownership mindset and proactive approach to delivery.
- Ability to mentor junior team members and drive technical excellence.
📌 Azure Data Engineer (Bengaluru)
🏢 Everforth Quinnox
📍 Bengaluru