We are looking for Azure Data Engineer
Experience - 4 to 7 years
Location - Bangalore
Work Mode - Hybrid Mode
JD:
We are seeking a highly skilled ETL Data Migration Engineer with 4 to 7 years of experience in designing, developing, and implementing large-scale data migration and data integration solutions on the Azure platform. The ideal candidate will have solid hands-on expertise in Azure Data Factory (ADF), Azure Databricks, SQL, PySpark, Python, and Azure DevOps. The candidate will be responsible for migrating data from legacy systems to modern Azure-based data platforms while ensuring data quality, performance, and reliability.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Factory (ADF).
- Build and optimize data transformation processes using Azure Databricks and PySpark.
- Perform end-to-end data migration activities from legacy systems to Azure-based data lakes and data warehouses.
- Analyze source-to-target mappings and implement complex business transformation logic.
- Develop reusable data ingestion frameworks and automation solutions.
- Write efficient and optimized SQL queries, stored procedures, and performance tuning solutions.Implement data validation, reconciliation, and data quality checks during migration activities.
- Collaborate with Business Analysts,
Architects, QA teams, and stakeholders to understand data requirements.Support deployment, release management, and CI/CD processes using Azure DevOps.
- Troubleshoot production issues and provide timely resolutions.
- Participate in code reviews and ensure adherence to development best practices.
- Create and maintain technical documentation, migration runbooks, and deployment guides.Support Agile ceremonies including Sprint Planning, Daily Scrum, Retrospectives, and Release activities.
Required Technical Skills
Must Have
Azure Data Factory (ADF)
Azure Databricks
- PySpark
- SQL Server / DB2 / Relational Databases
- Python
- Azure DevOps
- ETL/ELT Development
- Data Migration & Data Integration
- Source-to-Target Mapping
- Data Validation and Reconciliation
- CI/CD Pipelines
- Medallion Architecture (Bronze, Silver, Gold)
Key Competencies
- Strong analytical and problem-solving skills.
- Excellent communication and stakeholder management skills.
- Ability to work in Agile/Scrum environments.
- Ownership mindset and proactive approach to delivery.
- Ability to mentor junior team members and drive technical excellence.
Thanks & Regards
Kajal Badsiwal
Everforth Quinnox
Email ID -
[email protected]
📌 Data Engineer (Bengaluru)
🏢 Everforth Quinnox
📍 Bengaluru