Azure Data Engineer -
Job Title: Azure Data Engineer
Location: Pune/Mumbai
Experience Level: 5 to 7 Years
Job Purpose: To implement data engineering solutions on Enterprise Data Platform using latest technologies available in Azure Cloud space conforming to the best-in-class design standard & agreed requirements to achieve business objective
Accountabilities/Responsibilities:
- Build and operationalize data solutions for business using Azure services in combination with custom solutions Azure Data Factory, Azure Data Flows, Azure Databricks, Azure Data Lake Gen 2, Azure SQL etc
- Experience in migrating on-premises data warehouses to data platforms on AZURE cloud
- Designing and implementing data engineering, ingestion and transformation functions using ADF, Databricks
- Proficient in Py-Spark
- Experience in building Python based APIs on Azure Function Apps
- Experience on Azure Logic apps
- Experience in Lakehouse/Datawarehouse implementation using modern data platform architecture
- Capacity Planning and Performance Tuning on ADF & Databricks pipelines
- Support data visualization development using Power BI
- Exposure across all the SDLC process, including testing and deployment
- Experience in relational and dimensional modelling, including big data technologies
- Experience in Azure DevOps Build CI/CD pipelines for ADF, ADLS, Databricks, Azure SQL DB etc
- Experience of working in secured Azure environments using Azure Key Vaults, Service Principals, and Managed Identities
- Understanding of data masking, encryption and other practices used in handling sensitive data
- Ability to interact with Business for requirement gathering and query resolutions
- Working on offshore office-based development teams, collaborating within a team setting and participating in typical project lifecycle activities such as requirement analysis, testing and release
- Develop Azure Data skills within the team through knowledge sharing sessions, articles, etc.
- Adherence to organisations Risk & Controls requirements
- Participate in various initiatives/forums/groups and contribute effectively from idea creation to proto-type development. Support Strategic programs
- Good to have knowledge on Apigee (Googles API Management)
Knowledge, Skills, Experience & Educational Qualification Knowledge & Skills:
- Azure Data Factory
- Azure Data Lake Storage V2
- Azure SQL
- Azure Data Bricks
- PySpark
- Azure DevOps
- Power BI Report
- Confidence & excellent communication
Educational Qualification: Graduate/post-graduate. Preferably with specialisation in Computer Science, Statistics, Mathematics, Data Science, Engineering or related discipline
Microsoft Azure certification (good to have)
📌 Azure Data Engineer (Mumbai)
🏢 Atyeti
📍 Mumbai