04 Aug
|
Viaprom Technologies
|
West Bengal
04 Aug
Viaprom Technologies
West Bengal
Role Overview:
We are seeking an experienced Senior Azure Data Engineer with 10-12 years of experience in designing, developing, and supporting enterprise data platforms and application backends on Microsoft Azure. The candidate should have strong hands-on expertise in Azure SQL, Azure Data Factory, data pipelines, Python, data governance, and application integration. The role will support enterprise analytics applications, Power Platform solutions, and migration of selected Python/Streamlit-based KPI applications to Power Apps.
Key Roles and Responsibilities
1. Design, develop, maintain, and optimize data pipelines using Azure Data Factory, Azure SQL, ADLS, and related Azure services.
2. Develop and optimize SQL databases, stored procedures, functions, views, data models, and backend components supporting enterprise applications.
3. Build and maintain ETL/ELT processes integrating data from multiple internal and external sources.
4. Implement data quality, reconciliation, validation, audit, logging, and error-handling mechanisms.
5. Support implementation of Data Governance requirements including Data Catalogue, Data Dictionary, Metadata Management, Data Lineage, Data Classification, Data Quality, RBAC, and audit controls.
6. Work with Data/Platform Architects to operationalize defined governance standards across databases, data pipelines, and applications.
7. Support Azure SQL backend and data integration requirements for Power Apps and Power Automate applications.
8. Troubleshoot database, data pipeline, connectivity, application integration, and production issues across Development, UAT, and Production environments.
9. Use Python for data processing, automation, validation, reconciliation,
and implementation/refactoring of analytical and KPI calculation logic.
10. Support migration of existing Python/Streamlit-based KPI applications to Power Apps by understanding existing computation logic, data flows, backend dependencies, and output structures.
11. Work closely with Power Platform Developers, SQL Engineers, Business Analysts, KPI Logic Owners, Power BI teams, and Azure Infrastructure teams.
12. Support CI/CD, Git/Azure DevOps, deployment, documentation, production support, and other related technical requirements across the application and data platform.
Required Skills
1. Strong hands-on expertise in Microsoft Azure Data Engineering.
2. Strong experience with Azure SQL Database, SQL Server, T-SQL, stored procedures, query optimization, indexing, and performance tuning.
3. Hands-on experience with Azure Data Factory and ETL/ELT pipelines.
4. Experience with Azure Data Lake Storage ADLS Gen2 and cloud-based data integration.
5. Good hands-on knowledge of Python for data processing, automation, and analytical computations.
6. Strong understanding of data modelling, database design, data quality, reconciliation, audit, and error-handling frameworks.
7. Working knowledge of Data Governance including Data Catalogue, Metadata Management, Data Lineage, Data Dictionary, Data Quality, Data Classification, and RBAC.
8.
Understanding of Power Apps Power Automate integration with Azure SQL and enterprise backend systems.
9. Experience with Git, Azure DevOps, CI/CD, and controlled deployment practices.
10. Strong troubleshooting, analytical, documentation, and problem-solving capabilities.
Preferred Skills
1. Experience supporting Power Apps Power Automate-based enterprise applications.
2. Experience with Python Pandas, NumPy, Streamlit, or similar analytical applications.
3. Experience in migration or modernization of Python-based analytical applications.
4. Exposure to Power BI.
5. Exposure to Databricks, Spark, Synapse Analytics, or similar Azure data services.
6. Knowledge of REST APIs, Azure Key Vault, Managed Identity, and application integrations.
7. Experience implementing Data Governance and Data Quality controls in enterprise environments.
8. Experience in FMCG, Retail, Sales, Marketing Analytics, or similar data-intensive enterprise environments.
Candidate Profile
1. B.Tech/B.E./MCA or equivalent technical qualification.
2. 8-10 years of relevant experience in Azure Data Engineering, Database Engineering, or Data Platform development.
3. Robust hands-on technical orientation with the ability to independently develop, troubleshoot, and support production systems.
4. Ability to understand complex business/KPI calculation logic and translate it into scalable technical solutions.
5. Ability to work across Data Engineering, Data Governance, Power Platform integration, Python, and application backend requirements.
6. Ability to work effectively with architects, developers, business analysts, and client stakeholders.
📌 Senior Azure Data Engineer (West Bengal)
🏢 Viaprom Technologies
📍 West Bengal