18 Aug
|
Viaprom Technologies
|
Kolkata
18 Aug
Viaprom Technologies
Kolkata
Role Overview:
- We are seeking an experienced Senior Azure Data Engineer with 10-12 years of experience in designing, developing, and supporting enterprise data platforms and application backends on Microsoft Azure.
- The candidate should have strong hands-on expertise in Azure SQL, Azure Data Factory, data pipelines, Python, data governance, and application integration.
- The role will support enterprise analytics applications, Power Platform solutions, and migration of selected Python/Streamlit-based KPI applications to Power Apps.
Key Roles and Responsibilities
- 1. Design, develop, maintain, and optimize data pipelines using Azure Data Factory, Azure SQL, ADLS, and related Azure services.
- 2. Develop and optimize SQL databases, stored procedures, functions, views, data models, and backend components supporting enterprise applications.
- 3. Build and maintain ETL/ELT processes integrating data from multiple internal and external sources.
- 4. Implement data quality, reconciliation, validation, audit, logging, and error-handling mechanisms.
- 5. Support implementation of Data Governance requirements including Data Catalogue, Data Dictionary, Metadata Management, Data Lineage, Data Classification, Data Quality, RBAC, and audit controls.
- 6. Work with Data/Platform Architects to operationalize defined governance standards across databases, data pipelines, and applications.
- 7. Support Azure SQL backend and data integration requirements for Power Apps and Power Automate applications.
- 8. Troubleshoot database, data pipeline, connectivity, application integration, and production issues across Development, UAT, and Production environments.
- 9. Use Python for data processing, automation, validation, reconciliation,
and implementation/refactoring of analytical and KPI calculation logic.
- 10. Support migration of existing Python/Streamlit-based KPI applications to Power Apps by understanding existing computation logic, data flows, backend dependencies, and output structures.
- 11. Work closely with Power Platform Developers, SQL Engineers, Business Analysts, KPI Logic Owners, Power BI teams, and Azure Infrastructure teams.
- 12. Support CI/CD, Git/Azure DevOps, deployment, documentation, production support, and other related technical requirements across the application and data platform.
Required Skills
- 1. Strong hands-on expertise in Microsoft Azure Data Engineering.
- 2. Strong experience with Azure SQL Database, SQL Server, T-SQL, stored procedures, query optimization, indexing, and performance tuning.
- 3. Hands-on experience with Azure Data Factory and ETL/ELT pipelines.
- 4. Experience with Azure Data Lake Storage / ADLS Gen2 and cloud-based data integration.
- 5. Good hands-on knowledge of Python for data processing, automation, and analytical computations.
- 6. Solid understanding of data modelling, database design, data quality, reconciliation, audit, and error-handling frameworks.
- 7. Working knowledge of Data Governance including Data Catalogue, Metadata Management, Data Lineage, Data Dictionary, Data Quality, Data Classification, and RBAC.
- 8.
Understanding of Power Apps / Power Automate integration with Azure SQL and enterprise backend systems.
- 9. Experience with Git, Azure DevOps, CI/CD, and controlled deployment practices.
- 10. Strong troubleshooting, analytical, documentation, and problem-solving capabilities.
Preferred Skills
- 1. Experience supporting Power Apps / Power Automate-based enterprise applications.
- 2. Experience with Python Pandas, NumPy, Streamlit, or similar analytical applications.
- 3. Experience in migration or modernization of Python-based analytical applications.
- 4. Exposure to Power BI.
- 5. Exposure to Databricks, Spark, Synapse Analytics, or similar Azure data services.
- 6. Knowledge of REST APIs, Azure Key Vault, Managed Identity, and application integrations.
- 7. Experience implementing Data Governance and Data Quality controls in enterprise environments.
- 8. Experience in FMCG, Retail, Sales, Marketing Analytics, or similar data-intensive enterprise environments.
Candidate Profile
- 1. B.Tech/B.E./MCA or equivalent technical qualification.
- 2. 8-10 years of relevant experience in Azure Data Engineering, Database Engineering, or Data Platform development.
- 3. Strong hands-on technical orientation with the ability to independently develop, troubleshoot, and support production systems.
- 4. Ability to understand complex business/KPI calculation logic and translate it into scalable technical solutions.
- 5. Ability to work across Data Engineering, Data Governance, Power Platform integration, Python, and application backend requirements.
- 6. Ability to work effectively with architects, developers, business analysts, and client stakeholders.
📌 Senior Azure Data Engineer (Kolkata)
🏢 Viaprom Technologies
📍 Kolkata