19 Aug
|
Viaprom Technologies
|
Kolkata
19 Aug
Viaprom Technologies
Kolkata
Role Overview:
- We are seeking an experienced Senior Azure Data Engineer with 10-12 years of experience in designing, developing, and supporting enterprise data platforms and application backends on Microsoft Azure.
- The candidate should have strong hands-on expertise in Azure SQL, Azure Data Factory, data pipelines, Python, data governance, and application integration.
- The role will support enterprise analytics applications, Power Platform solutions, and migration of selected Python/Streamlit-based KPI applications to Power Apps.
Key Roles and Responsibilities
- Design, develop, maintain, and optimize data pipelines using Azure Data Factory, Azure SQL, ADLS, and related Azure services.
- Develop and optimize SQL databases, stored procedures, functions, views, data models, and backend components supporting enterprise applications.
- Build and maintain ETL/ELT processes integrating data from multiple internal and external sources.
- Implement data quality, reconciliation, validation, audit, logging, and error-handling mechanisms.
- Support implementation of Data Governance requirements including Data Catalogue, Data Dictionary, Metadata Management, Data Lineage, Data Classification, Data Quality, RBAC, and audit controls.
- Work with Data/Platform Architects to operationalize defined governance standards across databases, data pipelines, and applications.
- Support Azure SQL backend and data integration requirements for Power Apps and Power Automate applications.
- Troubleshoot database, data pipeline, connectivity, application integration, and production issues across Development, UAT, and Production environments.
- Use Python for data processing, automation, validation, reconciliation,
and implementation/refactoring of analytical and KPI calculation logic.
- Support migration of existing Python/Streamlit-based KPI applications to Power Apps by understanding existing computation logic, data flows, backend dependencies, and output structures.
- Work closely with Power Platform Developers, SQL Engineers, Business Analysts, KPI Logic Owners, Power BI teams, and Azure Infrastructure teams.
- Support CI/CD, Git/Azure DevOps, deployment, documentation, production support, and other related technical requirements across the application and data platform.
Required Skills
- Strong hands-on expertise in Microsoft Azure Data Engineering.
- Strong experience with Azure SQL Database, SQL Server, T-SQL, stored procedures, query optimization, indexing, and performance tuning.
- Hands-on experience with Azure Data Factory and ETL/ELT pipelines.
- Experience with Azure Data Lake Storage / ADLS Gen2 and cloud-based data integration.
- Good hands-on knowledge of Python for data processing, automation, and analytical computations.
- Strong understanding of data modelling, database design, data quality, reconciliation, audit, and error-handling frameworks.
- Working knowledge of Data Governance including Data Catalogue, Metadata Management, Data Lineage, Data Dictionary, Data Quality, Data Classification, and RBAC.
- Understanding of Power Apps / Power Automate integration with Azure SQL and enterprise backend systems.
- Experience with Git, Azure DevOps, CI/CD, and controlled deployment practices.
- Strong troubleshooting, analytical, documentation, and problem-solving capabilities.
Preferred Skills
- Experience supporting Power Apps / Power Automate-based enterprise applications.
- Experience with Python Pandas, NumPy, Streamlit, or similar analytical applications.
- Experience in migration or modernization of Python-based analytical applications.
- Exposure to Power BI.
- Exposure to Databricks, Spark, Synapse Analytics, or similar Azure data services.
- Knowledge of REST APIs, Azure Key Vault, Managed Identity, and application integrations.
- Experience implementing Data Governance and Data Quality controls in enterprise environments.
- Experience in FMCG, Retail, Sales, Marketing Analytics, or similar data-intensive enterprise environments.
Candidate Profile
- B.Tech/B.E./MCA or equivalent technical qualification.
- 10 years of relevant experience in Azure Data Engineering, Database Engineering, or Data Platform development.
- Solid hands-on technical orientation with the ability to independently develop, troubleshoot, and support production systems.
- Ability to understand complex business/KPI calculation logic and translate it into scalable technical solutions.
- Ability to work across Data Engineering, Data Governance, Power Platform integration, Python, and application backend requirements.
- Ability to work effectively with architects, developers, business analysts, and client stakeholders.
📌 Senior Azure Data Engineer (Kolkata)
🏢 Viaprom Technologies
📍 Kolkata