28 Sep
|
Innova ESI
|
Bengaluru
28 Sep
Innova ESI
Bengaluru
Data Engineer / IT System Support Analyst –
- 5–7 years of relevant experience in Data Engineering, ETL, and data pipeline development.
Mandatory Skills
- Microsoft Azure
- Azure Data Factory (ADF)
- Azure Synapse Analytics
- Azure Databricks
- Azure Data Lake Storage Gen2 (ADLS Gen2)
- Azure Blob Storage
- SQL
- Strong SQL/DML skills
- Experience with SQL Server, PostgreSQL, or modern RDBMS
- Microsoft Power Platform
- Power Apps
- Power Automate
- Power BI
- REST APIs & OAuth
- CI/CD
- Azure DevOps Pipelines
- Git / Version Control
- Deployment and maintenance of data solutions
1. Key Responsibilities
- Design, develop, and maintain automated, scalable, modular, and reusable data pipelines.
- Develop and maintain ETL/ELT processes using Azure data services.
- Work with Azure Data Factory, Synapse, Databricks, ADLS Gen2, and Blob Storage.
- Design efficient SQL queries and work with relational databases such as SQL Server and PostgreSQL.
- Develop solutions using Power Apps, Power Automate, and Power BI.
- Integrate data from REST APIs and work with authentication mechanisms such as OAuth.
- Collaborate with Data Architects, developers, and business stakeholders to understand data requirements.
- Optimize data pipelines for performance, scalability, reliability, and cost efficiency.
- Implement data validation and quality checks to ensure data accuracy and integrity.
- Monitor, troubleshoot, and resolve data pipeline issues.
- Follow software engineering best practices, including CI/CD, Git, version control, testing, and reusable code.
- Stay current with emerging Azure and data engineering technologies.
1. Preferred / Good-to-Have Skills
- Python
- .NET / C#
- JavaScript or Java
- Experience querying API endpoints as data sources
- Understanding of Azure subscriptions, resource groups, and related services
- Experience with Git workflows
- Experience using Azure DevOps Repositories and Pipelines
- Knowledge of Ansible and its integration with Azure DevOps pipelines
1. Required Qualifications
- Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent experience.
- 5–7 years of proven experience in Data Engineering or a similar data/ETL-focused role.
- Strong understanding of software engineering principles applied to Data Engineering.
- Solid problem-solving and analytical skills.
- Excellent communication and collaboration skills.
- Ability and willingness to learn new technologies quickly.
📌 Data Engineer - Azure | Power Automate | Power Apps | Power BI (Bengaluru)
🏢 Innova ESI
📍 Bengaluru