08 Sep
|
OnPoint Insights
|
Mumbai
08 Sep
OnPoint Insights
Mumbai
Data Engineer + DevOps – Azure
Role Overview
We're looking for a Data Engineer with ~2 years of experience building and maintaining data pipelines on Azure, along with working knowledge of CI/CD practices to support automated, reliable deployments.
Key Responsibilities
Design, build, and maintain scalable ETL/ELT pipelines using Azure Data Factory and/or SQL-based tools
Work with SQL Server / Azure SQL for ingestion, transformation, and storage across staging/curated/reporting layers
Optimize pipelines and queries for performance and cost efficiency
Collaborate with BI/analytics teams to deliver clean, reliable datasets for reporting
Implement and maintain CI/CD pipelines using Azure DevOps
Write clean, modular, well-documented code following Git-based version control practices
Monitor pipeline health, troubleshoot failures, and ensure data quality
Explore opportunities to apply AI/GenAI tools for pipeline automation, data quality checks, or documentation
Participate in code reviews and contribute to engineering best practices
Required Skills & Qualifications
~2 years of experience as a Data Engineer
Solid hands-on experience with Azure data services (ADF, Synapse, Azure SQL, or similar)
Proficiency in SQL and solid understanding of relational database concepts
Working knowledge of CI/CD concepts and tools — Azure DevOps required; GitHub Actions, Jenkins, or GitLab CI experience a plus
Hands-on experience developing and maintaining CI/CD pipelines for development environments using Azure DevOps (ADO)
Experience with Git-based version control and branching workflows
Ability to write clean, modular, well-documented pipeline code
Python for scripting
Proficiency in PySpark and Spark SQL
Good to Have
Exposure to Databricks (PySpark / Spark SQL), Delta Lake concepts
Familiarity with AI-assisted development tools (GitHub Copilot, Azure OpenAI, Claude Code or similar)
Basic exposure to GenAI/LLM-based data workflows
Basic understanding of data warehousing / dimensional mo
📌 Data Engineer + DevOps – Azure (Mumbai)
🏢 OnPoint Insights
📍 Mumbai