17 Nov
|
NexGen Tech Solutions
|
Mumbai
17 Nov
NexGen Tech Solutions
Mumbai
Key Responsibilities
Design and develop cloud and big data solutions, including contemporary analytics lakes on Azure Databricks.
Drive data migration from legacy and on-premises systems to Azure Databricks, including data validation and reconciliation.
Build scalable batch and streaming data pipelines using contemporary cloud and open-source ETL tools.
Work with business teams to gather requirements, identify data sources, and resolve data quality issues.
Implement CI/CD pipelines and automate deployments in line with DevOps best practices.
Create and maintain data governance, documentation, and lineage.
Build high-performance, low-latency distributed data systems.
Support data discovery, create DataMarts and APIs, and integrate with analytics and visualization tools.
Work with data scientists and analytics teams on data ingestion, pipeline optimization, and AI/ML use cases.
Required Skills
Strong hands-on experience (minimum 5 years) with Python, PySpark, and SQL
Azure Data Factory, Azure Functions, Data Lake, and Databricks
Experience in data migration projects
ETL/ELT pipelines and data orchestration
CI/CD (Azure DevOps or GitHub Actions) and automation
Exposure to AI/ML or GenAI data pipelines (preferred)
Robust debugging and problem-solving skills
Excellent communication and collaboration abilities
📌 Devops Engineer Azure Devops + Databricks Mumbai
🏢 NexGen Tech Solutions
📍 Mumbai