16 Nov
|
NexGen Tech Solutions
|
Mumbai
16 Nov
NexGen Tech Solutions
Mumbai
Key Responsibilities
- Design and develop cloud and big data solutions, including modern analytics lakes on Azure Databricks.
- Drive data migration from legacy and on-premises systems to Azure Databricks, including data validation and reconciliation.
- Build scalable batch and streaming data pipelines using modern cloud and open-source ETL tools.
- Work with business teams to gather requirements, identify data sources, and resolve data quality issues.
- Implement CI/CD pipelines and automate deployments in line with DevOps best practices.
- Create and maintain data governance, documentation, and lineage.
- Build high-performance, low-latency distributed data systems.
- Support data discovery, create DataMarts and APIs, and integrate with analytics and visualization tools.
- Work with data scientists and analytics teams on data ingestion, pipeline optimization, and AI/ML use cases.
Required Skills
- Strong hands-on experience (minimum 5 years) with Python, PySpark, and SQL
- Azure Data Factory, Azure Functions, Data Lake, and Databricks
- Experience in data migration projects
- ETL/ELT pipelines and data orchestration
- CI/CD (Azure DevOps or GitHub Actions) and automation
- Exposure to AI/ML or GenAI data pipelines (preferred)
- Robust debugging and problem-solving skills
- Excellent communication and collaboration abilities
📌 DevOps Engineer (Azure DevOps + Databricks) (Mumbai)
🏢 NexGen Tech Solutions
📍 Mumbai