16 Nov
|
NexGen Tech Solutions
|
Mumbai
16 Nov
NexGen Tech Solutions
Mumbai
Key Responsibilities
• Design and develop cloud and big data solutions, including modern analytics lakes on Azure Databricks.
• Drive data migration from legacy and on-premises systems to Azure Databricks, including data validation and reconciliation.
• Build scalable batch and streaming data pipelines using modern cloud and open-source ETL tools.
• Work with business teams to gather requirements, identify data sources, and resolve data quality issues.
• Implement CI/CD pipelines and automate deployments in line with DevOps best practices.
• Create and maintain data governance, documentation, and lineage.
• Build high-performance, low-latency distributed data systems.
• Support data discovery, create DataMarts and APIs, and integrate with analytics and visualization tools.
• Work with data scientists and analytics teams on data ingestion, pipeline optimization, and AI/ML use cases. Required Skills
• Solid hands-on experience (minimum 5 years) with Python, PySpark, and SQL
• Azure Data Factory, Azure Functions, Data Lake, and Databricks
• Experience in data migration projects
• ETL/ELT pipelines and data orchestration
• CI/CD (Azure DevOps or GitHub Actions) and automation
• Exposure to AI/ML or GenAI data pipelines (preferred)
• Solid debugging and problem-solving skills
• Excellent communication and collaboration abilities
📌 DevOps Engineer (Mumbai)
🏢 NexGen Tech Solutions
📍 Mumbai