15 Aug
|
Technology next
|
Pune
15 Aug
Technology next
Pune
Data Engineer (ETL) | AI/ML & Azure Data Platform
Experience: 7-8 Years
Employment Type: C2C / C2H
Location: Hybrid (Pan India)
Shift: 11:00 AM - 9:00 PM IST
Job Summary
Key Responsibilities
- Design and optimize ETL/ELT pipelines.
- Develop scalable data processing solutions using Python and PySpark.
- Build data lakes and warehouses using Azure Databricks and Snowflake.
- Develop Azure Functions and integrate Azure Service Bus.
- Automate infrastructure using Terraform and CI/CD pipelines.
- Collaborate with AI/ML teams to integrate LLMs into data workflows.
- Ensure data quality, scalability, and production support.
Required Skills:
- Data Engineering & ETL/ELT
- Python
- Apache Spark (PySpark & Spark SQL)
- Azure Databricks (Unity Catalog)
- Snowflake
- Azure Functions & Azure Service Bus
- SQL
- Terraform
- Git, GitHub Actions, Artifactory & SonarQube
- AI/ML & LLM Integration (mandatory)
Preferred Skills
Azure Data Factory, Azure Synapse, Delta Lake, MLflow, Azure DevOps, Kafka, Docker, Kubernetes, Microsoft Fabric.
Qualifications:
- Bachelor's or Master's degree in Computer Science, IT, Engineering, or a related field.
- 7-8 years of Data Engineering experience with Azure cloud services.
- Solid analytical, problem-solving, and communication skills.
Pay: ₹90,000.00 - ₹100,000.00 per month
Experience:
- Azure: 7 years (required)
- Snowflake: 4 years (required)
- ETL: 5 years (required)
- AI/ML Integration: 3 years (required)
- Python: 3 years (required)
Work Location: Hybrid remote in Pune, Maharashtra (Pune District)
📌 Data Eng (Pune)
🏢 Technology next
📍 Pune