22 Aug
|
Henry Harvin India
|
Pune
22 Aug
Henry Harvin India
Pune
Job Summary
We are looking for a skilled and motivated Cloud Data & Generative AI Engineer to design, develop, deploy, and optimize cloud-based data and AI solutions. The ideal candidate should have hands-on experience with Microsoft Azure, Databricks, Python, SQL, Data Engineering, LLMs, Generative AI, RAG, and AI application development.
The role involves working across cloud infrastructure, data pipelines, analytics, machine learning, Generative AI applications, and modern AI architectures.
## Key Responsibilities
- Design and implement scalable data and cloud solutions using Microsoft Azure.
- Develop and manage Azure services including Azure Storage, Azure SQL, Cosmos DB, Virtual Machines, App Services, Azure Functions, API Management, Logic Apps, Event Hub, Service Bus, and Azure Monitor.
- Build and optimize data engineering pipelines using Azure Databricks, Apache Spark, PySpark, SQL, Delta Lake, and Azure Data Factory.
- Develop ETL/ELT pipelines and implement data ingestion, transformation, validation, and quality processes.
- Work with ADLS, Azure Synapse Analytics, Databricks, and Power BI for end-to-end data solutions.
- Implement CI/CD and infrastructure automation using Git, GitHub, GitHub Actions, Docker, Terraform, and Azure DevOps.
- Develop Python-based applications and APIs using frameworks such as FastAPI.
- Work with Machine Learning, Large Language Models (LLMs), NLP, Transformers, and pre-trained models.
- Develop and deploy Generative AI applications, chatbots, and conversational AI solutions using Azure AI services.
- Design and implement Prompt Engineering, Azure AI Foundry, Azure AI Search, RAG, vector search, embeddings, and agentic AI solutions.
- Build AI agents using tool/function calling, Semantic Kernel, LangChain, Azure AI Agent Service, and MCP.
- Develop Retrieval-Augmented Generation (RAG) pipelines with retrieval, grounding, reranking, query rewriting, and evaluation.
- Implement monitoring, security, governance, compliance, and performance optimization for cloud, data,
and AI workloads.
- Troubleshoot technical issues across cloud infrastructure, data pipelines, applications, and AI solutions.
- Collaborate with cross-functional teams to understand business requirements and deliver scalable technology solutions.
## Required Skills
- Microsoft Azure
- Azure Databricks
- Python
- SQL
- PySpark / Apache Spark
- Data Engineering & ETL/ELT
- Azure Data Factory
- Azure Data Lake Storage (ADLS)
- Azure Synapse Analytics
- Delta Lake
- Git & GitHub
- Docker
- GitHub Actions / CI-CD
- Terraform
- Power BI
- Machine Learning fundamentals
- Large Language Models (LLMs)
- Generative AI
- Prompt Engineering
- Azure AI / Azure OpenAI
- Azure AI Search
- RAG / Vector Search / Embeddings
- Agentic AI & Tool Calling
- MCP (Model Context Protocol)
- LangChain / Semantic Kernel
- FastAPI
## Good to Have
- Experience with Databricks architecture and performance optimization.
- Knowledge of Azure security, identity, DevSecOps, and governance.
- Experience with Kafka or Azure Event Hubs for real-time data processing.
- Knowledge of Power BI and advanced analytics.
- Experience with Collibra or data governance platforms.
- Familiarity with Current Relic and application/infrastructure observability.
- Understanding of AI model evaluation, monitoring, responsible AI, and data privacy.
## Education
Bachelor's or Master's degree in Computer Science, Information Technology, Data Science, Artificial Intelligence, Engineering, or a related field.
## Experience
10-12 years of relevant experience in Cloud, Data Engineering, AI/ML, Generative AI, or related technology domains.
## Key Competencies
Cloud Computing | Data Engineering | Azure | Databricks | Python | SQL | DevOps | Data Analytics | Machine Learning | Generative AI | LLMs | RAG | AI Agents | Azure AI | Prompt Engineering
Course- Salesforce Developer Training
Training - Offline
Duration -200 Hrs
Days- Mon to Fri ( 8 Hours per day )
Timing- 10 am to 7 pm
Address: Commerzone IT Park, Building No. 4, Samrat Ashok Path, off Airport Road, Yerawada, Pune, Maharashtra, 411006.
📌 Cloud Data & Generative AI Engineer (Pune)
🏢 Henry Harvin India
📍 Pune