# Job Title: AI Data Engineer

- Location: Pune, Maharashtra
- Work Mode: Work From Office (WFO)(886)
- Experience: 5–10 Years
- Notice Period: Immediate to 45 Days

## Role Overview We are looking for an experienced AI Data Engineer to design, develop, optimize, and operate scalable data pipelines and cloud-based data platform solutions. The ideal candidate will have strong hands-on experience with Azure, Databricks, PySpark, SQL, Kafka, Delta Lake, and ETL processes.

The role involves building reliable batch and streaming data pipelines, ensuring data quality and platform performance, and implementing knowledge base and Retrieval-Augmented Generation (RAG) solutions to support agentic AI use cases.

## Key Responsibilities

- Design, develop, optimize, and maintain production-grade batch and streaming data pipelines.
- Build and manage scalable data processing solutions using Azure, Databricks, PySpark, Python, SQL, Kafka, and Delta Lake.
- Develop robust ETL workflows for data ingestion, transformation, validation, and processing.
- Implement pipeline orchestration, monitoring, observability, error handling, and performance tuning.
- Develop and support knowledge base and RAG solutions for agentic AI applications.
- Ensure data quality, reliability, scalability, and security across data platforms.
- Apply enterprise data architecture principles, access controls, and cloud security best practices.
- Support CI/CD pipelines, release management, deployment, and production operations.
- Troubleshoot data pipeline issues and perform root cause analysis to maintain platform stability.




- Collaborate with engineers, architects, product owners, source-system teams, and business stakeholders to translate requirements into secure and maintainable solutions.
- Maintain technical documentation and participate in technical discussions and design reviews.

## Must-Have Skills ### Technical Skills

- Strong hands-on experience with Microsoft Azure and Databricks.
- Proficiency in Python and SQL for data transformation and validation.
- Practical experience with PySpark and Apache Spark for large-scale data processing.
- Experience with Apache Kafka and batch/streaming data pipelines.
- Strong understanding of Delta Lake and ETL processes.
- Experience with cloud data platforms and production data pipeline operations.
- Ability to independently design, build, optimize, monitor, and troubleshoot production pipelines.
- Understanding of enterprise data architecture, cloud security, access control, CI/CD, and release management.
- Experience with production support, error handling, observability, and performance optimization.

### Experience & Qualifications

- Bachelor's degree in Computer Science, Engineering, or a related field.




- 5–8 years of relevant experience in data engineering, data platform engineering, or cloud-scale analytics delivery.
- Demonstrated ownership of production pipelines and platform components.
- Minimum 2 years of stability with an organization.
- Excellent verbal and written communication skills.

## Nice-to-Have Skills
- Hands-on experience implementing knowledge base solutions.
- Experience developing Retrieval-Augmented Generation (RAG) solutions.
- Familiarity with agentic AI use cases and AI data platform integrations.
- Experience with advanced data pipeline orchestration, observability, and operational automation.

## Preferred Candidate Profile
- Self-driven professional with robust analytical and problem-solving abilities.
- Detail-oriented, with a focus on data quality and production reliability.
- Capable of working independently and leading technical discussions.
- Strong stakeholder management, documentation, and communication skills.
- Candidates currently based in Pune or nearby locations are preferred.

## Interview Process
- 2 Technical Rounds
- 1 Client Round
- HR Discussion
- Important:** This is a Work From Office role in Pune. Candidates should have relevant hands-on technical experience, strong communication skills, and be available to join within 45 days.

Skills: python,etl,apache spark,cloud data platforms,data platform engineering,data engineering,cloud-scale analytics delivery,databricks,delta lake,sql,microsoft azure,pyspark,batch/streaming data pipelines

📌 AI Data Engineer (Pune)
🏢 Umanist NA
📍 Pune