About the Role:
We're Hiring: AI Data Engineer
Department: AI Factory
Experience: 5–10 Years Open
Position: Pune, Maharashtra, India
Are you passionate about building scalable data platforms and enabling next-generation AI solutions? We're looking for an experienced AI Data Engineer to design, develop, optimise, and manage production-grade data pipelines and AI-ready data solutions.
Responsibilities:
- Design, build, and maintain scalable batch and streaming data pipelines.
- Develop data transformation and validation workflows using Python, SQL, and PySpark.
- Work with Azure, Databricks, Apache Kafka, and Delta Lake for cloud-scale data processing.
- Implement and optimise ETL workflows, data orchestration, monitoring, and error handling.
- Develop knowledge bases and Retrieval-Augmented Generation (RAG) solutions for agentic AI use cases.
- Ensure data platform security, access control, CI/CD,
and production reliability.
- Collaborate with engineers, architects, product owners, and business stakeholders to deliver secure and maintainable solutions.
Qualifications:
- Bachelor's degree in Computer Science, Engineering, or a related field.
- 5–10 years of relevant experience in data engineering, data platforms, or cloud analytics.
Required Skills
- Azure Cloud Data Platforms
- Databricks
- Apache Spark / PySpark
- Python and SQL
- Apache Kafka
- Delta Lake and ETL
- Data Pipeline Design and Optimisation
- Knowledge of RAG and AI data solutions
- Robust problem-solving, analytical, documentation, and communication skills.
- Ability to independently own production pipelines and lead technical discussions.
📌 AI Data Engineer (Pune)
🏢 Arthefy
📍 Pune