About the Role:
We're Hiring: AI Data Engineer
Department: AI Factory
Experience: 5–10 Years Open
Position: Pune, Maharashtra, India
Are you passionate about building scalable data platforms and enabling next-generation AI solutions? We're looking for an experienced AI Data Engineer to design, develop, optimise, and manage production-grade data pipelines and AI-ready data solutions.
Responsibilities:
Design, build, and maintain scalable batch and streaming data pipelines.
Develop data transformation and validation workflows using Python, SQL, and PySpark.
Work with Azure, Databricks, Apache Kafka, and Delta Lake for cloud-scale data processing.
Implement and optimise ETL workflows, data orchestration, monitoring, and error handling.
Develop knowledge bases and Retrieval-Augmented Generation (RAG) solutions for agentic AI use cases.
Ensure data platform security, access control, CI/CD,
and production reliability.
Collaborate with engineers, architects, product owners, and business stakeholders to deliver secure and maintainable solutions.
Qualifications:
Bachelor's degree in Computer Science, Engineering, or a related field.
5–10 years of relevant experience in data engineering, data platforms, or cloud analytics.
Required Skills
Azure Cloud Data Platforms
Databricks
Apache Spark / PySpark
Python and SQL
Apache Kafka
Delta Lake and ETL
Data Pipeline Design and Optimisation
Knowledge of RAG and AI data solutions
Robust problem-solving, analytical, documentation, and communication skills.
Ability to independently own production pipelines and lead technical discussions.
📌 Ai Data Engineer Pune (India)
🏢 Arthefy
📍 India