Job Title: AI Data Engineer

Location: Bengaluru

Experience: 7+ Years

Mandatory Skills

Data Engineering, ETL/ELT, SQL, Python, Apache Spark, Databricks, Azure/AWS/GCP, Data Modeling, Data Lakes, Data Warehousing, Kafka/Event Hubs, Airflow, AI/ML Data Pipelines.

Key Responsibilities
- Design and develop scalable ETL/ELT pipelines for AI and analytics workloads.
- Build cloud-native data platforms, data lakes, and modern data warehouses.
- Develop batch and real-time data pipelines using Spark and Kafka/Event Hubs.
- Support AI/ML model training, feature engineering, and data preparation.
- Build AI-ready datasets for machine learning and Generative AI applications.
- Ensure data quality, governance, security, and regulatory compliance.
- Optimize data processing performance and cloud costs.
- Collaborate with AI Engineers, Data Scientists, and DevOps teams.
- Implement monitoring, automation,



and CI/CD for data pipelines.
- Maintain metadata, data lineage, and documentation.

Required Skills
- 6–8 years of experience in Data Engineering.
- Strong SQL and Python programming skills (Scala is a plus).
- Hands-on experience with Apache Spark and Databricks.
- Experience building enterprise ETL/ELT pipelines.
- Solid understanding of Data Lakes, Data Warehousing, and Data Modeling.
- Experience with Azure, AWS, or GCP data services.
- Experience with Kafka or Event Hubs for streaming data.
- Knowledge of Airflow, Git, and CI/CD practices.
- Experience supporting AI/ML workloads, feature engineering, or model data pipelines.
- Exposure to Generative AI or modern AI platforms is an added advantage.

📌 AI Data Engineer (Bengaluru)
🏢 Talentmatics
📍 Bengaluru