Job Summary

We are seeking a highly skilled AI Data Engineer to design, build, and optimize scalable AI/ML data platforms and pipelines supporting Generative AI, Large Language Models (LLMs), and advanced analytics solutions. The ideal candidate will have hands-on experience with Databricks (DBRX ecosystem), cloud platforms (AWS, Azure, or GCP), up-to-date data engineering frameworks, and Snowflake data warehousing solutions.

Responsibilities

- Design and develop scalable batch and real-time data pipelines using Databricks, Spark, and cloud-native services.
- Build and maintain enterprise-grade data lakes, lakehouses, and data warehouses.
- Create ingestion frameworks for structured, semi-structured, and unstructured data.
- Develop AI-ready data pipelines supporting LLM, RAG, Agentic AI, and predictive analytics use cases.
- Implement metadata management, data governance, lineage, and data quality controls.
- Prepare and transform data for LLM training, fine-tuning, and inference workloads.
- Build Retrieval-Augmented Generation (RAG) pipelines integrating vector databases and enterprise knowledge sources.
- Develop data workflows supporting DBRX and other foundation models.
- Optimize AI data pipelines for performance, scalability, and cost efficiency.
- Design solutions on AWS, Azure, or GCP environments.




- Leverage cloud-native data services for ingestion, storage, orchestration, and monitoring.
- Implement CI/CD and Infrastructure as Code (IaC) practices for data platforms.
- Ensure security, compliance, and governance across cloud data ecosystems.

Technical Requirements

- Experience building enterprise GenAI or AI Agent solutions.
- Exposure to DBRX foundation models and Databricks AI platform.
- Hands-on experience with vector search and semantic retrieval systems.
- Knowledge of DataOps, MLOps, and LLMOps best practices.
- Experience with multi-cloud data architectures.
- Understanding of Responsible AI and model governance frameworks.

Qualifications

- Bachelor's or Master's degree in Computer Science, Data Engineering, Information Technology, Artificial Intelligence, or related field.

Key Skills

- Databricks
- DBRX
- PySpark
- Spark
- Snowflake
- AWS
- Azure
- GCP
- Delta Lake

Educational Requirement

Bachelor of Engineering,Bachelor Of Technology (Integrated)

Preferred Skills

Technology->AI-Data science->Machine Learning,Technology->AI-Generative AI->Artificial Intelligence - BASIC,Technology->AI-Generative AI->Generative AI for Data Analytics

Service Line

Data Analytics Unit

📌 AI Data Engineers (Noida)
🏢 Infosys
📍 Noida