22 Nov
|
Zorba AI
|
Bengaluru
22 Nov
Zorba AI
Bengaluru
Data Engineering & AI Platform ArchitectDomain: BFSI / Financial ServicesExperience: 6 - 10 YearsLocation: BengaluruWork Mode: Work from Office - 4 days per weekNotice Period: Immediate to 30 daysRole Overview:We are looking for a Data Engineering & AI Platform Architect with strong hands-on experience in building scalable, cloud-native data platforms and end-to-end data engineering solutions. The ideal candidate will combine expertise in Python, SQL, Spark/PySpark, distributed data processing and modern lakehouse architectures with practical exposure to Generative AI, Large Language Models (LLMs), Retrieval-Augmented Generation (RAG) and vector databases. Experience in the BFSI domain is essential.Key Responsibilities:- Design and develop scalable, cloud-native, AI-ready data platforms and up-to-date data architectures.- Build, optimize and maintain end-to-end batch and streaming data pipelines using Python, SQL and Spark/PySpark.- Implement data ingestion, transformation, processing and integration across enterprise data sources.- Design and implement lakehouse architectures using platforms such as Databricks and Snowflake.- Integrate enterprise data platforms with LLM-based applications, RAG workflows and vector databases.- Develop reusable data services and frameworks to support analytics, machine learning and AI use cases.- Implement orchestration, CI/CD, monitoring, data quality, governance and security practices.- Drive MLOps/LLMOps practices to support reliable deployment, monitoring and lifecycle management of AI-enabled solutions.- Collaborate with data scientists, AI engineers,
architects and business stakeholders to deliver production-ready solutions.- Support data platform modernization, cloud migration, performance optimization and operational reliability.Mandatory Technical Skills:- Strong programming experience in Python and SQL.- Hands-on experience with Apache Spark and PySpark.- Strong data engineering experience, including end-to-end ETL/ELT pipeline development.- Experience with distributed data processing and large-scale data platforms.- Experience with cloud platforms such as AWS, Microsoft Azure or Google Cloud Platform (GCP).- Exposure to Databricks and/or Snowflake, including modern lakehouse architecture.- Practical understanding of LLM integration, RAG and vector databases.- Experience with workflow orchestration, CI/CD, monitoring, data governance and security.Domain Requirement:Mandatory experience in BFSI, banking, financial services or insurance. Candidates should be able to demonstrate hands-on involvement in relevant financial-services data platforms, workflows or use cases.Preferred Experience:- Experience implementing production-grade RAG or LLM-powered applications.- Exposure to vector databases, embeddings, semantic search and enterprise knowledge retrieval.- Experience with MLOps/LLMOps tools, model or prompt evaluation, observability and governance.- Experience designing secure, scalable and highly available data platforms.Candidate Requirements:- 6 - 10 years of relevant professional experience.- Immediate joiners or candidates with a notice period of up to 30 days.- Willingness to work from the office 4 days per week. (ref:hirist.tech)
📌 Data Engineering & AI Platform Architect (Bengaluru)
🏢 Zorba AI
📍 Bengaluru