We are seeking an ambitious Data and AI Engineer with 5-8 years of experience to
play a pivotal role in modernizing client’s core data infrastructure and scaling
advanced AI capabilities. This role bridges legacy big data setting and
future cloud platform. You will actively maintain and optimize our existing data
pipelines while architecting, developing, and transitioning workflows to an
AI-ready cloud ecosystem. Beyond traditional data pipelines, you will play an
active role in building and deploying intelligent AI agents and leveraging
advanced Large Language Models (LLMs) like Anthropic Claude, utilizing the
cutting-edge Databricks AI suite to deliver immediate business value.
RESPONSIBILITIES
ROLES AND RESPONSIBILITIES: • Cloud Modernization & Migration: Deconstruct
legacy Apache Spark and Hadoop MapReduce workflows to re-architect and rebuild
them as optimized, production-ready pipelines within AWS and Databricks. • AI
Agent & LLM Development: Design, build, and deploy intelligent AI agents and
workflow automation tools leveraging leading Large Language Models (LLMs)
such
as Anthropic Claude. • AI Data Pipeline Engineering: Build and optimize pipeline
architectures explicitly tailored for AI use cases, including unstructured data
ingestion, real-time feature tokenization, and metadata tagging for vector
databases. • Legacy Infrastructure Maintenance: Monitor, maintain, and
troubleshoot existing big data workloads running on our Hadoop cluster to
guarantee data availability for business operations during the multi-phase
migration, resolving bottlenecks and Out Of-Memory (OOM) errors. • BI
Engineering & Support: Act as the primary engineering liaison for downstream
business stakeholders utilizing BI tools (e.g. Tableau, Looker, etc.) by
performing minor functional enhancements, bug fixes, and data extract
optimizations to resolve report dashboard latency. • Cloud Optimization: Utilize
Databricks and Delta Lake features (e.g., ACID transactions, Z-Ordering,
📌 Data Engineer (Bengaluru)
🏢 EXL
📍 Bengaluru