11 Nov
|
Avia
|
Indiranagar
Data Engineer/ Sr. Data Engineer – Talend & Agentic AI
Experience: 3 –5 Years
Location: Bengaluru (Remote) Candidate has to be based in Bangalore
Employment Type: Full-Time
Role Overview
We are looking for a skilled and enthusiastic Data Engineer with 2–5 years of experience in Data Engineering, Talend Studio, and emerging Generative AI technologies. The ideal candidate should have hands-on experience in designing, developing, and maintaining scalable data integration and ETL pipelines using Talend Studio, along with an understanding of Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), and Agentic AI.
The candidate will work on building enterprise-grade data engineering solutions and contribute to integrating AI-powered capabilities into data platforms and business workflows.
Key Responsibilities
1. Data Engineering & ETL Development
Design, develop, and maintain scalable ETL/ELT pipelines using Talend Studio.
Build data integration workflows to extract, transform, and load data from multiple sources.
Work with structured and unstructured data across relational databases, APIs, files, and cloud platforms.
Perform data cleansing, transformation, validation, and quality checks.
Optimize ETL jobs for performance, scalability, and reliability.
Troubleshoot data pipeline failures and implement error-handling and monitoring mechanisms.
2. Generative AI & LLM
Work with Large Language Models (LLMs) and integrate them into enterprise applications.
Develop LLM-powered RAG pipelines and Agentic AI orchestration using as LangGraph, LangChain, or similar agentic frameworks.
Implement prompt engineering techniques and structured output generation.
Integrate LLM APIs and develop AI-powered workflows for business use cases.
Understand LLM concepts such as embeddings, vector search, context windows, and model inference.
Develop and implement RAG pipelines to enable intelligent retrieval from enterprise data sources.
Required Technical Skills
Primary Skills
3–5 years of experience in Data Engineering and ETL development.
Hands-on experience with Talend Studio (Talend Data Integration).
Good understanding of ETL/ELT concepts, data transformations, and data integration patterns.
Working knowledge of Python programming.
Understanding of Generative AI, LLMs, and Agentic AI concepts.
Knowledge of RAG architecture, embeddings, vector databases, and semantic search.
Familiarity with LangChain, LangGraph, or similar GenAI frameworks.
Secondary / Positive-to-Have Skills
Experience with SQL and relational databases such as PostgreSQL, MySQL, or SQL Server.
Exposure to cloud platforms such as AWS, Azure, or GCP.
Familiarity with Snowflake or other modern cloud data platforms.
Knowledge of REST APIs and microservices.
Exposure to vector databases such as FAISS, Pinecone, Chroma, or Weaviate.
Familiarity with Git, CI/CD, and software development best practices.
Understanding of data governance, security, and data quality practices.
Education
Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related discipline.
Keywords:
Talend Studio, Data Engineering, ETL, ELT, Python, SQL, Generative AI, Agentic AI, LLM, RAG, LangChain, LangGraph, Vector Database, Embeddings, Semantic Search.
Need to have strong Python coding experience.
Pay: ₹1,500,000.00 - ₹2,500,000.00 per year
Work Location: In person
📌 Data Engineer/ Sr. Data Engineer – Talend & Agentic AI (Indiranagar)
🏢 Avia
📍 Indiranagar