Summary
We are seeking a highly skilled Data Engineer to join our IT Services team, where you will play a pivotal role in architecting and maintaining robust data infrastructure. This position is central to enabling advanced analytics and intelligent decision-making by leveraging cutting-edge technologies such as Generative AI, LLMs, and RAG frameworks. The ideal candidate will possess deep expertise in building scalable data pipelines and managing complex data ecosystems, ensuring seamless integration of batch and streaming processing to drive business value.
Responsibilities
- Design, develop, and optimize scalable ETL/ELT pipelines to facilitate efficient data movement and transformation.
- Architect and manage contemporary data platforms, including Data Lakes and Data Warehouses, to support diverse analytical needs.
- Implement and maintain real-time streaming and batch processing systems using industry-standard tools.
- Build and integrate APIs to ensure smooth data connectivity across various applications and services.
- Utilize Infrastructure as Code (IaC) principles to automate the provisioning and management of data infrastructure.
- Develop and deploy data models that support high-performance querying and reporting requirements.
- Collaborate on the implementation of advanced data solutions involving Kafka for event streaming and Airflow/Astronomer for orchestration.
- Create interactive dashboards and reports using Power BI to visualize key data insights for stakeholders.
- Apply Generative AI and LLM capabilities to enhance data processing workflows and unlock new analytical possibilities.
Requirements Requirements:
- Experience: 5.5 to 8 years of hands-on experience in data engineering within the IT Services sector.
- Technical Proficiency: Demonstrated expertise in Apache Kafka, Power BI, and API development.
- Advanced AI Skills: Proven ability to work with Generative AI, Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), and Model Context Protocol (MCP).
- Infrastructure: Strong background in Infrastructure as Code (IaC) for managing cloud resources.
- Orchestration: Experience with workflow orchestration tools such as Apache Airflow or Astronomer.
- Data Architecture: Deep knowledge of Data Modeling, Data Warehousing, and Data Lake architectures.
- Processing: Competence in handling both batch and streaming data processing scenarios.
- Compensation: Competitive salary package ranging from ₹22 to ₹25 LPA.
📌 Data Engineer (India)
🏢 Vrinda International
📍 India
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.