Job Summary

We are looking for an experienced Data Engineer to design, develop, and optimize scalable data pipelines and cloud-native data solutions on Google Cloud Platform (GCP). The role involves building robust ETL/ELT frameworks, implementing Infrastructure as Code using Terraform, enabling CI/CD practices, and delivering high-quality data products. The ideal candidate will have strong expertise in DBT, GCP services, data modeling, and modern data architecture.

Responsibilities

- Orchestrate Intelligence - Architect for RAG: You'll design and scale the pipelines for Retrieval-Augmented Generation (RAG), transforming massive volumes of unstructured IT logs and documentation into optimized Vector Embeddings.
- Scale vector infrastructure: You will be responsible for the health and performance of our vector databases (e.g., Pinecone, Milvus, or Weaviate), ensuring sub-second retrieval speeds for agentic reasoning loops.
- Master Data Transformation - Engineer semantic layers: Move beyond simple ETL to build knowledge graphs and semantic layers that provide agents with the necessary context to navigate complex infrastructure puzzles.
- Automate data excellence: Using a keen eye for detail, you'll build automated data guardrails to detect noise, bias, or PII (Personally Identifiable Information) before it reaches the model, ensuring our AI remains safe and impactful.
- Own the Backbone - Solve meaningful challenges: Serve as the bridge between raw, messy data sources and deep technical AI work, identifying and resolving quality issues at the source.
- Progress to production: With a well-defined methodology and software engineering prowess, you will build, deploy, and maintain the CI/CD pipelines for our data infrastructure, ensuring that our context window remains fresh and reliable.

What You Are

You're good at what you do and possess the required experience to prove it. However, equally as important - you have a growth mindset; keen to drive your own personal and career development.



You are customer-focused - someone who prioritizes customer success in their work. And finally, you're open and borderless - naturally inclusive in how you work with others.

Required Skills and Experience

- Overall 6+ Years of experience into IT.
- Expertise in data mining, data storage and Extract-Transform-Load (ETL) processes
- Experience in data pipelines development and tooling, e.g., Glue, Databricks, Synapse, or Dataproc
- Experience with both relational and NoSQL databases, PostgreSQL, DB2, MongoDB
- Excellent problem-solving, analytical, and critical thinking skills
- Ability to manage multiple projects simultaneously, while maintaining a high level of attention to detail
- Ability to communicate with both technical and non-technical colleagues, to derive and translate technical requirements from business needs

Preferred Skills and Experience

- Experience working as a Data Engineer and/or in cloud modernization
- Experience in Data Modelling, to create conceptual model of how data is connected and how it will be used in business processes
- Professional certification, e.g. Open Certified Technical Specialist with Data Engineering Specialization
- Cloud platform certification, e.g. AWS Certified Data Analytics - Specialty, Elastic Certified Engineer, Google Cloud Professional Data Engineer, or Microsoft Certified: Azure Data Engineer Associate
- Understanding of social coding and Integrated Development Environments, e.g. GitHub and Visual Studio
- Degree in a scientific discipline, such as Computer Science, Software Engineering, or Information Technology
- DBT, GCP, BigQuery, Data Engineer, Terraform, CI/CD, DevOps, SQL, Spark, Apache Beam, Hive, Cloud Run, Iceberg, Hudi, Avro, Parquet, Data Mesh, Data Modeling, ETL, ELT, Data Pipeline, Google Cloud

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.

📌 Data Engineer (Bengaluru)
🏢 Kyndryl
📍 Bengaluru