Senior Data Engineer – Engineer 3

Experience - 7+ years of professional Data Engineering experience

Role Overview

We are looking for a Senior Data Engineer to design, build, and maintain scalable data pipelines, data platforms, and cloud-based data solutions. The role involves working with large volumes of data, optimizing systems, implementing CI/CD, and collaborating with cross-functional teams.

Must-Have Skills

GCP:

- BigQuery
- Dataflow
- Dataproc
- Data Fusion
- Cloud SQL

Data Engineering & Processing:

- Apache Airflow
- PySpark
- Python
- Kafka
- Pub/Sub
- PostgreSQL
- API Development

DevOps & Infrastructure:

- Terraform
- Tekton
- CI/CD

Key Responsibilities

- Design and develop scalable data pipelines and architectures.
- Build and maintain data warehouses, lakes, and data platforms.
- Process and manage large volumes of structured and unstructured data.
- Automate data workflows using Python, PySpark, and Airflow.
- Work with real-time data using Kafka and Pub/Sub.




- Implement CI/CD and infrastructure automation using Terraform and Tekton.
- Monitor, troubleshoot, and optimize data systems for performance and reliability.
- Collaborate with Data Scientists, Analysts, Developers, and business teams.
- Mentor junior engineers and take ownership of projects.

Preferred Skills

- Jira
- Data Governance
- Machine Learning platforms
- Data Visualization / BI tools
- Kubernetes / Containerization
- Cloud / Multi-cloud architecture

Ideal Candidate

A senior-level Data Engineer with strong GCP + Python + PySpark + Airflow expertise, hands-on experience building large-scale data pipelines, and positive knowledge of Kafka, Pub/Sub, Terraform, and CI/CD.

Pay: ₹1,500,000.00 - ₹2,300,000.00 per year

Application Question(s):

- How many years of hands-on Data Engineering experience do you have?
- How many years of work experience do you have with GCP?

Work Location: In person

📌 Senior Data Engineer – Engineer 3 (Chennai)
🏢 MentorBeep
📍 Chennai