13 Aug
|
MentorBeep
|
Chennai
13 Aug
MentorBeep
Chennai
Senior Data Engineer – Engineer 3
Experience - 7+ years of skilled Data Engineering experience
Role Overview
We are looking for a Senior Data Engineer to design, build, and maintain scalable data pipelines, data platforms, and cloud-based data solutions. The role involves working with large volumes of data, optimizing systems, implementing CI/CD, and collaborating with cross-functional teams.
Must-Have Skills
GCP:
BigQuery
Dataflow
Dataproc
Data Fusion
Cloud SQL
Data Engineering & Processing:
Apache Airflow
PySpark
Python
Kafka
Pub/Sub
PostgreSQL
API Development
DevOps & Infrastructure:
Terraform
Tekton
CI/CD
Key Responsibilities
Design and develop scalable data pipelines and architectures.
Build and maintain data warehouses, lakes, and data platforms.
Process and manage large volumes of structured and unstructured data.
Automate data workflows using Python, PySpark, and Airflow.
Work with real-time data using Kafka and Pub/Sub.
Implement CI/CD and infrastructure automation using Terraform and Tekton.
Monitor, troubleshoot, and optimize data systems for performance and reliability.
Collaborate with Data Scientists, Analysts, Developers, and business teams.
Mentor junior engineers and take ownership of projects.
Preferred Skills
Jira
Data Governance
Machine Learning platforms
Data Visualization / BI tools
Kubernetes / Containerization
Cloud / Multi-cloud architecture
Ideal Candidate
A senior-level Data Engineer with solid GCP + Python + PySpark + Airflow expertise, hands-on experience building large-scale data pipelines, and positive knowledge of Kafka, Pub/Sub, Terraform, and CI/CD.
Pay: ₹1,500,000.00 - ₹2,300,000.00 per year
Application Question(s):
How many years of hands-on Data Engineering experience do you have?
How many years of work experience do you have with GCP?
Work Location: In person
📌 Senior Data Engineer – Engineer 3 Chennai
🏢 MentorBeep
📍 Chennai