06 Sep
|
KANINI
|
Chennai
Job Description
Job Summary
n
We are looking for a skilled Data Engineer with a robust background in building scalable, high-performance data pipelines on Google Cloud Platform (GCP) .
n
The ideal candidate will have hands-on experience with BigQuery , Airflow , and cloud-based ETL workflows , along with solid programming expertise in Java or Python .
n
n
Experience: 8+ Years
n
Location: Chennai, Pune, Coimbatore and Bangalore
n
n
Primary Skills
n
n
Google Cloud Platform (GCP): Hands-on experience with BigQuery, Cloud Storage, Dataflow, Pub/Sub, and Airflow (Composer).
n
BigQuery: Strong SQL skills with expertise in query optimization, partitioning, clustering, and cost management.
n
Airflow (Composer): Proven ability to build, schedule, and monitor ETL/ELT pipelines using Apache Airflow.
n
Programming: Proficiency in Python or Java for data processing, automation, and pipeline development.
n
ETL & Data Integration: Designing and implementing end-to-end ETL/ELT workflows for structured and unstructured data.
n
Database Management: Solid command of SQL; working knowledge of NoSQL databases like MongoDB or Firestore.
n
Version Control & DevOps: Experience with Git,
CI/CD practices; familiarity with Docker/Kubernetes is a plus.
n
n
n
Key Responsibilities
n
n
Design, develop, and maintain scalable data pipelines and data lake solutions on GCP.
n
Build and automate data ingestion and transformation workflows using Airflow and BigQuery.
n
Ensure data quality, performance, and security across all cloud environments.
n
Collaborate with cross-functional teams to translate business needs into efficient data models.
n
Optimize queries, manage schema evolution, and maintain high data availability .
n
Implement data governance , version control, and CI/CD best practices.
n
Monitor and troubleshoot data pipelines for continuous reliability and efficiency improvements .
n
n
n
Why Join KANINI?
n
n
Join KANINI’s award-winning Data Engineering Team, recognized as the "Outstanding Data Engineering Team" at DES 2025
n
Work on real-world problemsat the intersection of data, AI, and product development
n
Be part of a cooperative, innovative, and growth-driven environment.
n
Access to cutting-edge tools, leadership support, and continuous learning opportunities.
n
n
📌 Senior Data Engineer Chennai
🏢 KANINI
📍 Chennai