Job Description :
Senior Data Engineer | Data Engineer News Corp India | Location: Bengaluru
About the Role
We are looking for a Senior Data Engineer (and Data Engineer) with excellent analytical abilities in the GCP Ecosystem. At News Corp India, our Data Warehouse is our primary product. You won't just move data; you will solve critical business problems by architecting high-performance, automated data environments. This isn't just about moving data from A to B. You’ll be expected to understand the "why" behind the data, solving complex business problems through productive pipeline design and a "Thinking Data" mindset - where AI and advanced analytics are simply part of your standard toolkit.
The Technical Core
● Data Warehousing: Expert-level BigQuery (Partitioning, Clustering, Slot Management).
● Lakehouse Architecture: Implementing BigLake for unified governance.
● Distributed Processing: Processing large-scale datasets using PySpark on Dataproc.
● Orchestration & Code: Python, SQL, and Cloud Composer (Airflow).
● DevOps: Terraform (IaC), CircleCI, and GitHub.



Key Responsibilities The Senior Data Engineer will be the technical lead for major initiatives, focusing on architecture, optimization, and setting best practices.
● Data Architecture & Design: Design and architect scalable, high-performance ETL/ELT pipelines in GCP using Cloud Composer and PySpark on Dataproc.
● Query & Cost Optimization: Lead the optimization of BigQuery performance—utilizing Partitioning, Clustering, Materialized Views, and slot management to drastically reduce latency and GCP costs.
● Lakehouse Governance: Implement and manage BigLake to bridge the gap between data lakes and warehouses, ensuring unified governance and security for structured and unstructured data.
● Advanced Automation & Infrastructure: Drive automation efforts from data ingestion to infrastructure deployment using Terraform (IaC) and CircleCI, ensuring modular, reproducible, and self-healing systems.
● Data Quality &

📌 Senior Engineer, Data Engineering (Bengaluru)
🏢 News
📍 Bengaluru