Job Description :
About the Role
We are looking for a Data Engineer with excellent analytical abilities in the GCP Ecosystem. At News Corp India, our Data Warehouse is our primary product. You won't just move data; you will solve critical business problems by architecting high-performance, automated data environments.
This isn't just about moving data from A to B. You’ll be expected to understand the "why" behind the data, solving complex business problems through productive pipeline design and a "Thinking Data" mindset - where AI and advanced analytics are simply part of your standard toolkit.
The Technical Core
● Data Warehousing: Expert-level BigQuery (Partitioning, Clustering, Slot Management).
● Lakehouse Architecture: Implementing BigLake for unified governance. ● Distributed Processing: Processing large-scale datasets using PySpark on Dataproc.
● Orchestration & Code: Python, SQL, and Cloud Composer (Airflow). ● DevOps: Terraform (IaC), CircleCI, and GitHub.
Key Responsibilities
The Data Engineer will primarily focus on the development, deployment,



and operational maintenance of the data pipelines.
● Pipeline Development & Maintenance: Develop, deploy, and maintain scalable ETL/ELT pipelines in GCP using Cloud Composer and PySpark on Dataproc following established architectural patterns.
● Performance Optimization: Implement and utilize BigQuery features like Partitioning, Clustering, and Materialized Views to improve query performance and contribute to GCP cost management.
● Data Integration: Assist in the implementation of BigLake components to ensure structured and unstructured data is accessible with unified governance.
● Code & Infrastructure Deployment: Utilize Terraform and CircleCI for deploying and managing pipeline code and related infrastructure to ensure a modular and reproducible environment.
● Data Operations & Monitoring: Implement robust logging, alerting, and data quality checks within pipelines to actively monitor data flow and ensure data re

📌 Engineer, Data Engineering (Bengaluru)
🏢 News
📍 Bengaluru