13 Nov
|
News
|
Bengaluru
The Data Engineer will primarily focus on the development, deployment, and operational
maintenance of the data pipelines.
~ Develop, deploy, and maintain scalable ETL/ELT
pipelines in GCP using Cloud Composer and PySpark on Dataproc following established
Performance Optimization: Implement and utilize BigQuery features like Partitioning,
Clustering, and Materialized Views to improve query performance and contribute to GCP
Data Integration: Assist in the implementation of BigLake components to ensure
structured and unstructured data is accessible with unified governance.
~ Code & Infrastructure Deployment: Utilize Terraform and CircleCI for deploying and
Data Operations & Monitoring: Implement robust logging, alerting, and data quality
checks within pipelines to actively monitor data flow and ensure data reliability.
- business requirements and translate them into efficient data solutions.
- data processing capabilities.
Experience: Mid Level - 2 - 4 years of hands-on Data Engineering experience.
Solid knowledge of GCP services with a focus on BigQuery, DataForm,
Cloud Composer, Cloud Storage, Cloud functions and Dataproc.
~ Transformation Tools: Proficiency in Dataform for managing version-controlled SQL
workflows and modeling within BigQuery.
~ Strong Coding: Excellent Python and SQL skills. Solid understanding of Data Modeling (Star Schema,
Snowflake) and Data Operations.
Experience with CI/CD tools and Infrastructure-as-Code is essential.
Experience in the News or Media industry is a solid plus.
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, age, national origin, protected veteran status, disability status or any other protected characteristic.
Reasonable Accommodation
We are committed to providing reasonable accommodation for qualified individuals with disabilities in our job application and/or interview process. If you need assistance or accommodation in completing your application or participating in an interview due to a disability, email us at [HIDDEN TEXT]. Please put 'Reasonable Accommodation' in the subject line and provide a brief description of the type of assistance you need. Please refer to the privacy notice at the bottom of this page for submitting any data access, deletion, or other data subject rights requests, where permitted under your local laws and regulations.
📌 Data Engineer with SQL (Bengaluru)
🏢 News
📍 Bengaluru