06 Aug
|
Tata Consultancy Services
|
Bengaluru
06 Aug
Tata Consultancy Services
Bengaluru
We are seeking a highly skilled Google Data Engineer (E4 level) to design, build, and optimize scalable data solutions on the Google Cloud Platform (GCP). The ideal candidate should have strong expertise in Big Data technologies and BigQuery, with hands-on experience in data pipeline development, data modeling, and performance optimization.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using GCP services.
- Build and manage data warehouses using BigQuery.
- Develop and optimize ETL/ELT workflows for large-scale datasets.
- Work with structured and unstructured data in Big Data environments.
- Ensure data quality, integrity, and governance across pipelines.
- Optimize queries and datasets for performance and cost efficiency in BigQuery.
- Integrate data from multiple sources (APIs, databases, streaming systems).
- Implement real-time and batch data processing solutions.
- Collaborate with data scientists, analysts, and business stakeholders to deliver actionable insights.
- Monitor and troubleshoot production data pipelines.
Required Skills & Expertise
- Strong experience in Google BigQuery
- Data modeling, partitioning & clustering
- Query optimization and cost management
- Hands-on with Big Data ecosystems
- Hadoop / Spark / Hive (preferably Spark on GCP Dataproc)
- Expertise in ETL/ELT pipeline development
- Proficiency in SQL (advanced level)
GCP Ecosystem
- Hands-on experience with:
- Cloud Storage
- Dataflow (Apache Beam)
- Dataproc
- Pub/Sub (streaming pipelines)
- Cloud Composer (Airflow)
- BigLake / Data Catalog (nice to have)
Programming
- Strong coding skills in:
- Python (preferred)
- Java/Scala (optional but good to have)
Data Engineering Concepts
- Data warehousing & dimensional modeling
- Schema design (star/snowflake)
- Data partitioning, clustering
- Batch and streaming architecture
- Data security & governance
Valuable to Have Skills
- Experience with CI/CD pipelines for data workflows
- Knowledge of Terraform / Infrastructure as Code
- Exposure to Looker / Data Studio / BI tools
- Experience in ML data pipelines on GCP
- Understanding of Data Mesh / Modern Data Architecture
Experience Requirements
- Typically 5+ years of experience in Data Engineering
- Minimum 23 years of hands-on experience in GCP
- Proven experience working with BigQuery in production environments
Education
- Bachelor’s or Master’s degree in Computer Science, Engineering, or related field
Soft Skills
- Strong analytical and problem-solving abilities
- Excellent communication and collaboration skills
- Ability to work in agile environments
📌 Digital : Google Data Engineering (Bengaluru)
🏢 Tata Consultancy Services
📍 Bengaluru