11 Aug
|
Tata Consultancy Services
|
Bengaluru
11 Aug
Tata Consultancy Services
Bengaluru
Key Responsibilities
- Design, build, and optimize scalable data pipelines on GCP.
- Develop and maintain ETL/ELT workflows for ingesting, transforming, and loading data from multiple sources.
- Implement and manage data solutions using GCP services such as BigQuery, Cloud Storage, Dataflow, Dataproc, Pub/Sub, Composer, and Cloud Functions.
- Create and maintain data models, data marts, and enterprise data warehouses.
- Ensure data quality, governance, security, and compliance across data platforms.
- Collaborate with business stakeholders, data analysts, data scientists, and application teams to understand data requirements.
- Monitor, troubleshoot, and optimize data processing workflows for performance and cost efficiency.
- Implement CI/CD pipelines and infrastructure automation for data engineering deployments.
- Support real-time and batch data processing requirements.
- Document data architecture, workflows, and best practices.
Required Skills & Qualifications
- Bachelor's degree in Computer Science,
Information Technology, Engineering, or a related field.
- 5+ years of experience in Data Engineering and Cloud Data Platforms.
- Hands-on experience with Google Cloud Platform (GCP) services.
- Strong proficiency in SQL and data modeling concepts.
- Experience with BigQuery, Cloud Storage, Dataflow, Pub/Sub, and Dataproc.
- Strong programming skills in Python, Java, or Scala.
- Experience building ETL/ELT pipelines using modern data integration tools.
- Knowledge of distributed data processing frameworks such as Apache Spark.
- Understanding of data warehousing concepts and dimensional modeling.
- Experience with workflow orchestration tools such as Cloud Composer (Airflow).
- Familiarity with version control systems like Git and CI/CD practices.
- Solid problem-solving and analytical skills.
📌 GCP Senior Data Engineer - S (Bengaluru)
🏢 Tata Consultancy Services
📍 Bengaluru