Required Skills: Python, Spark or Pyspark, SQL, GCP
:
- Design, develop, and optimize scalable data pipelines using Python / PySpark .
- Work extensively with Google Cloud Platform (GCP) services to build robust data solutions.
- Develop and manage data workflows using Airflow / Cloud Composer / Astronomer .
- Implement data ingestion and streaming solutions using Pub/Sub and Apache Kafka .
- Build and maintain ETL/ELT pipelines using Dataflow or Dataproc .
- Write complex and optimized queries using BigQuery and Advanced SQL .
- Automate infrastructure provisioning using Terraform scripting .
- Develop serverless solutions using Cloud Functions .
- Configure and manage Scheduled Queries, Monitoring Dashboards, and Alerting Systems .
- Ensure data quality, reliability, and performance across pipelines.
- Collaborate with cross-functional teams (analytics, product, DevOps).
- Implement and maintain CI/CD pipelines for data workflows.
📌 GCP Data Engineer (Chennai)
🏢 Crescent Techservices
📍 Chennai
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.