Required Skills: Python, Spark or Pyspark, SQL, GCP
:
- Design, develop, and optimize scalable data pipelines using Python / PySpark.
- Work extensively with Google Cloud Platform (GCP) services to build robust data solutions.
- Develop and manage data workflows using Airflow / Cloud Composer / Astronomer.
- Implement data ingestion and streaming solutions using Pub/Sub and Apache Kafka.
- Build and maintain ETL/ELT pipelines using Dataflow or Dataproc.
- Write complex and optimized queries using BigQuery and Advanced SQL.
- Automate infrastructure provisioning using Terraform scripting.
- Develop serverless solutions using Cloud Functions.
- Configure and manage Scheduled Queries, Monitoring Dashboards, and Alerting Systems.
- Ensure data quality, reliability, and performance across pipelines.
- Collaborate with cross-functional teams (analytics, product, DevOps).
- Implement and maintain CI/CD pipelines for data workflows.
📌 GCP Data Engineer (Chennai)
🏢 Crescent Techservices
📍 Chennai
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.