Data Engineer – Python | GCP | BigQueryExperience: 4–9 Years

Location:
Chennai Work Mode: Hybrid Notice Period: Immediate Joiners to Serving Notice Period Preferred 45 days Role OverviewWe are looking for an experienced Data Engineer with solid hands-on experience in Python/PySpark, SQL, GCP and BigQuery. The ideal candidate should have a strong understanding of data engineering, data warehousing and data processing technologies and experience building scalable data pipelines on GCP. Mandatory Skills
• Python / PySpark – 4+ Years
• SQL – 4+ Years
• GCP – 3+ Years
• BigQuery
• Dataflow or Dataproc
• Pub/Sub
• Scheduled Queries
• Cloud Functions
• Apache Kafka
• Terraform – 2+ Years
• Airflow / Astronomer / Cloud Composer – 2+ Years
• Monitoring Tools and Dashboards Good to Have
• GCP Data Fusion
• Tekton / CI-CD Pipelines
• GCP Secret Manager
• Advanced Analytics and Data/ML Solutions
• Prompt Engineering
• Generative AI / LLM
• Agentic AI
• LangGraph / CrewAI / OpenAI SDK / Google ADK

Key Responsibilities




• Design and develop scalable data pipelines using GCP services.
• Develop data processing solutions using Python/PySpark and SQL.
• Work with BigQuery and distributed data processing technologies.
• Build and maintain data pipelines using Dataflow/Dataproc, Pub/Sub and Kafka.
• Implement infrastructure automation using Terraform.
• Develop and manage workflows using Airflow, Astronomer or Cloud Composer.
• Monitor, troubleshoot and optimize production data pipelines.
• Work with business and technical stakeholders to understand requirements.
• Translate business problems into data, analytics and ML solutions. Candidate Profile
• Strong hands-on experience in Data Engineering.
• Good understanding of GCP data engineering and data warehousing.
• Strong Python/PySpark and SQL skills.
• Experience working with production-grade data pipelines.
• Strong analytical, problem-solving and communication skills.
• Candidates who can join immediately or are currently serving their notice period are preferred.

📌 GCP Data Engineer 5 + Years (Chennai)
🏢 HASHTAG GLOBAL SUPPORT PRIVATE
📍 Chennai