We are hiring for one of our Leading Clients for a strong Senior GCP Data Engineer / Technical Lead with deep hands-on experience in Dataflow, Apache Beam, IAM strategy, Dataproc, BigQuery, Cloud Composer, Python and SQL to design, develop and optimize scalable enterprise data platforms.
Key Responsibilities
- Design and implement complex, scalable data pipelines using GCP Dataflow, Apache Beam and Dataproc/Spark.
- Develop custom Dataflow/Beam templates and reusable pipeline frameworks.
- Design and optimize Cloud Composer/Airflow DAGs, dependencies, scheduling and failure/retry strategies.
- Develop advanced Python and GoogleSQL solutions for large-scale data processing.
- Perform BigQuery performance and cost optimization, including query tuning, partitioning and clustering.
- Troubleshoot complex pipeline failures, performance bottlenecks and production issues.
- Implement batch and streaming pipelines using Dataflow and Pub/Sub.
- Review code and technical designs, ensure engineering best practices and mentor team members.
- Own technical quality across modules covering performance, scalability, reliability and maintainability.
- Collaborate with architects and stakeholders to translate solution designs into robust technical implementations.
- Solid hands-on Dataflow & Apache Beam experience is mandatory.
- Strong knowledge of GCP IAM, service accounts and project-level security.
- Expertise in BigQuery optimization, partitioning, clustering and cost management.
- Strong understanding of Dataproc/Spark internals and performance tuning.
- Hands-on experience with Cloud Composer/Airflow and production-grade DAG development.
- Strong troubleshooting and technical problem-solving skills.
If your skills match the JD and you're interested, please share your updated resume highlighting the relevant skill set.
Note: Profiles are now AI-validated, so please ensure your resume accurately reflects your hands-on experience matching the JD to avoid rejection due to skill mismatches.
📌 GCP Data Engineer (Bhubaneswar)
🏢 Elabs Infotech
📍 Bhubaneswar
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.