10 Aug
|
Religent Systems
|
Hyderabad
10 Aug
Religent Systems
Hyderabad
Job Description
We are looking for an experienced GCP Data Engineer with strong hands-on expertise in Python, BigQuery, Dataflow, and Cloud Composer. In this role, you will design, build, and maintain scalable data pipelines on Google Cloud Platform (GCP), working closely with business and technology teams to enable reliable data migration, transformation, and analytics use cases.
Roles & Responsibilities
Design & Develop Data Pipelines
Design, develop, and maintain scalable, secure, and reliable data pipelines using GCP services (BigQuery, Dataflow, Cloud Composer, GCS, etc.).
Build end-to-end data ingestion and transformation workflows from various source systems (databases, APIs, flat files, etc.).
Data Migration & Onboarding
Work with client business and technical teams to build complex data migration pipelines and seamlessly onboard recent data products to the GCP environment.
Streamline and optimize data migration workflows to add measurable value to client data hubs and analytics platforms.
Data Transformation & Curation
Build robust ETL/ELT processes to cleanse,
transform, and curate data into analytics-ready datasets and views.
Ensure data quality, integrity, and consistency across stages with proper validation, logging, and monitoring.
Frameworks & Reusability
Design and build reusable frameworks for ingesting different data patterns (batch, streaming, CDC, etc.), reducing time-to-market for new data products.
Create and maintain technical documentation for pipelines, frameworks, and processes.
Collaboration & Agile Delivery
Work in an agile environment, participating in sprint planning, daily stand-ups, and retrospectives.
Collaborate with data architects, analysts, SMEs, and business stakeholders to translate requirements into scalable data solutions.
Deployment, CI/CD & Operations
Use tools like Spinnaker, Jenkins, and Git to implement CI/CD for data pipelines and related components.
Deploy and manage data workloads on GKE or other GCP compute services
📌 GCP Data Engineer (Hyderabad)
🏢 Religent Systems
📍 Hyderabad