24 Aug
|
Cloudxtreme
|
Bengaluru
24 Aug
Cloudxtreme
Bengaluru
Role & responsibilities
Analyze data and write complex SQL queries in GCP Big Query to extract required information.
Expertise in ETL concepts
Very solid SQL, ability to write complex SQL to perform common types of analysis and aggregations
Create stream and batch data pipeline using Java in Apache beam with distributed data processing using Google Dataflow.
Expert in Airflow, Cloud Composer, Dataflow, Cloud Storage balancing
Understand customer requirement lead down by BSA and provide required data outputs.
Orchestrate data pipeline jobs using Google cloud composer.
Write code in Python / Java to receive streaming data from Google cloud pub/sub.
Maintain code in given Bit bucket code repository and use Terraform and Python based data pipeline to deploy code in various cloud workplace.
Accept work, update status in JIRA and create documentation in Confluence.
Basic knowledge in Python programming,
📌 Google Cloud Platform Developer Bengaluru
🏢 Cloudxtreme
📍 Bengaluru