Job description for GCP Senior Data Engineer Job Title GCP Senior Data Engineer Experience 5 years Desired Candidate Profile Job Description In this Role the GCP Lead Data Engineer is responsible to Design develop test and implement technical solutions using GCP data technologies/tools Develop data solutions in distributed microservices and full stack systems Utilize programming languages like Python Java and GCP technologies like BigQuery Data Proc Data Flow Clous SQL Cloud Functions Cloud Run Cloud Composer PubSub APIs Lead performance engineering and ensure the systems are scalable Ensure clarity on NFR and implement these requirements Work with Client Technical Manager by understanding customers landscape their IT priorities Desired Candidate Profile Technology Engineering Expertise Overall 5 years of overall experience in implementing data solutions using CloudOnprem technologies At least 3 years of experience in data pipeline development using GCP cloud technologies Proficient in data ingestion store and processing using GCP technologies like BigQuery Data Proc Data Flow Clous SQL Cloud Functions Cloud Run Cloud Composer PubSub and APIs Proficient in pipeline development using ELT and ETL approaches Experience in Microservices implementations on GCP Knowledge in Master data management Knowledge in Data Catalog Data Governance Data Security Strong Python coding skills with handson experience in building scalable production grade data pipelines and services Excellent SQL skills Must be google certified Experience with different development methodologies RUP Scrum XP Soft skills Soft skills Able to deal with diverse set of stakeholders Proficient in articulation communication and presentation High integrity Problem solving skills learning attitude Team player
Responsibilities
- In this Role the GCP Lead Data Engineer is responsible to Design develop test and implement technical solutions using GCP data technologies/tools
- Develop data solutions in distributed microservices and full stack systems
- Utilize programming languages like Python Java and GCP technologies like BigQuery Data Proc Data Flow Clous SQL Cloud Functions Cloud Run Cloud Composer PubSub APIs
- Lead performance engineering and ensure the systems are scalable
- Ensure clarity on NFR and implement these requirements
- Work with Client Technical Manager by understanding customers landscape their IT priorities
Requirements / Qualifications
- Overall 5 years of overall experience in implementing data solutions using CloudOnprem technologies
- At least 3 years of experience in data pipeline development using GCP cloud technologies
- Proficient in data ingestion store and processing using GCP technologies like BigQuery Data Proc Data Flow Clous SQL Cloud Functions Cloud Run Cloud Composer PubSub and APIs
- Proficient in pipeline development using ELT and ETL approaches
- Experience in Microservices implementations on GCP
- Knowledge in Master data management
- Knowledge in Data Catalog Data Governance Data Security
- Robust Python coding skills with handson experience in building scalable production grade data pipelines and services
- Excellent SQL skills
- Must be google certified
- Experience with different development methodologies RUP Scrum XP
Soft Skills
- Able to deal with diverse set of stakeholders
- Proficient in articulation communication and presentation
- High integrity
- Problem solving skills learning attitude
- Team player
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.