Role & responsibilities
- Analyze data and write complex SQL queries in GCP Big Query to extract required information.
- Expertise in ETL concepts
- Very strong SQL, ability to write complex SQL to perform common types of analysis and aggregations
- Create stream and batch data pipeline using Java in Apache beam with distributed data processing using Google Dataflow.
- Expert in Airflow, Cloud Composer, Dataflow, Cloud Storage balancing
- Understand customer requirement lead down by BSA and provide required data outputs.
- Orchestrate data pipeline jobs using Google cloud composer.
- Write code in Python / Java to receive streaming data from Google cloud pub/sub.
- Maintain code in given Bit bucket code repository and use Terraform and Python based data pipeline to deploy code in various cloud environment.
- Accept work, update status in JIRA and create documentation in Confluence.
- Basic knowledge in Python programming,
Process Skills:
- Participate as core member of agile team across all planning, analysis, design, development,
and testing activities including participation in all scrum ceremonies.
- Well-developed analytical & problem-solving skills
- Strong oral and written communication skills
- Excellent leadership skills with ability lead and guide and groom the team.
- Must possess good knowledge on SDLC and STLC life cycle.
Behavioral Skills:
- Good exposure in onsite/offshore work model and coordination.
- Robust technical leadership skills to mentor and manage a team in offshore
- Team player rather than an individual contributor
- Customer-oriented and cool-tempered
- At least 4 years of experience including;
- Able to work in Scrum model with offshore coordination
- able to work directly with customer stakeholders
- able to communicate clearly in oral and writing
- identify risks, plan mitigation
- escalate on time to customers and leaders
- good in prioritizing work and time management
good problem-solving skills, able to think out of the box