23 Sep
Purview India Consulting And Services
Kheda
Role: Hadoop + GCP Data Engineer
Exp : 5+ years
Location: Pune
Immediate Joiner
Mandatory Skills:
Note: 5-7 years of exp having programming hands-on on Scala + Spark + CICD, cloud exposure as GCP exposure would be valuable to have but not mandatory.
- Must have good experience in below tech stack
- Hadoop
- Hive
- HDFS
- Apache
- Spark
- Scala
- GCP
- Jenkins
- Airflow
- SQL
- Hands on experience on Data migration and data processing on the Google Cloud stack, specifically:
- Big Query
- Cloud Dataflow
- Cloud DataProc
- Cloud Storage
- Cloud DataPrep
- Cloud PubSub
- Cloud Composer & Airflow
- Must have understanding Scala
- Experience designing and deploying large scale distributed data processing systems with few technologies such as PostgreSQL or equivalent databases, SQL, Hadoop, Spark, Tableau
- Proven ability to define and build architecturally sound solution designs.
- Demonstrated ability to rapidly build relationships with key stakeholders.
- Experience of automated unit testing, automated integration testing and a fully automated build and deployment process as part of DevOps tooling.
- Must have the ability to understand and develop the logical flow of applications on technical code level.
- Strong interpersonal skills and ability to work in a team and in global environments.
- Should be proactive, have learning attitude & adjust to work in dynamic work environments.
- Exposure in Enterprise Data Warehouse technologies
- Exposure in a customer facing role working with enterprise clients.
- Experience with industry standard version control tools (Git, GitHub), automated deployment tools (Ansible & Jenkins) and requirement management in JIRA.
- Exposure to DevOps & Agile Project methodology such as Scrum and Kanban.
- Understanding of big data modelling techniques using relational and non-relational techniques
- Experience on Debugging the Code issues and then publishing the highlighted differences to the development team/Architects.
- Understanding or experience of Cloud design patterns
- Good to have Google Cloud Certification.
📌 Data Engineer
🏢 Purview India Consulting And Services
📍 Kheda
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.