19 Nov
|
Wipro
|
Bengaluru
Job Title: GCP Data Engineer - Data Pipelines and DataOps
Location: Offshore
Job Responsibilities
1. Data Pipeline Development:
- Design, develop, and optimize end-to-end data pipelines on Google Cloud Platform (GCP) to facilitate seamless data integration from diverse sources to destinations.
- Implement both batch and streaming data processing solutions, ensuring high performance and reliability.
1. DataOps Implementation:
- Collaborate with cross-functional teams to establish and implement DataOps practices for data pipeline development, deployment, and monitoring.
- Integrate version control, automated testing, and continuous integration into the data engineering workflow.
1. GCP Data Services Mastery:
- Demonstrate advanced knowledge and hands-on experience with GCP data services, including BigQuery, Dataflow, Dataprep, Dataproc, and other relevant tools.
- Stay abreast of the latest GCP data services offerings and leverage them to enhance data engineering processes.
1. Data Governance and Security:
- Implement data governance policies within the context of DataOps, ensuring data quality, security, and compliance with industry standards.
- Work closely with security and compliance teams to address any data security concerns in data pipeline processes.
1. Collaboration and Communication:
- Collaborate effectively with data architects, data scientists, and business stakeholders to understand data requirements and deliver scalable and productive solutions.
- Communicate technical concepts and solutions to both technical and non-technical team members.
1. Documentation and Best Practices:
- Maintain comprehensive documentation for data pipelines, DataOps processes, and configurations.
- Advocate and enforce best practices for data engineering within the organization.
- Documenting Data API specifications including UML Entity relationship diagrams with entity description, enumerations, payload structure, data dictionary and error response structures.
Qualifications
- Bachelors degree in computer science, Information Technology, or a related field.
- Minimum of 5 years of hands-on experience with GCP data services and data engineering, with a focus on data pipelines and DataOps.
📌 Job Opportunity-GCP Data Engineer-Wipro (Bengaluru)
🏢 Wipro
📍 Bengaluru