26 Sep
BT Group
Secunderabad
Job Description: Data Engineer (Specialist)
Platform: GCP
Position Overview:
We are seeking a skilled and experienced GCP Data Engineer to join our team. As a GCP Data Engineer, you will be responsible for designing, implementing and maintaining our data infrastructure and pipelines on the Google Cloud Platform (GCP).
Key Responsibilities:
Design & Development:
- Design and implement data ingestion pipelines, data processing workflows, and data storage solutions using GCP services such as Cloud Storage, Big Query, Dataflow, Composer etc.
- Work with other DEs to integrate data solutions into existing or new applications.
- Develop and manage data integration processes to extract data from various sources, transform and cleanse it,
and load it into appropriate data storage systems.
- Implement robust ETL processes to ensure data quality and consistency.
Data Modeling and Optimization:
- Design and implement data models and schemas that meet business requirements and support efficient data retrieval and analysis.
- Optimize data structures and queries for performance and scalability.
Monitoring and Maintenance:
- Monitor data pipelines and processes for data quality issues.
- Troubleshoot and resolve data-related problems in a timely manner.
- Perform regular data backups and implement disaster recovery procedures.
Collaboration and Documentation:
- Collaborate with cross-functional teams to understand data requirements and provide technical guidance and support.
- Document data infrastructure, processes, and workflows to ensure knowledge sharing and maintainability.
Qualifications and Skills:
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- 8 years experience as a Data Engineer, preferably 5 years in Google Cloud Platform.
- Solid knowledge of GCP services such as Cloud Storage, Big Query, Dataflow, Dataproc, Cloud Composer, Pub/Sub, Airflow, DAG etc.
- Proficiency in SQL and experience with Data Modeling and Optimization.
- Experience with data integration and ETL processes.
- Familiarity with programming languages such as Python.
- Understanding of data security and compliance requirements.
- Excellent problem-solving and troubleshooting skills.
- Strong communication and collaboration skills.
We’re an equal opportunity employer. We value diversity and encourage people of all backgrounds to apply. If you’re excited about this role but don’t meet every requirement, we still want to hear from you.
📌 GCP Data Engineer (specialist)
🏢 BT Group
📍 Secunderabad
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.