31 Jul
|
Akshya Patra Services
|
Bengaluru
31 Jul
Akshya Patra Services
Bengaluru
job Description: Data Engineer (2-3 years Experience)
We are looking for an experienced Data Engineer with 2-3 years of experience to join our growing team. This role will involve working with cutting-edge tools in the Google Cloud Platform (GCP) ecosystem, specifically focusing on BigQuery, Dataflow, Dataform, Cloud Storage, Pub/Sub, and Airflow. You will play a key role in building and maintaining scalable data pipelines, ensuring data integrity, and supporting the analytics team to drive data-driven decisions.
Key Responsibilities:
- Design, develop, and maintain data pipelines using GCP BigQuery, GCP Dataflow, GCP Dataform, and Airflow to ensure seamless data integration and transformation processes.
- Collaborate with cross-functional teams to understand data needs and ensure effective data solutions and integrations.
- Implement best practices for data quality, monitoring, and optimization in cloud-based environments.
- Work with GCP Cloud Storage and GCP Pub/Sub to manage and process large datasets, and enable real-time data streaming.
- Write efficient Python scripts to automate data workflows and integrate with different tools within the GCP workplace.
- Leverage DBT (Data Build Tool) for data transformation, testing, and documentation.
- Monitor and troubleshoot data pipeline issues, ensuring smooth and continuous operations.
- Participate in code reviews, testing, and deployment to production environments.
Required Skills:
- 2-3 years of experience as a Data Engineer, preferably with hands-on experience in Google Cloud Platform (GCP).
- Strong expertise in GCP BigQuery, GCP Dataflow, GCP Dataform, and Airflow for building data pipelines and workflows.
- Proficiency in Python for scripting and automation.
- Experience with GCP Cloud Storage and GCP Pub/Sub for managing and processing data.
- Familiarity with DBT for data transformation and version control.
- Understanding of ETL and data warehousing concepts, as well as data modeling and schema design.
📌 Data Engineer (Bengaluru)
🏢 Akshya Patra Services
📍 Bengaluru