24 Sep
|
Q1 Technologies India PVT
|
Gurugram
24 Sep
Q1 Technologies India PVT
Gurugram
KEY ACCOUNTABILITIES
1. Data Architecture & Solution Design:
- Design scalable and efficient data solutions using Big Query and other GCP tools to support business intelligence and analytics needs.
- Collaborate with stakeholders to define data requirements and translate them into technical designs.
- Work with Google Cloud Platform, with some use of AWS
2. Data Integration & Pipelines:
- Build, maintain, and optimize ETL/ELT pipelines using tools such as Airflow, Dataflow, Apache Beam, and Cloud Composer.
- Integrate various data sources, including APIs, relational databases, and streaming platforms, into BigQuery.
- Data transformation with Dataform
3. BigQuery Optimization & Performance Tuning:
- Optimize BigQuery queries and storage to ensure cost efficiency and high performance.
- Implement partitioning and clustering strategies to enhance query performance.
4. Cloud Infrastructure Management:
- Manage and configure GCP services such as Cloud Storage, Pub/Sub, and IAM for secure and reliable data operations.
- Ensure adherence to best practices in cloud security and compliance.
5. Data Governance & Quality:
- Implement data quality and governance frameworks, ensuring data accuracy, consistency, and availability.
- Establish monitoring and alerting for data pipelines and systems to prevent and address failures.
6. Collaboration & Support:
- Work closely with data analysts, data engineers, and business teams to enable smooth processing of data.
- Provide technical guidance to team members.
KEY LIAISONS
- SDSE Data Engineering Team
- Samsung Electronics Australia
- Samsung Korea
DIMENSIONS:
- Maintain good and strong relationships with all key liaisons
- The direction of activities associated with marketing team and operation team
SKILLS AND EXPERIENCE:
Essential
1. The candidate must have exceptional English as they will be dealing with global teams where English is not everyone's first language.
2. The ability to work Australian hours
3. Technical Expertise:
- Proficient in BigQuery and SQL, with a strong understanding of data modeling and query optimization.
- Hands on experience with GCP services, including but not limited to Cloud Storage, Cloud Composer, Dataflow, and Pub/Sub.
- Familiarity with data pipeline tools and frameworks (e.g., Apache Beam, Airflow, Dataflow, Dataform).
- Strong proficiency in Python or Java for data processing and scripting tasks.
- Knowledge of shell scripting and automation in cloud environments.
- Proven experience designing and managing data solutions in GCP.
- Robust background in building and maintaining ETL/ELT pipelines in cloud environments.
- Demonstrated ability to optimize BigQuery performance and manage cloud costs effectively.
- Experience implementing partitioning, clustering, and materialized views.
4. Soft Skills:
- Excellent problem solving and analytical skills.
- Strong communication skills with the ability to convey complex technical concepts to non-tech stakeholders.
- Ability to work collaboratively in a fast paced, dynamic environment.
5. Certifications:
- Google Cloud Certified: Professional Data Engineer or Associate Cloud Engineer.
Desired
- Experience or knowledge of exposing data in Data Studio
📌 GCP Data Engineer (Gurugram)
🏢 Q1 Technologies India PVT
📍 Gurugram