Role & responsibilities

Proficient in BigQuery, Dataflow, Cloud Build, SQL, Terraform, Git, experience with data modeling (dimensional modeling, star schema), ETL processes, and GCP cost optimization; LookML experience is a plus

BigQuery: Extensive experience designing, developing, and optimizing data warehouses and data marts within BigQuery, including deep knowledge of its architecture, partitioning, clustering, and performance tuning

Cloud Build: Proficiency in building and maintaining complex ETL pipelines using these and other relevant GCP services for data extraction, transformation, and loading.

SQL: Advanced proficiency with a focus on query optimization and performance tuning within BigQuery.

Terraform: Proven experience managing GCP infrastructure as code, specifically BigQuery resources.

Git: Proficiency with Git and version control best practices.

Data Modeling: Strong skills in designing dimensional models and star schemas, translating business requirements into productive data structures.

GCP Cost Optimization: Ability to estimate, track, and minimize GCP costs related to data processing and storage

ETL: Experience designing, building, and maintaining complex ETL processes.

Collaboration and Communication: Excellent interpersonal and communication skills for effective collaboration with stakeholders.

Preferred candidate profile

Translate Business Needs into Data Marts: Collaborate with business stakeholders to gather and analyze requirements, translating them into well-defined data marts (Consumption Datasets) within BigQuery,



Design and Develop ETL Processes: Design, develop, and maintain efficient and reliable ETL pipelines, adhering to the BTDP framework (Custom framework based on GCP components and Terraform for developing on Beauty Tech Data Platform).

Optimize for Performance and Cost: Continuously monitor and optimize the performance and cost of BigQuery queries and data storage. Implement best practices for partitioning, clustering, and query optimization to minimize costs and maximize efficiency.

Ensure Data Accuracy and Integrity: Implement data quality checks and validation processes throughout the ETL pipeline to ensure data accuracy and integrity.

Implement Access Management: Implement and maintain appropriate access controls for the Consumption Datasets within the BTDP framework, ensuring data security and compliance.

Collaborate with Power BI Team: Work closely with the Power BI team to ensure seamless integration of the Consumption Datasets into their semantic model. Provide necessary documentation and support to facilitate the development of reports and dashboards.

Document and Maintain Data Infrastructure: Maintain comprehensive documentation of the data architecture, ETL processes, and data models, including Terraform configurations and BTDP framework adherence.

Stay Current with GCP Technologies: Stay up to date on the latest GCP technologies and best practices, continuously seeking opportunities to improve the data infrastructure and processes within the context of the BTDP framework.

📌 GCP Data Engineer (Telangana)
🏢 Michael Page
📍 Telangana