- Design, develop, and maintain scalable data pipelines on Google Cloud.
- Build ETL/ELT workflows for ingesting and transforming data from multiple sources.
- Develop and optimize data warehouses using BigQuery.
- Create and manage data lakes using Cloud Storage and BigLake.
- Process large-scale batch and streaming data using Dataflow, Dataproc, and Apache Spark.
- Develop real-time data ingestion solutions using Pub/Sub.
- Perform data modeling and database optimization.
- Write complex SQL queries and improve query performance using BigQuery.
- Automate workflows using Cloud Composer (Airflow) and Workflows.
- Ensure data quality, validation, governance, and security controls.
- Monitor and troubleshoot production data pipelines.
- Collaborate with Data Analysts, Data Scientists, and business stakeholders.
- Implement CI/CD practices for data engineering solutions.