GCP data services: BigQuery, Dataflow, Dataproc, Cloud Storage, Composer/Airflow, Pub/Sub
Strong SQL and Python for pipeline development
ETL/ELT design and dimensional data modelling
SAS Base & Macros for legacy analytics and migration
CI/CD, version control and cloud cost/performance tuning
Key tools BigQuery · Python · SAS · Airflow
Key Responsibilities
1. Develop and maintain complex data models using ca erwin data modeler to support business requirements.
2. Utilize google bigquery for data storage, querying, and analysis to ensure data accuracy and efficiency.
3. Implement data pipelines using google dataflow to streamline data processing and transformation tasks.
4. Write and optimize sql queries to extract and manipulate data for analysis purposes.
5. Develop and deploy python scripts for automating data related processes and tasks.
6. Collaborate with cross functional teams to ensure data quality, consistency, and integrity throughout the data lifecycle.
Skill Requirements
1. Proficiency in google bigquery for data storage,
querying, and analysis.
2. Robust sql skills for data manipulation and querying.
3. Experience with python for data processing, automation, and script development.
4. Knowledge of google dataflow for building and managing data pipelines.
5. Familiarity with ca erwin data modeler for designing and maintaining data models.
6. Strong analytical and problem-solving abilities.
7. Excellent communication and collaboration skills to work effectively with diverse teams.
8. Ability to prioritize tasks and work efficiently in a fast paced environment.
Other Requirements 1.Relevant certifications in Google BigQuery, SQL, Python, or CA Erwin Data Modeler are a plus.