10 Sep
|
CSI GLOBAL
|
Maharashtra
10 Sep
CSI GLOBAL
Maharashtra
Role: GCP Data Engineer Lead
Location : Pune
Job Summary
We are seeking a skilled Data Engineer with strong experience in Google BigQuery, SQL, and ETL pipeline development. The ideal candidate will be responsible for designing, developing, and maintaining scalable data solutions that support analytics, reporting, and business intelligence initiatives. The candidate should possess strong data modeling skills and hands-on experience with cloud-based data platforms.
Key Responsibilities
· Design, develop, and maintain scalable ETL/ELT pipelines for data ingestion and transformation.
· Build and optimize data warehouses and data marts using Google BigQuery.
· Develop complex SQL queries, stored procedures, and performance tuning techniques.
· Integrate data from multiple sources, including APIs, databases, and cloud storage.
· Ensure data quality, data governance, and data security standards are maintained.
· Collaborate with business stakeholders, data analysts, and data scientists to understand requirements.
· Monitor, troubleshoot, and optimize data processing workflows.
· Implement automation and orchestration solutions for data pipelines.
· Participate in code reviews, testing, and deployment activities.
· Document data flows, processes, and technical specifications.
Required Skills
Technical Skills
· Strong experience with Google BigQuery.
· Advanced proficiency in SQL.
· Hands-on experience in ETL/ELT development.
· Experience with data warehousing concepts and dimensional modeling.
· Knowledge of cloud platforms such as Google Cloud Platform (GCP).
· Experience with data orchestration tools such as Airflow, Cloud Composer, or similar.
· Working knowledge of scripting languages such as Python.
· Experience with Git and CI/CD processes.
Database Skills
· Relational databases (SQL Server, MySQL, PostgreSQL, Oracle).
· Query optimization and performance tuning.
· Data migration and integration.
Preferred Skills
· Experience with GCP services such as:
o Cloud Storage o Dataflow o Pub/Sub o Cloud Composer o Dataproc
· Knowledge of Spark or distributed data processing frameworks.
· Understanding of data governance and data quality frameworks.
· Experience in Agile/Scrum methodologies.
Qualifications
· Bachelor's degree in Computer Science, Information Technology, Engineering, or related field.
· Relevant cloud certifications (Google Cloud Skilled Data Engineer) are a plus.
Nice to Have
· Experience with BI tools such as Power BI, Tableau, or Looker.
· Exposure to real-time data processing and streaming architectures.
· Experience working in large enterprise environments.
📌 GCP Data Engineer Lead (Maharashtra)
🏢 CSI GLOBAL
📍 Maharashtra