06 Aug
|
MindBrain
|
Bengaluru
06 Aug
MindBrain
Bengaluru
– Senior Data Engineer (GCP)
? Location: Remote
? Experience: 5–8 Years
? Employment Type: Contract Job Summary
We are looking for an experienced Senior Data Engineer with strong expertise in Google Cloud Platform (GCP) and contemporary data engineering technologies. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines, optimizing data processing workflows, and enabling efficient analytics solutions using cloud-native technologies.
Key Responsibilities
Design, develop, and maintain scalable ETL/ELT pipelines using Python and Apache Airflow.
Build and optimize data ingestion, transformation, and processing workflows on Google Cloud Platform (GCP).
Develop and manage large-scale data solutions using BigQuery, Cloud Storage, and Data Lake architecture.
Work with structured and semi-structured data using SQL Server, BigQuery, and Hadoop ecosystems.
Optimize SQL queries, data models, and pipeline performance for high-volume datasets.
Design scalable Data Lake solutions for enterprise analytics and reporting.
Collaborate with Data Scientists, BI Developers, and cross-functional teams to deliver business-driven data solutions.
Implement data quality checks, monitoring,
logging, and troubleshooting mechanisms.
Ensure data security, governance, and best practices across cloud environments.
Participate in architecture discussions, code reviews, and technical documentation.
Required Skills
Strong hands-on experience with Google Cloud Platform (GCP).
Expertise in SQL Server and advanced SQL programming.
Strong programming skills in Python.
Experience with Apache Airflow for workflow orchestration.
Good knowledge of Hadoop ecosystem.
Hands-on experience with Google BigQuery.
Experience designing and implementing Data Lake architectures.
Strong understanding of ETL/ELT concepts and data warehousing.
Experience with Git, CI/CD, and Agile methodologies.
Excellent problem-solving and analytical skills.
Preferred Qualifications
Experience with GCP services such as Cloud Composer, Cloud Storage, Pub/Sub, Dataflow, or Dataproc.
Knowledge of Spark, PySpark, or distributed data processing frameworks.
GCP Professional Data Engineer certification is a plus.
Experience with infrastructure automation and monitoring tools is preferred.
📌 Senior GCP Data Engineer (10+ years) (Bengaluru)
🏢 MindBrain
📍 Bengaluru