01 Sep
|
IntraEdge
|
Gurugram
01 Sep
IntraEdge
Gurugram
Job Title: Data Engineer with GCP
Location: Gurugram, India
Job Type: Full time
Job Summa
ry We are seeking an experienced Data Engineer with strong expertise i n Google Cloud Platform (GC P) , Pyth on, an d Py Spa rk to design, develop, and maintain scalable data pipelines and data processing solutions. The ideal candidate will have hands-on experience with big data technologies and cloud-based data platform
s.
Required Ski
lls5+ years of experience in Data Engineeri
ng. Strong programming experience in Pyt h
on. Hands-on experience wi th Py Sp ark for large-scale data processi
ng. Robust experience wi th Google Cloud Platform (G CP) servic
es: Big Qu
ery Cloud Stor
age Dataf
low Datap
roc Pub/
Sub Airf
low Experience building ETL/ELT pipelin
es. Strong SQL skills and database knowled
ge.
Experience with data modeling and data warehousing concep
ts. Knowledge of workflow orchestration tools such as Apache Airfl
ow. Experience with Git and CI/CD process
es.
Responsibili
ties Design, develop, and optimize scalable data pipelines using Python and Py Sp
ark. Build and maintain ETL/ELT processes on
GCP. Develop data ingestion solutions from multiple sour
ces. Work with large datasets and optimize data processing performa
nce. Create and maintain data models in Big Qu
ery. Implement data quality, validation, and monitoring proces
ses. Collaborate with data analysts, data scientists, and business stakehold
ers. Troubleshoot and resolve data pipeline iss
ues.
📌 Gcp data engineer (Gurugram)
🏢 IntraEdge
📍 Gurugram