07 May
|
AgileEngine
|
Bengaluru
07 May
AgileEngine
Bengaluru
Data Engineer – GCP | Mumbai / Pune / Bangalore
Immediate Hiring | Fast-Track Interviews | Work on Global Data Platforms
We’re hiring a Data Engineer (GCP) to join a high-impact data platform initiative at . If you enjoy building scalable data pipelines, working with financial datasets, and leveraging modern cloud + AI technologies, this role is for you.
Location: Mumbai / Pune / Bangalore - 2 Days Work from Office.
---
Why You Should Apply:
• Work on One MSCI Data Platform (OMDP) – a global data transformation initiative
• Build large-scale, regulatory-grade financial data systems
• Exposure to AI-driven data platforms (Vertex AI, anomaly detection, semantic search)
• Collaborate with global engineering, data, and compliance teams
• Strong ownership with real impact on business-critical systems
---
✅ What We Need (Non-Negotiable):
• 6–8 years of experience in Data Engineering
• Strong Python skills (data pipelines, transformation, automation)
• Advanced SQL + BigQuery (partitioning, clustering, materialized views, time-series queries)
• Hands-on experience with Cloud Composer (Apache Airflow) — DAGs, SLA, retries
• Experience with Dataproc (Apache Spark) — batch ingestion & Delta Lake
• Solid knowledge of GCP ecosystem (Cloud Storage, Pub/Sub, Datastream, IAM, Monitoring)
• Experience with Git workflows (branching, PRs, pipeline-as-code)
• Familiarity with REST APIs integrations
• Experience using AI-assisted dev tools (Copilot, Cursor, etc.)
---
What You’ll Do:
• Build scalable, fault-tolerant data pipelines on GCP
• Design BigQuery lakehouse layers & Dataproc-driven workflows
• Implement bitemporal data models (valid-time + system-time)
• Develop and maintain data quality & testing frameworks
• Own end-to-end pipeline lifecycle — ingestion → QA → audit → delivery
• Work with global stakeholders across engineering, business & compliance
• Support AI integrations (data quality, anomaly detection, semantic search using Vertex AI)
• Contribute to shared data platform services (not siloed development)
---
➕ Bonus (Good to Have):
• Experience with pandas / PySpark
• Knowledge of Dataplex, ClickHouse, CDC (Datastream)
• Understanding of financial data (equities, fixed income, corporate actions)
• Experience with BigQuery cost optimization (slots, reservations)
• Exposure to Terraform & CI/CD pipelines
• Experience with LLMs / Agentic AI use cases
---
⚡ Priority Given To Candidates Who:
• Have strong hands-on GCP + Airflow experience
• Have worked on large-scale data platforms / financial datasets
• Can join within 2 weeks
• Demonstrate solid ownership and problem-solving mindset
---
To Apply, DM or Share:
1. Email ID
2. Experience
3. Current CTC / Expected CTC
4. Notice Period
5. Location
---
Serious applicants only. Profiles without GCP + Airflow hands-on experience will not be considered.
📌 Data Engineer - GCP ( Mumbai/Pune/Bengaluru)
🏢 AgileEngine
📍 Bengaluru