31 Jul
|
Ascendion Engineering
|
Maharashtra
31 Jul
Ascendion Engineering
Maharashtra
Position: GCP Data Engineer with ML
Exp Level: 8+ years
Location: Bengaluru, Hyderabad, Chennai, Pune, Vadodara
Work Hours :: 2-11 pm IST
Required Qualifications:
- Hands-on data engineering or ML data engineering experience in a production GCP environment.
- Strong proficiency in Python, Java, or Node.js for pipeline development, feature engineering scripts, and automation.
- Strong hands-on experience with BigQuery (partitioning, clustering, cost management, complex SQL, ML-optimized
table design).
- Proficiency with Apache Kafka for real-time streaming ingestion.
- Experience with Dataflow (Apache Beam) for both streaming and batch pipelines.
- Proficiency with Apache Spark (PySpark or Scala); DataSpark experience a solid plus.
- Solid familiarity with GCP ecosystem: Cloud Storage, Pub/Sub, Dataproc, Cloud Composer/Airflow.
- Experience building ML training pipelines and Feature Stores (GCP Feature Store preferred); understanding of the ML
lifecycle including feature engineering, data versioning, and train/eval splits.
- Experience with Vertex AI Pipelines or similar MLOps tooling.
- Demonstrated experience designing disaster recovery zones and failover strategies for cloud data platforms:
cross-region replication, RTO/RPO definition, and DR testing.
- Experience with data archival design: BigQuery table lifecycle management, Cloud Storage tiered storage policies, and
long-term retention for regulated datasets.
- Hands-on experience handling PHI under HIPAA: field-level encryption and masking, de-identification techniques, audit
logging, access control policies, and HIPAA Security Rule compliance for data at rest and in transit.
- Strong SQL and data modeling skills; experience with layered data lake or lakehouse architecture.
Nice to Have
- Experience integrating Adobe Analytics data streams or Adobe Experience Platform.
- Familiarity with Looker or Vertex AI as downstream consumers.
- Knowledge of Click-Thru file formats and external table patterns in BigQuery.
- Experience with GCP CMEK (Customer-Managed Encryption Keys) for PHI dataset protection.
- Familiarity with HIPAA BAA requirements in cloud vendor agreements.
📌 GCP Data Engineer with ML (Maharashtra)
🏢 Ascendion Engineering
📍 Maharashtra