06 Aug
|
Infiligence
|
Madurai
06 Aug
Infiligence
Madurai
- Design, build, and maintain ELT pipelines on GCP (ingestion through curated layers) using BigQuery, Dataform/Dataflow, and Cloud Composer.
- Ingest data from diverse sources streaming (Pub/Sub), batch and file-based (Cloud Storage), and healthcare interoperability formats (FHIR/HL7 via the Healthcare API).
- Implement data-quality controls (schema validation, completeness, deduplication, referential integrity) and end-to-end data lineage.
- Apply data protection and governance de-identification/tokenization (Cloud DLP with KMS/CMEK) and row- and column-level access controls.
- Model curated datasets (medallion / lakehouse and dimensional) for analytics, reporting, and downstream AI/ML.
- Build incremental and change-data-capture (CDC)
loads and optimize for cost and performance (partitioning, clustering, query efficiency).
- Establish observability (monitoring, alerting) and CI/CD for data pipelines, and maintain metadata and catalog documentation.
- Collaborate with data architects, analysts, and stakeholders to translate requirements into reliable, well-documented data products.
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
📌 Data Engineer - Google Cloud Platform (GCP) (Madurai)
🏢 Infiligence
📍 Madurai