Job Requirements

We are looking for a skilled Development Engineer – CDF Quality & Catalogue with expertise in data quality, data governance, data cataloguing, and AWS data services. The candidate will be responsible for implementing data quality controls, maintaining metadata catalogues, managing data governance policies, and monitoring data pipelines to ensure data accuracy, consistency, completeness, and reliability.

The ideal candidate will have hands-on experience with AWS Glue Data Catalog, AWS Lake Formation, and Amazon CloudWatch, along with a robust understanding of metadata management, data lineage, access controls, and data observability

Design, develop, and maintain data quality validation frameworks for CDF datasets and data pipelines.

Implement data quality checks to identify missing, duplicate, invalid, inconsistent,



and incomplete records

Establish data quality rules, validation thresholds, and exception-handling mechanisms.

Manage metadata, schemas, tables, partitions, and data discovery using AWS Glue Data Catalog.

Implement data governance policies, data ownership, classification, and metadata standards.

Configure and manage data access permissions and fine-grained access controls using AWS Lake Formation.

Monitor data pipelines, ingestion processes, and data quality metrics to identify operational issues

Data quality, data governance, data catalogue, Glue Data Catalog, Lake Formation, observability (CloudWatch)

Work Experience

5-7Years

📌 Lead Software Engineer (Bengaluru)
🏢 Virtusa
📍 Bengaluru