We are seeking a highly skilled Senior Data Engineer to support the migration of SAS-based data platforms, ETL processes, reporting datasets, and analytical workloads to Google Cloud Platform (GCP) using DBT. The role involves designing, developing, optimizing, and supporting cloud-native data pipelines while ensuring data quality, scalability, security, and compliance.
The ideal candidate should possess solid expertise in SQL, Python, PySpark, DBT, BigQuery, and data warehousing concepts, with experience in large-scale data migration and modernization initiatives.
Key Responsibilities
SAS Migration & Modernization
Analyze existing SAS datasets, ETL jobs, PROC SQL code, and SAS macros.
Convert SAS transformation logic into DBT models and cloud-native data pipelines.
Support migration of historical and incremental data from SAS platforms to GCP.
Participate in migration assessments, code conversion, and reconciliation activities.
Data Engineering & Development
Design and develop scalable ELT pipelines using DBT and BigQuery.
Build and optimize data ingestion, transformation,
and aggregation processes.
Develop reusable and modular DBT models following best practices.
Implement performance tuning for SQL and BigQuery workloads.
Create and maintain data lineage and metadata documentation.
Data Quality & Reconciliation
Design and implement data quality validation frameworks.
Perform source-to-target reconciliation between SAS and GCP platforms.
Investigate and resolve data inconsistencies and migration issues.
Support automated testing and monitoring of data pipelines.
Cloud Platform Development
Build and manage solutions using:
BigQuery
Cloud Storage
Dataproc
Cloud Composer (Airflow)
Dataflow
Support data security, access controls, and governance requirements.
Collaboration & Delivery
Work closely with Data Architects, Business Analysts, Data Modelers, and QA teams.
Participate in design reviews and sprint planning sessions.
Estimate effort and provide technical input
📌 Senior Data Engineer (India)
🏢 EXL
📍 India