Job Description
We are seeking a highly skilled Senior Data Engineer to support the migration of SAS-based data platforms, ETL processes, reporting datasets, and analytical workloads to Google Cloud Platform (GCP) using DBT. The role involves designing, developing, optimizing, and supporting cloud-native data pipelines while ensuring data quality, scalability, security, and compliance.
The ideal candidate should possess robust expertise in SQL, Python, PySpark, DBT, BigQuery, and data warehousing concepts, with experience in large-scale data migration and modernization initiatives.
Key Responsibilities
SAS Migration & Modernization
- Analyze existing SAS datasets, ETL jobs, PROC SQL code, and SAS macros.
- Convert SAS transformation logic into DBT models and cloud-native data pipelines.
- Support migration of historical and incremental data from SAS platforms to GCP.
- Participate in migration assessments, code conversion, and reconciliation activities.
Data Engineering & Development
- Design and develop scalable ELT pipelines using DBT and BigQuery.
- Build and optimize data ingestion, transformation, and aggregation processes.
- Develop reusable and modular DBT models following best practices.
- Implement performance tuning for SQL and BigQuery workloads.
- Create and maintain data lineage and metadata documentation.
Data Quality & Reconciliation
- Design and implement data quality validation frameworks.
- Perform source-to-target reconciliation between SAS and GCP platforms.
- Investigate and resolve data inconsistencies and migration issues.
- Support automated testing and monitoring of data pipelines.
Cloud Platform Development
- Build and manage solutions using:
- BigQuery
- Cloud Storage
- Dataproc
- Cloud Composer (Airflow)
- Dataflow
- Support data security, access controls, and governance requirements.
Collaboration & Delivery
- Work closely with Data Architects, Business Analysts, Data Modelers, and QA teams.
- Participate in design reviews and sp
📌 Senior Data Engineer (Pune)
🏢 EXL
📍 Pune