Core Technical Skills
• Strong Python programming experience
• Advanced SQL
• DBT development
• Google BigQuery
• PySpark
• Data engineering and ETL/ELT pipeline development
• Data validation and reconciliation
• Data migration experience
Python Libraries & Frameworks
• Pandas
• NumPy
• PyArrow
• Pytest
• Outstanding Expectations or similar data quality framework
• Google Cloud Python SDK
GCP Services
• BigQuery
• Cloud Storage
• Cloud Composer / Airflow
• Dataproc
• Dataflow
• IAM
• Cloud Logging and Monitoring
Responsibilities
SAS Migration & Code Conversion
• Analyse existing SAS datasets, SAS programs, PROC SQL, Data Steps, and SAS macros.
• Convert SAS business logic into Python, SQL, PySpark, and DBT models.
• Support migration of historical and incremental SAS data into GCP.
• Document SAS-to-GCP transformation logic and technical conversion rules.
• Assist in identifying reusable patterns for SAS macro conversion.
Python Data Engineering
• Develop Python-based data processing, automation, and validation scripts.
• Build reusable Python frameworks for data ingestion, transformation, and reconciliation.
• Use Python libraries such as Pandas, NumPy, PyArrow, and Google Cloud SDK.
• Automate data quality checks, file processing, metadata extraction, and exception reporting.
• Develop utilities to compare SAS outputs with GCP outputs.
DBT & BigQuery Development
• Develop and maintain DBT models for transformation logic.
• Convert SAS PROC SQL logic into DBT SQL models.
• Implement DBT tests for data quality, uniqueness, referential integrity, and business rules.
• Support Bronze, Silver, and Gold layer implementation in BigQuery.
• Optimize SQL queries and BigQuery tables for performance and cost efficiency.
GCP Data Pipeline Development
• Build scalable data pipelines using GCP services such as:
• BigQuery
• Cloud Storage
• Cloud Composer / Airflow
• Dataproc
• Dataflow
• Cloud Functions
• Develop batch and incremental
📌 Assistant Manager (Bengaluru)
🏢 EXL
📍 Bengaluru