Data Engineering with Databricks, Python, PySpark, SQL, DBT
- Strong in Python & Pyspark programming, SQL
- Has valuable experience in developming of Data Pipelines and Data Curation using AWS native data services (and Azure Synapse & ADLS)
- Has good experience on AWS Cloudformation for IaC and CI/CD using Git, Harness and Kubernetes
- Pipeline orchestation using Apache Airflow
- Data modeling experience
- Good communication skill and understanding/experience of working in Agile delivery
- AI-Augmented Engineering Delivery leveraging (Copilot, VS Code agent mode) into engineering workflow code generation, test creation, code review, documentation