- PySpark
- Databricks Workflows
- Apache Kafka
- Delta Lake on Databricks
- Snowflake
Key Responsibilities
- Design scalable data engineering solutions using PySpark and modern distributed data processing frameworks.
- Define data ingestion, transformation, and processing architectures aligned with business and analytical objectives.
Behavioral Competencies
- Demonstrates robust ownership while driving data engineering excellence.
- Collaborate effectively with various teams and business stakeholders to ensure smooth delivery.