We are looking for an experienced Data Engineer with strong expertise in Python, SQL, Snowflake, and PySpark to design, develop, and optimize scalable data pipelines and data warehouse solutions.
Must-Have Skills:
- Advanced Python and SQL for data processing and transformations.
- Strong understanding of Snowflake architecture, query optimization, and performance tuning.
- Hands-on experience with PySpark and distributed data processing.
- Expertise in data modelling and data warehouse design.
- Experience with CI/CD pipelines, version control, and automated deployments.
Valuable to Have:
- Apache Kafka for real-time data processing.
- dbt for data transformations and testing.
- Knowledge of healthcare data controls, data privacy, and quality standards.