Specialized in building scalable pipelines using GitHub, optimizing ETL workflows using native Databricks capabilities and Azure/ Amazon web services
- Build and maintain API integrations
- Develop SFTP pipelines and automated file ingestion
- Create error handling, notifications, and monitoring workflows
- Implement low-complexity ingestions (e.G., file drops, partner data shares)
- Maintain scripts and GitHub repositories
- Test pipelines and Document flows