- 8+ years of design & development experience with big data technologies
- Proficient in Python, PySpark, Azure Data Brickes/AWS, Kubernetes and Terraform
- 2+ years of development experience in cloud technologies like Azure, AWS or GCP
- Proficient in querying and manipulating data from various DB (relational and big data).
- Experience of writing effective and maintainable unit and integration tests for ingestion pipelines.
- Experience of using static analysis and code quality tools and building CI/CD pipelines.
- Excellent communication, problem-solving, and leadership skills, and be able to work well in a fast-paced, dynamic environment.
- Experience of working on high-traffic and large-scale Software Products
- Mandatory: Solid experience in Data Governance, including SODA and Alation.
- Mandatory: Strong experience in Azure Databricks and data pipelines.