Experience
8+ years of design & development experience with big data technologies
Proficient in Python, PySpark, Azure Data Brickes/AWS, Kubernetes and Terraform
2+ years of development experience in cloud technologies like Azure, AWS or GCP
Proficient in querying and manipulating data from various DB (relational and big data).
Experience of writing effective and maintainable unit and integration tests for ingestion pipelines.
Experience of using static analysis and code quality tools and building CI/CD pipelines.
Excellent communication, problem-solving, and leadership skills, and be able to work well in a rapid-paced, dynamic environment.
Experience of working on high-traffic and large-scale Software Products
Mandatory: Robust experience in Data Governance, including SODA and Alation.
Mandatory: Robust experience in Azure Databricks and data pipelines.