Role & responsibilities
10+ years of experience in Data Engineering / Data Platform roles
Solid hands-on expertise in:
Databricks (Delta Lake, workflows, DAG)
Apache Airflow / Astronomer
Python, SQL, DBT ,AWS
Proven experience implementing CI/CD frameworks (Harness, GitHub Actions, Azure DevOps)
Deep understanding of:
Data governance (catalogs, lineage, contracts, metadata)
Data quality and masking techniques
Enterprise data platforms and marketplace ecosystems
Experience with API-based integrations (e.g., entitlement systems like AccessCentral)
Monitoring/observability tools (e.g., Datadog)
Platform engineers must demonstrate genuine platform and infrastructure engineering capability across ten domains:
Infrastructure as Code
Cloud Platform Management (AWS and Azure)
CI/CD (including Harness)
Databricks platform provisioning (not just pipeline development)
Performance Tuning
Software Development (Python)
Container Platform (Kubernetes)
Networking
Security
Disaster Recovery (build, maintain and support DR features and tooling)