We are seeking a handson Databricks Platform Engineer to provide offshore operational support platform administration automation monitoring and continuous improvement for our enterprise Databricks Lakehouse platform on AWS
This role will work closely with the onshore Senior Data Platform Engineer while independently managing assigned platformengineering and operational responsibilities Key areas of focus include implementing established platform standards maintaining daytoday platform reliability automating repeatable activities responding to incidents and service requests and providing effective coverage outside onshore business hours The offshore engineer will also participate in proofofconcept initiatives evaluate emerging Databricks capabilities and provide handson assistance to Data Engineering and Data Science teams in resolving platformrelated issues The ideal candidate will have strong experience supporting Databricks in a production environment administering AWSintegrated platform services implementing Terraform automation and troubleshooting platform security networking compute and workload issues The offshore Databricks Platform Engineer will primarily focus on
Daytoday platform administration and operational support
Cost usage capacity and policy monitoring
Provide recommendations on cost optimizations
Implementation of approved architecture and platform standards
Monitoring incident response troubleshooting and service restoration
Terraform API CLI and scripting automation
Platform deployments and environment promotion
Access compute workspace and Unity Catalog administration
Runbooks operational documentation and shift handoffs
Initial investigation and escalation of complex platform issues
Required Qualifications
At least three years of handson experience administering and supporting Databricks in a production environment
Certifications in AWS and Databricks
Experience supporting enterprisescale Databricks environments on AWS
Robust knowledge of oDatabricks account and workspace administration oUnity Catalog and access governance oCompute policies and job policies oCost optimizations oAWS IAM VPC network and security KMS Dynamo MSK S3 Private links CloudWatch oDatabricks REST APIs and CLI automation oData pipelines SQL ETL process