- Design end to end Databricks Lakehouse architectures supporting batch streaming analytics and ML workloads

- Define platform standards for data ingestion transformation storage and consumption using Delta Lake and Apache Spark

- Ensure architectures are scalable resilient secure and cost optimized

- Platform Engineering Optimization
- Own Databricks workspace design cluster policies autoscaling strategies and job configurations

- Lead Spark and SQL performance tuning workload optimization and capacity planning

- Drive best practices for incremental processing partitioning and effective data layouts in Delta Lake

- Data Governance Security Compliance
- Implement enterprise grade governance using Unity Catalog access controls lineage and auditability

- Enforce data security compliance and privacy standards across environments

- Delivery Stakeholder Collaboration
- Work closely with data engineers data scientists BI teams and application teams to translate business requirements into technical solutions

- Review designs provide technical guidance and ensure adherence to architectural standards

- Support cloud cost optimization platform troubleshooting and root cause analysis

📌 Databricks Engineer (Bengaluru)
🏢 Flow Global Technology
📍 Bengaluru