- Design end to end Databricks Lakehouse architectures supporting batch streaming analytics and ML workloads
- Define platform standards for data ingestion transformation storage and consumption using Delta Lake and Apache Spark
- Ensure architectures are scalable resilient secure and cost optimized
- Platform Engineering Optimization
- Own Databricks workspace design cluster policies autoscaling strategies and job configurations
- Lead Spark and SQL performance tuning workload optimization and capacity planning
- Drive best practices for incremental processing partitioning and productive data layouts in Delta Lake
- Data Governance Security Compliance
- Implement enterprise grade governance using Unity Catalog access controls lineage and auditability
- Enforce data security compliance and privacy standards across environments
- Delivery Stakeholder Collaboration
- Work closely with data engineers data scientists BI teams and application teams to translate business requirements into technical solutions
- Review designs provide technical guidance and ensure adherence to architectural standards
- Support cloud cost optimization platform troubleshooting and root cause analysis

📌 Databricks Engineer (Bengaluru)
🏢 Flow Global Technology
📍 Bengaluru