Design end to end Databricks Lakehouse architectures supporting batch streaming analytics and ML workloads
Define platform standards for data ingestion transformation storage and consumption using Delta Lake and Apache Spark
Ensure architectures are scalable resilient secure and cost optimized
Platform Engineering Optimization
Own Databricks workspace design cluster policies autoscaling strategies and job configurations
Lead Spark and SQL performance tuning workload optimization and capacity planning
Drive best practices for incremental processing partitioning and productive data layouts in Delta Lake
Data Governance Security Compliance
Implement enterprise grade governance using Unity Catalog access controls lineage and auditability
Enforce data security compliance and privacy standards across environments
Delivery Stakeholder Collaboration
Work closely with data engineers data scientists BI teams and application teams to translate business requirements into technical solutions
Review designs provide technical guidance and ensure adherence to architectural standards
Support cloud cost optimization platform troubleshooting and root cause analysis

📌 Databricks Engineer (Bengaluru)
🏢 Flow Global Technology
📍 Bengaluru