15 Aug
|
Hexaware Technologies
|
Mumbai
15 Aug
Hexaware Technologies
Mumbai
- 9-12 years of overall experience in IT, Data Engineering, and a minimum of 5 years of hands-on experience with Databricks in production environments, in cloud-based data engineering, with a strong background in designing, implementing, and supporting modern data lakehouse architectures.
- Design and build Databricks Lakehouse architecture specific to the client''s context: Unity Catalog hierarchy, cluster policies, network configuration (VNET injection or Private Link), and medallion layer design justified against their security, compliance, and budget constraints
- Implement Databricks Unity Catalog governance: three-level namespace design (metastore/catalogue/schema), column-level lineage, energetic data masking, row-level security, and Delta Sharing for cross-cloud data access
- Build AI-ready data pipelines: embedding generation workflows, document chunking and indexing pipelines, and semantic search indices using Databricks Vector Search
- Implement end-to-end monitoring: Databricks job failure alerts,
data freshness SLA checks, row count anomaly detection, data quality expectation failures via DLT
- Primary Skills: Databricks Lakehouse Platform , Delta Lake, Unity Catalog, Delta Live Tables, Databricks Workflows, Databricks SQL, Multi-Cloud Data Engineering, Azure (Synapse, ADF, ADLS Gen2) or AWS (S3, Glue, Redshift) or GCP (BigQuery, Dataflow); Python , PySpark, Pandas, Boto3, Delta API ; SQL
- Secondary Skills: Apache Kafka / Azure Event Hubs / AWS Kinesis, Databricks Structured Streaming, Databricks MLflow, Databricks AI Assistant, Snowflake, OpenLineage / Databricks Unity Catalog lineage, Azure DevOps / GitHub Actions, Cloud Cost Management / Databricks DBU optimisation, Docker / Kubernetes, REST / GraphQL API Integration, Data Governance Frameworks, GitHub Copilot.
Location - Chennai,Mumbai,Pune,Bengaluru,Hyderabad,Noida,Ahmedabad.
📌 Forward Deployed Engineer (Mumbai)
🏢 Hexaware Technologies
📍 Mumbai