30 Sep
|
Maneva Consulting
|
Chennai
30 Sep
Maneva Consulting
Chennai
Greetings from Maneva!
Job Title - Databricks Architect
Experience - 15 - 20 Years
Location - Chennai (Hybrid)
Notice - Immediate to 30 days
Requirements:-
- Refactor legacy Synapse T-SQL stored procedures, scripts, and views into native PySpark, Databricks SQL, or Delta Live Tables (DLT).
- Transition legacy Synapse distribution schemas (HASH, ROUND_ROBIN, REPLICATE) to Delta Lake Liquid Clustering (CLUSTER BY) for optimal query performance and maintenance.
- Design productive batch and streaming ingestion patterns using Autoloader and Delta Lake Lakehouse mechanisms.
- Conduct performance tuning using OPTIMIZE, Z-ORDER, compute cluster sizing, and Serverless Warehouse setup.
Key Skills
- Target State Architecture:
Designing end-to-end Target State Architecture Blueprints incorporating Databricks Lakehouse components, Unity Catalog, and Delta Live Tables (DLT).
- Databricks: Databricks Runtime, Delta Lake, Delta Live Tables (DLT).
- Architecture & Cost Optimization: Articulating design decisions, evaluating build vs. buy, and balancing performance with licensing costs.
- Performance & Storage: Liquid Clustering, Partitioning Strategies, Auto Loader, Databricks SQL Serverless.
- Languages: Python, PySpark, Advanced SQL, Scala (Optional).
- CI/CD & Tools: Databricks Asset Bundles (DABs), dbx, Git Integration, MLflow.
📌 Databricks Architect (Chennai)
🏢 Maneva Consulting
📍 Chennai