06 Oct
|
Planful
|
Hyderabad
About the Role
As a Principal Architect, you will be responsible for the architectural design and end-to-end implementation of a high-performance OLAP query engine and semantic layer. The primary goal is to develop a custom JSON-based query language (DSL) and a translation engine that converts these requests into optimized SQL for columnar databases. This role requires a deep understanding of systems programming, compiler theory, and multi-dimensional data modeling to serve high-concurrency read loads in a microservices workplace.
What You'll Do
• Architectural Design & Query Execution
• Compiler & DSL development: Design a custom JSON-based OLAP query language. Define eBNF grammars and build a translation layer to convert functional formulas and DSL requests into an optimized execution plan.
• SQL generation & optimization: Implement and oversee the generation of highly optimized SQL tailored for columnar databases including ClickHouse, SingleStore, and DuckDB.
• Semantic layer management: Architect the representation of multi-dimensional data models within columnar structures,
ensuring efficient data retrieval and aggregation.
• Custom function logic: Implement logic for custom functions, determining the optimal balance between SQL push-down and application-layer execution
• Caching & Performance Engineering
• Multi-dimensional caching: Envisage and implement a distributed caching strategy for multidimensional data, utilizing shared memory systems like Redis.
• Concurrency & scaling: Build and maintain high-performance microservices using Java (Micronaut or Spring Boot) with Project Loom (Virtual Threads) to handle massive concurrent read loads.
• Low-level optimization: Manage system-level performance including connection pooling, array pooling, and off-heap memory management.
• JVM tuning: Apply expert knowledge of Java Garbage Collectors (including ZGC and Shenandoah) to maintain low-latency response times.
• Engineering Excellence & AI Integrati
📌 Principal Architect (Hyderabad)
🏢 Planful
📍 Hyderabad