â Lead the development, testing, and maintenance of the query optimizer for e6data's data lake query engine.
â Implement advanced optimization techniques, such as cost-based optimization and rule-
based optimization, to enhance engine performance.
â Design and build sophisticated capabilities in the optimizer, including the Learning
Optimizer, which intelligently detects and generates essential statistics. Leverage past query executions to improve cardinality estimates.
â Fine-tune the optimizer to handle complex queries, such as those involving intricate joins, subqueries, or large datasets, ensuring the engine can support diverse customer workloads efficiently.
â Integrate AI-driven optimization techniques to significantly enhance the efficiency of SQL query execution.
â Mentor junior engineers and contribute to the overall architectural decisions of the engine team.
Requirements
â Deep Understanding of Database Internals: Requires profound knowledge of how the query optimizer works, including an understanding of various access paths, join algorithms, and join ordering algorithms.
â Theoretical Understanding: A sound theoretical understanding of relational algebra and query rewrites.
â Problem-Solving Abilities: Exceptional ability to troubleshoot and optimize SQL execution plans, particularly in identifying and resolving performance bottlenecks.
â Programming Experience: Proficiency in Java, with extensive experience in building and optimizing large-scale distributed systems.
â Experience with Advanced Frameworks: Experience with Apache Calcite or similar query optimization frameworks; familiarity with AI and machine learning models,
especially in the context of database systems.
Benefits
Why Join Us?:
â Be part of a team that is pushing the boundaries of what’s possible in analytics.
â Lead initiatives that deliver tangible value and impact a wide array of industries.
â Enjoy a dynamic and cutting-edge work environment where your contributions are recognized and valued.