Re: [DISCUSS] CEP-39: Cost Based Optimizer

2023-12-13 Thread Benedict
> Is it for you a blocker for this CEP or do you just want to make sure that this part is discussed in deeper details before we implement it? My concept of a CEP is that we explore enough of the design detail to have a shared understanding of how things should work before implementation begins. If

Re: [DISCUSS] CEP-39: Cost Based Optimizer

2023-12-13 Thread Benjamin Lerer
One thing that I did not mention is the fact that this CEP is only a high level proposal. There will be deeper discussions on the dev list around the different parts of this proposal when we reach those parts and have enough details to make those discussions more meaningful. > The maintenance an

Re: [DISCUSS] CEP-39: Cost Based Optimizer

2023-12-13 Thread guo Maxwell
calcite has it‘s own way of sql parser which used javacc that is different from antlr. though I think calcite is a very good sql framework in my opinion. We have tried to use calcite to develop our own sql which can both support cql ,and some normal sql like presto sql ,also we want to take advanta

Re: [DISCUSS] CEP-39: Cost Based Optimizer

2023-12-13 Thread Maxim Muzafarov
Hello Benjamin, Can you share the reasons why Apache Calcite is not suitable for this case and why it was rejected? It has custom syntax support, CBO, so I am interested to see some technical details in the "Rejected Alternatives" section, I'm pretty sure they exist, but they weren't mentioned the

Re: [DISCUSS] CEP-39: Cost Based Optimizer

2023-12-13 Thread Benedict
A CBO can only make worse decisions than the status quo for what I presume are the majority of queries - i.e. those that touch only primary indexes. In general, there are plenty of use cases that prefer determinism. So I agree that there should at least be a CBO implementation that makes the same d