Re: [DISCUSS] FLIP-508: Add support for Smile format for Compiled plans

2025-02-07 Thread Gyula Fóra
Thanks Timo for the extra info on the context of this change. +1 Gyula On Fri, Feb 7, 2025 at 5:05 PM Timo Walther wrote: > Hi Gyula, > > Sergey and I spent a significant amount of time in researching different > formats. > > When we introduced CompiledPlan, the question whether we want to use

Re: [DISCUSS] FLIP-508: Add support for Smile format for Compiled plans

2025-02-07 Thread Timo Walther
Hi Gyula, Sergey and I spent a significant amount of time in researching different formats. When we introduced CompiledPlan, the question whether we want to use a binary format for performance and efficiency reasons immediately came up, but we decided to postpone this discussion. Back then

Re: [DISCUSS] FLIP-508: Add support for Smile format for Compiled plans

2025-02-07 Thread Gyula Fóra
Hey! Do we have some examples of other frameworks/projects etc using the Smile format? This seems to be a somewhat arbitrary change with regard to the selected format, my concern is that this will make the compiled plan less useful in general as it's harder to parse with standard tools. What is t

[DISCUSS] FLIP-508: Add support for Smile format for Compiled plans

2025-02-07 Thread Sergey Nuyanzin
Hi everyone, I would like to initiate a discussion for the FLIP-508[1] below, which adds support for Smile[2] format for Compiled plans Looking forward to hearing from you. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-508%3A+Add+support+for+Smile+format+for+Compiled+plans [2] https