Hi Timo, Renjie, What I was thinking did not include the QueryableStateTableSink, but rather tap in directly into the state of a streaming operator. Perhaps it is the same thing, but just it sounds not intuitive to consider it a sink.
So, we would need a way to configure the environment for the query to share the "state name" before the query is executed, and then use this to create the hook for the queriable state in the operator. Perhaps extend the current codegen and operator implementations to get as a parameter the StateDescriptor to be inquired. Looking forward for the design document, will be happy to give you feedback. Best, Stefano -----Original Message----- From: Renjie Liu [mailto:liurenjie2...@gmail.com] Sent: Friday, March 02, 2018 11:42 AM To: dev@flink.apache.org Subject: Re: StreamSQL queriable state Great, thank you. I'll start by writing a design doc. On Fri, Mar 2, 2018 at 6:40 PM Timo Walther <twal...@apache.org> wrote: > I gave you contributor permissions in Jira. You should be able to > assign it to yourself now. > > Am 3/2/18 um 11:33 AM schrieb Renjie Liu: > > Hi, Timo: > > It seems that I can't assign it to myself. Could you please help to > assign > > that to me? > > My jira username is liurenjie1024 and my email is > liurenjie2...@gmail.com > > > > On Fri, Mar 2, 2018 at 6:24 PM Timo Walther <twal...@apache.org> wrote: > > > >> Hi Renjie, > >> > >> that would be great. There is already a Jira issue for it: > >> https://issues.apache.org/jira/browse/FLINK-6968 > >> > >> Feel free to assign it to yourself. You can reuse parts of my code > >> if you want. But maybe it would make sense to have a little design > >> document first about what we want to support. > >> > >> Regards, > >> Timo > >> > >> > >> Am 3/2/18 um 11:10 AM schrieb Renjie Liu: > >>> Hi, Timo, I've been planning on the same thing and would like to > >> contribute > >>> that. > >>> > >>> On Fri, Mar 2, 2018 at 6:05 PM Timo Walther <twal...@apache.org> > wrote: > >>> > >>>> Hi Stefano, > >>>> > >>>> yes there are plan in this direction. Actually, I already worked > >>>> on > such > >>>> a QueryableStateTableSink [1] in the past but never finished it > because > >>>> of priority shifts. Would be great if somebody wants to > >>>> contribute > this > >>>> functionality :) > >>>> > >>>> Regards, > >>>> Timo > >>>> > >>>> [1] https://github.com/twalthr/flink/tree/QueryableTableSink > >>>> > >>>> Am 3/2/18 um 10:58 AM schrieb Stefano Bortoli: > >>>>> Hi guys, > >>>>> > >>>>> I am checking out the queriable state API, and it seems that > >>>>> most of > >> the > >>>> tooling is already available. However, the queriable state is > available > >>>> just for the streaming API, not at the StreamSQL API level. In > >> principle, > >>>> as the flink-table is aware of the query semantic and data output > type, > >> it > >>>> should be possible to configure the query compilation to nest > queriable > >>>> state in the process/window functions. Is there any plan in this > >> direction? > >>>>> Best, > >>>>> Stefano > >>>>> > >>>> -- > >>> Liu, Renjie > >>> Software Engineer, MVAD > >>> > >> -- > > Liu, Renjie > > Software Engineer, MVAD > > > > -- Liu, Renjie Software Engineer, MVAD
