Re: Any way to improve list state get performance

2022-11-22 Thread Xingcan Cui
Hi Tao, I think you just need an extra `isEmpty` VARIABLE and maintain it properly (e.g., when restoring the job, check if the list state is empty or not). Also, I remembered that the list state for rocksdb is not as performant as the map state when the state is large. Sometimes you could use a m

Re: Any way to improve list state get performance

2022-11-21 Thread tao xiao
any suggestion is highly appreciated On Tue, Nov 15, 2022 at 8:50 PM tao xiao wrote: > Hi team, > > I have a Flink job that joins two streams, let's say A and B streams, > followed by a key process function. In the key process function the job > inserts elements from B stream to a list state if

Any way to improve list state get performance

2022-11-15 Thread tao xiao
Hi team, I have a Flink job that joins two streams, let's say A and B streams, followed by a key process function. In the key process function the job inserts elements from B stream to a list state if element from A stream hasn't arrived yet. I am wondering if any way to skip the liststat.get() to