ilto:pangong...@hotmail.com>>
发送时间: Wednesday, October 10, 2018 2:44:48 PM
收件人: vino yang
抄送: user
主题: 答复: No data issued by flink window after a few hours
Hi,
Cause default state size in one hour is too small,and the max window size is 24
hours, so I used 500M.
MemoryStateBackend stateBackend
Please look at the mail below, the others were out of data cause the bad
network.
Yours,
September
发件人: 潘 功森
发送时间: Friday, October 12, 2018 11:05:49 AM
收件人: vino yang
抄送: user
主题: 答复: No data issued by flink window after a few hours
Hi,
I found the pictures
pache.org>
主题: Re: 答复: No data issued by flink window after a few hours
Hi,
I agree with Vino, that you should check if the watermark is progressing for
all subtasks, if you are using event time semantics. If this is not the problem
it would help if you could share the code of your job. By
Hi,
I agree with Vino, that you should check if the watermark is progressing
for all subtasks, if you are using event time semantics. If this is not
the problem it would help if you could share the code of your job. By
the way have you tried reproducing the problem with collection source?
Best,
, October 10, 2018 2:44:48 PM
收件人: vino yang
抄送: user
主题: 答复: No data issued by flink window after a few hours
Hi,
Cause default state size in one hour is too small,and the max window size is 24
hours, so I used 500M.
MemoryStateBackend stateBackend = new MemoryStateBackend(MAX_STATE_SIZE);//500M
Hi,
Cause default state size in one hour is too small,and the max window size is 24
hours, so I used 500M.
MemoryStateBackend stateBackend = new MemoryStateBackend(MAX_STATE_SIZE);//500M
env.setStateBackend(stateBackend);
And I found Irrespective of the configured maximal state size, the state
Hi,
"ram to cache the distinct data about sliding window" means I used computer
momery not the third part db to cache the data need used in window.
“the data need used in window” means :such as the sliding window is 1 hour, and
I need to count the distinct users, I need to cache the user id about