Re: ProcessFunction collect and close, when to use?

2019-11-29 Thread shuwen zhou
if it’s closed, it usually means the writer is closed or maybe the > operator is closed. > > > > If processElement received a message but consider it as discard and > does not call collect(), will this block checkpoint's barrier until next > element was sent by collect() ?

ProcessFunction collect and close, when to use?

2019-11-28 Thread shuwen zhou
n the collector collect() anymore data? 2. If processElement received a message but consider it as discard and does not call collect(), will this block checkpoint's barrier until next element was sent by collect() ? -- Best Wishes, Shuwen Zhou

Re: Cron style for checkpoint

2019-11-21 Thread shuwen zhou
anism to > achieve fault tolerance and transparent for users. On the other hand, > savepoint in Flink behaves more like a user control behavior, can savepoint > not satisfy your demands for crontab? > > > > Best > > Yun Tang > > > > *From: *Congxian Qiu >

Re: Cron style for checkpoint

2019-11-20 Thread shuwen zhou
> > Best, > > Jiayi Liao > > > At 2019-11-21 10:20:47, "shuwen zhou" wrote: > >Hi Community, > >I would like to know if there is a existing function to support cron style > >checkpoint? > >The case is, our data traffic is huge on HH:30 for

Cron style for checkpoint

2019-11-20 Thread shuwen zhou
point is already in progress when minutes is 15 or 45, there would be a config value to trigger a new checkpoint or pass. -- Best Wishes, Shuwen Zhou <http://www.linkedin.com/pub/shuwen-zhou/57/55b/599/>

Fwd: RocksDB state on HDFS seems not being cleanned up

2019-11-17 Thread shuwen zhou
Forward to user group again since mail server was rejecting for last time -- Forwarded message - From: shuwen zhou Date: Wed, 13 Nov 2019 at 13:33 Subject: Re: RocksDB state on HDFS seems not being cleanned up To: Yun Tang Cc: user Hi Yun, After my investigation, I found out