RE: [Flink 1.6] How to get current total number of processed events

2019-01-25 Thread Thanh-Nhan Vo
Hi Kien, Thanks you so much for you answer ! Regards, Nhan De : Kien Truong [mailto:duckientru...@gmail.com] Envoyé : vendredi 25 janvier 2019 13:47 À : Thanh-Nhan Vo ; user@flink.apache.org Objet : Re: [Flink 1.6] How to get current total number of processed events Hi Nhan, To get a global

Re: [Flink 1.6] How to get current total number of processed events

2019-01-25 Thread Kien Truong
nvoyé :* jeudi 24 janvier 2019 12:45 *À :* Thanh-Nhan Vo ; user@flink.apache.org *Objet :* Re: [Flink 1.6] How to get current total number of processed events Hi Nhan, You can store the max/min value using the value states of a KeyedProcessFunction, or in the global state of a ProcessWindowFun

Re: [Flink 1.6] How to get current total number of processed events

2019-01-25 Thread Congxian Qiu
:* vendredi 25 janvier 2019 07:30 > *À :* Kien Truong > *Cc :* Thanh-Nhan Vo ; user@flink.apache.org > *Objet :* Re: [Flink 1.6] How to get current total number of processed > events > > > > Hi, Nhan > > Do you want the total number of the current parallelism or the

RE: [Flink 1.6] How to get current total number of processed events

2019-01-25 Thread Thanh-Nhan Vo
: Congxian Qiu [mailto:qcx978132...@gmail.com] Envoyé : vendredi 25 janvier 2019 07:30 À : Kien Truong Cc : Thanh-Nhan Vo ; user@flink.apache.org Objet : Re: [Flink 1.6] How to get current total number of processed events Hi, Nhan Do you want the total number of the current parallelism or the operator

RE: [Flink 1.6] How to get current total number of processed events

2019-01-25 Thread Thanh-Nhan Vo
:45 À : Thanh-Nhan Vo ; user@flink.apache.org Objet : Re: [Flink 1.6] How to get current total number of processed events Hi Nhan, You can store the max/min value using the value states of a KeyedProcessFunction, or in the global state of a ProcessWindowFunction. On processing each item, co

Re: [Flink 1.6] How to get current total number of processed events

2019-01-24 Thread Congxian Qiu
iven key j (denoted > c_j), is there a way to retrieve max{c_j}, min{c_j}? > > Thanks > > > > *De :* Kien Truong [mailto:duckientru...@gmail.com > ] > *Envoyé :* mercredi 23 janvier 2019 16:04 > *À :* user@flink.apache.org > *Objet :* Re: [Flink 1.6] How to get curren

Re: [Flink 1.6] How to get current total number of processed events

2019-01-24 Thread Kien Truong
 :* mercredi 23 janvier 2019 16:04 *À :* user@flink.apache.org *Objet :* Re: [Flink 1.6] How to get current total number of processed events Hi Nhan, Logically, the total number of processed events before an event cannot be accurately calculated unless events processing are synchronized. This is

RE: [Flink 1.6] How to get current total number of processed events

2019-01-23 Thread Thanh-Nhan Vo
:04 À : user@flink.apache.org Objet : Re: [Flink 1.6] How to get current total number of processed events Hi Nhan, Logically, the total number of processed events before an event cannot be accurately calculated unless events processing are synchronized. This is not scalable, so naturally I

Re: [Flink 1.6] How to get current total number of processed events

2019-01-23 Thread Kien Truong
Hi Nhan, Logically, the total number of processed events before an event cannot be accurately calculated unless events processing are synchronized. This is not scalable, so naturally I don't think Flink supports it. Although, I suppose you can get an approximate count by using a non-keyed Tu