Re: FoldFunction accumulator checkpointing

2018-09-02 Thread Hequn Cheng
Hi Marzieh, Have you ever imported `org.apache.flink.api.java.tuple.Tuple2`? It seems that you imported the wrong class. You can copy the code from here[1]. Best, Hequn [1] https://ci.apache.org/projects/flink/flink-docs-master/tutorials/datastream_api.html On Sun, Sep 2, 2018 at 1:56 PM Mar_z

Re: FoldFunction accumulator checkpointing

2018-09-01 Thread Mar_zieh
Hello I wrote example of "Monitoring the Wikipedia Edit Stream" in Intellij Idea, but I got errors on "acc.f0 , acc.f1" which was like this: Error:(39, 28) java: cannot find symbol symbol: variable f0 location: variable acc of type scala.Tuple2 Would you please tell me how to solve this pr

Re: FoldFunction accumulator checkpointing

2016-04-22 Thread Aljoscha Krettek
Hi Ron, I see that this leads to a bit of a hassle for you. I'm very reluctant to allow the general RichFunction interface in functions that are used inside state because this has quite some implications. Maybe we can add a simplified interface just for functions that are used inside state to allow

Re: FoldFunction accumulator checkpointing

2016-04-19 Thread Ron Crocker
Aljoscha - I want to use a RichFoldFunction to get the open() hook. I cheat and use this structure instead with a (non-Rich) FoldFunction: public class InfinitResponseFilterFolder implements FoldFunction, String> { private BackingStore backingStore; @Override public String fold(Infini

Re: FoldFunction accumulator checkpointing

2016-04-13 Thread Aljoscha Krettek
Hi, there are two cases where a FoldFunction can be used in the streaming API: KeyedStream.fold() and WindowedStream.fold()/apply(). In both cases we internally use the partitioned state abstraction of Flink to keep the state. So yes, the accumulator value is consistently maintained and will surviv

FoldFunction accumulator checkpointing

2016-04-12 Thread Michael Radford
I'm wondering whether the accumulator value maintained by a FoldFunction is automatically checkpointed? In general, but specifically when using the WindowedStream.apply variant that takes a FoldFunction: public DataStream apply(R initialValue, FoldFunction foldFunction,