Re: reduce error

2015-10-16 Thread Ufuk Celebi
Hey Michele! Sorry for the long delay on this. Can you share the code and data? The easiest thing to reproduce is to actually run the code with the data. It will also help a lot when trying to fix the problem. If you can't share publicly feel free to mail me at uce at apache org. – Ufuk On Thu, O

Session Based Windows

2015-10-16 Thread Hamilton, Paul
Hi, I am attempting to make use of the new window APIs in streaming to implement a session based window and am not sure if the currently provided functionality handles my use case. Specifically what I want to do is something conceptually similar to a ³Sessions.withGapDuration(Š)² window in Google

Re: Scala Code Generation

2015-10-16 Thread schultze
Thanks a lot for the help. I was able to apply the Tuple1 functionality to fix my problem. I also moved up to Flink 0.9. However I have another problem executing generated Scala programs. It seems like a Scala program executed with a Flink 0.9 Job Manager only has a limited amount of usable opera

Re: Apache Flink and serious streaming stateful processing

2015-10-16 Thread Stephan Ewen
Hi! As Gyula mentioned an upcoming Pull Request will make the state backend pluggable. We would like to add the following state holders into Flink: (1) Small state in memory (local execution / debugging) : State maintained in a heap hash map, checkpoints to JobManager. This is in there now. (2)