Re: /newbie/ Share state between streams

2016-06-04 Thread Andrey Utkin
Hi Jamie, Your answer was very helpful. Thanks a lot. -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/newbie-Share-state-between-streams-tp7368p7380.html Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.

Re: env.fromElements produces TypeInformation error

2016-06-04 Thread Dan Drewes
I've tested it, but unfortunately it does not solve the problem. The error message remains the same. Am 04.06.2016 um 19:38 schrieb Simone Robutti: I'm not sure if this is the solution and I don't have the possibility to try right now, but you should move the case class "State" definition outsid

Re: env.fromElements produces TypeInformation error

2016-06-04 Thread Simone Robutti
I'm not sure if this is the solution and I don't have the possibility to try right now, but you should move the case class "State" definition outside the abstract class. 2016-06-04 17:34 GMT+02:00 Dan Drewes : > > Hi, > > compiling the code: > > def minimize(f: DF, init: T): T = { > > //create

env.fromElements produces TypeInformation error

2016-06-04 Thread Dan Drewes
Hi, compiling the code: def minimize(f:DF, init:T):T = { //create execution environment val env = ExecutionEnvironment.getExecutionEnvironment valinitialstate =initialState(f, init) val iterativestate= env.fromElements(initialstate).iterate(1) { iterationInput: DataSet[State] =>

Re: Event processing time with lateness

2016-06-04 Thread Aljoscha Krettek
Hi Igor, you might be interested in this doc about how we want to improve handling of late data and some other things in the windowing API: https://docs.google.com/document/d/1Xp-YBf87vLTduYSivgqWVEMjYUmkA-hyb4muX3KRl08/edit?usp=sharing I've sent it around several times but you can never know who'

Re: Maintaining watermarks per key, instead of per operator instance

2016-06-04 Thread Aljoscha Krettek
Hi, I think you first have to convert back to a DataStream using .select() or .flatSelect(). But Till should know more about this, maybe he can help. Cheers, Aljoscha On Thu, 2 Jun 2016 at 19:19 Kanstantsin Kamkou wrote: > Hi Aljoscha! Is it possible somehow to use the RichXFunction in CEP? > T

Re: Why would slot sharing be undesirable?

2016-06-04 Thread Márton Balassi
Hi Leon, Basically you are trading away utilizing all of your resources in the cluster to cut network IO. With putting more and more tasks into the same slot you are pushing a job from being potentially network bound to usually CPU bound, as the parallel instances of tasks in the same slot sharing

Why would slot sharing be undesirable?

2016-06-04 Thread leon_mclare
Hi, i am deploying a 5 stage pipeline, with varying DOPs for experimental purposes. The benefits of slot sharing are clear. What is unclear to me is when slot sharing would be undesirable. Since slot sharing enables bypassing of additional buffers (buffers between slots) as well as memory base