Re: FLink Streaming - Parallelize ArrayList

2015-09-29 Thread defstat
Is there any way to "broadcast" the internal list so that all processing nodes "Know" the list, and use it either inside the connect function or in a fold operation? -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/FLink-Streaming-Parallelize-

Re: FLink Streaming - Parallelize ArrayList

2015-09-29 Thread defstat
Will that keep a global list for all execution environment? -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/FLink-Streaming-Parallelize-ArrayList-tp2957p2959.html Sent from the Apache Flink User Mailing List archive. mailing list archive at

FLink Streaming - Parallelize ArrayList

2015-09-28 Thread defstat
Hi all, Is there a way to either Broadcast or Parallelize an ArrayList of custom objects? The application is as follows: I have 2 streams taken from two sockets. The first stream contains vectors that should populate one list of vectors by deciding whether an arriving vector is part of the lis

Statefull computation

2015-08-23 Thread defstat
Hi. I am struggling the past few days to find a solution on the following problem, using Apache Flink: I have a stream of vectors, represented by files in a local folder. After a new text file is located using DataStream text = env.readFileStream(...), I transform (flatMap), the Input into a Sing