Re: RichMapPartitionFunction - problems with collect

2016-04-28 Thread Sergio Ramírez
ssignment. Or simply try to avoid collect, count and print which trigger the eager execution of a Flink job. Cheers, Till ​ On Wed, Apr 13, 2016 at 5:47 PM, Sergio Ramírez wrote: Hello again: Any news about this problem with enriched MapPartition function? Thank you On 06/04/16 17:01, Sergio R

Re: RichMapPartitionFunction - problems with collect

2016-04-13 Thread Sergio Ramírez
Hello again: Any news about this problem with enriched MapPartition function? Thank you On 06/04/16 17:01, Sergio Ramírez wrote: Hello, Ok, please find enclosed the test code and the input data. Cheers On 31/03/16 10:07, Till Rohrmann wrote: Hi Sergio, could you please provide a complete

Re: RichMapPartitionFunction - problems with collect

2016-03-29 Thread Sergio Ramírez
uffering values effectively causes you to store the same value multiple times. can you try disabling objectReuse using env.getConfig().disableObjectReuse() ? On 22.03.2016 16:53, Sergio Ramírez wrote: Hi all, I've been having some problems with RichMapPartitionFunction. Firstly, I trie

RichMapPartitionFunction - problems with collect

2016-03-22 Thread Sergio Ramírez
Hi all, I've been having some problems with RichMapPartitionFunction. Firstly, I tried to convert the iterable into an array unsuccessfully. Then, I have used some buffers to store the values per column. I am trying to transpose the local matrix of LabeledVectors that I have in each partition