Re: Broadcasted Variable not updated in a Iterative Data Set

2015-05-12 Thread Stephan Ewen
Happy to hear that it works! On Wed, May 13, 2015 at 12:42 AM, Ventura Del Monte < venturadelmo...@gmail.com> wrote: > Thank you for your clarification. At the end I figured out, it was a silly > programming error, now it just works fine. Thank you again for your > explanation. > > > 2015-05-11 2

Re: Broadcasted Variable not updated in a Iterative Data Set

2015-05-12 Thread Ventura Del Monte
Thank you for your clarification. At the end I figured out, it was a silly programming error, now it just works fine. Thank you again for your explanation. 2015-05-11 22:31 GMT+02:00 Stephan Ewen : > Can you share the respective part of the code, then we can have a look? > > In general, a DataSe

Re: Broadcasted Variable not updated in a Iterative Data Set

2015-05-11 Thread Stephan Ewen
Can you share the respective part of the code, then we can have a look? In general, a DataSet is re-broadcasted in each iteration, if it depends on the IterativeDataSet. You have to re-grab it from the RuntimeContext in each superstep. If you call getBroadcastSet() in the open() method, then it wi

Broadcasted Variable not updated in a Iterative Data Set

2015-05-11 Thread Ventura Del Monte
Hello, I am writing a Flink application whose purpose is to train neural networks. I have implemented a version of SDG based on mini batches using the IterativeDataSet class. In a nutshell, my code groups the input features in a set called mini batch (i have as many mini batches as the parallelism