Re: Flink Iterations vs. While loop

2016-09-06 Thread Dan Drewes
orkers. If you have the full code available somewhere we might be able to help better. For L-BFGS you should only be broadcasting the model (i.e. the weight vector), and yes that would happen at each iteration, since you are updating the model at each iteration. On Fri, Sep 2, 2016 at 5:30 PM,

Re: Flink Iterations vs. While loop

2016-09-02 Thread Dan Drewes
on have support for object reuse with arrays (FLINK-3695). This would be implemented as DoubleValueArray or ValueArray rather than double[] but it would be interesting to test for a change in performance. Greg On Fri, Sep 2, 2016 at 6:16 AM, Dan Drewes <mailto:dre...@campus.tu-berlin.de>

Re: env.fromElements produces TypeInformation error

2016-06-04 Thread Dan Drewes
ot;State" definition outside the abstract class. 2016-06-04 17:34 GMT+02:00 Dan Drewes mailto:dre...@campus.tu-berlin.de>>: Hi, compiling the code: def minimize(f:DF, init:T):T = { //create execution environment val env = ExecutionEnvironment.getExecutionEnvi

env.fromElements produces TypeInformation error

2016-06-04 Thread Dan Drewes
Hi, compiling the code: def minimize(f:DF, init:T):T = { //create execution environment val env = ExecutionEnvironment.getExecutionEnvironment valinitialstate =initialState(f, init) val iterativestate= env.fromElements(initialstate).iterate(1) { iterationInput: DataSet[State] =>