Can a master class control the superstep in Flink Spargel ?

2015-02-14 Thread HungChang
Hi, Would it be available to control the supersteps in Flink Spargel? For example, a master controls the basic graph algorithm having 5 phases and the master can switch between the phases. In the given example of Spargel those are send msg and update msg sequentially. Would it be possible to swit

Re: Does Flink use all of the available memory?

2015-02-14 Thread Viktor Rosenfeld
Hi Fabian, thanks for the reply. I increased the TM heap to 20GB (on a 32GB machine) and indeed got a performance boost of more than a minute (about 20%). Cheers, Viktor > Am 14.02.2015 um 14:23 schrieb Fabian Hueske-2 [via Apache Flink (Incubator) > User Mailing List archive.] : > > Hi, > >

Re: Does Flink use all of the available memory?

2015-02-14 Thread Fabian Hueske
Hi, Flink uses only the memory which is configured to the JobManager and TaskManager JVMs. By default this is 256MB for the JM and 512MB for the TM (see [1] for details). The TM memory is split into equally large chunks for each configured slot of the TM. You should definitely configure the TM JV

Does Flink use all of the available memory?

2015-02-14 Thread Viktor Rosenfeld
Hi, does the default configuration of Flink use all of the available memory? I mean the physical memory installed in the computer, not whatever amount of memory the JVM allocates by default. Cheers, Viktor -- View this message in context: http://apache-flink-incubator-user-mailing-list-archiv

Multiple sources shortest path

2015-02-14 Thread HungChang
Hi, In graph api there's an single source shortest path library. DataSet> singleSourceShortestPaths = graph.run(new SingleSourceShortestPaths(srcVertexId, maxIterations)).getVertices(); For Multiple Source, would it be possible to run it for all nodes using for-loop? for example,