Re: coGroup exception or something else in Gelly job

2017-06-22 Thread Kaepke, Marc
Hi Greg if you have an idea, I'm still interested. In case you didn't, please give me a feedback too. Best, Marc Sent from my iPhone On 15. Jun 2017, at 15:19, Kaepke, Marc mailto:marc.kae...@haw-hamburg.de>> wrote: Hi Greg, I wanna ask if there was any news about the implementation or oppo

Re: coGroup exception or something else in Gelly job

2017-06-15 Thread Kaepke, Marc
Hi Greg, I wanna ask if there was any news about the implementation or opportunities? Thanks and best regards, Marc Am 12.06.2017 um 19:28 schrieb Kaepke, Marc mailto:marc.kae...@haw-hamburg.de>>: I’m working on an implementation of SemiClustering [1]. I used two graph models (Pregel aka. vert

Re: coGroup exception or something else in Gelly job

2017-06-12 Thread Kaepke, Marc
I’m working on an implementation of SemiClustering [1]. I used two graph models (Pregel aka. vertexcentric iteration and gather scatter). Short description of the algorithm * input is a weighted, undirected graph * output are greedy clusters * Each vertex V maintains a list contain

Re: coGroup exception or something else in Gelly job

2017-06-12 Thread Greg Hogan
I don't think it is possible for anyone to debug your exception without the source code. Storing the adjacency list within the Vertex value is not scalable. Can you share a basic description of the algorithm you are working to implement? On Mon, Jun 12, 2017 at 5:47 AM, Kaepke, Marc wrote: > It

Re: coGroup exception or something else in Gelly job

2017-06-12 Thread Kaepke, Marc
It seems Flink used a different exception graph outside of my IDE (intellij) The job anatomy is: load data from csv and build an initial graph => reduce that graph (remove loops and combine multi edges) => extend the modified graph by a new vertex value => run a gather-scatter iteration I have

Re: coGroup exception or something else in Gelly job

2017-06-09 Thread Greg Hogan
Have you looked at org.apache.flink.gelly.GraphExtension.CustomVertexValue.createInitSemiCluster(CustomVertexValue.java:51)? > On Jun 9, 2017, at 4:53 PM, Kaepke, Marc wrote: > > Hi everyone, > > I don’t have any exceptions if I execute my Gelly job in my IDE (local) > directly. > The next s

coGroup exception or something else in Gelly job

2017-06-09 Thread Kaepke, Marc
Hi everyone, I don’t have any exceptions if I execute my Gelly job in my IDE (local) directly. The next step is an execution with a real kubernetes cluster (1 JobManager and 3 TaskManager on dedicated machines). The word count example is running without exceptions. My Gelly job throws following