Re: store and retrieve Graph object

2015-11-25 Thread Vasiliki Kalavri
Good to know :) On 25 November 2015 at 21:44, Stefanos Antaris wrote: > Hi, > > It works fine using this approach. > > Thanks, > Stefanos > > On 25 Nov 2015, at 20:32, Vasiliki Kalavri > wrote: > > Hey, > > you can preprocess your data, create the vertices and store them to a > file, like you w

Re: store and retrieve Graph object

2015-11-25 Thread Stefanos Antaris
Hi, It works fine using this approach. Thanks, Stefanos > On 25 Nov 2015, at 20:32, Vasiliki Kalavri wrote: > > Hey, > > you can preprocess your data, create the vertices and store them to a file, > like you would store any other Flink DataSet, e.g. with writeAsText. > > Then, you can crea

Re: store and retrieve Graph object

2015-11-25 Thread Vasiliki Kalavri
Hey, you can preprocess your data, create the vertices and store them to a file, like you would store any other Flink DataSet, e.g. with writeAsText. Then, you can create the graph by reading 2 datasets, like this: DataSet vertices = env.readTextFile("/path/to/vertices/")... // or your custom re

Re: store and retrieve Graph object

2015-11-25 Thread Stefanos Antaris
Hi Vasia, my graph object is the following: Graph graph = Graph.fromCollection(edgeList.collect(), env); The vertex is a POJO not the value. So the problem is how could i store and retrieve the vertex list? Thanks, Stefanos > On 25 Nov 2015, at 18:16, Vasiliki Kalavri wrote: > > Hi Stefa

Re: store and retrieve Graph object

2015-11-25 Thread Vasiliki Kalavri
Hi Stefane, let me know if I understand the problem correctly. The vertex values are POJOs that you're somehow inferring from the edge list and this value creation is what takes a lot of time? Since a graph is just a set of 2 datasets (vertices and edges), you could store the values to disk and ha

store and retrieve Graph object

2015-11-25 Thread Stefanos Antaris
Hi to all, i am working on a project with Gelly and i need to create a graph with billions of nodes. Although i have the edge list, the node in the Graph needs to be a POJO object, the construction of which takes long time in order to finally create the final graph. Is it possible to store the