Hello, How exactly do you represent the DataSet of DataSets? I'm asking because if you have something like a DataSet<DataSet<A>> that unfortunately doesn't work in Flink.
Best, Gábor 2016-11-14 20:44 GMT+01:00 otherwise777 <wou...@onzichtbaar.net>: > Hey There, > > I'm trying to calculate the betweenness in a graph with Flink and Gelly, the > way I tried this was by calculating the shortest path from every node to the > rest of the nodes. This results in a Dataset of vertices which all have > Datasets of their own with all the other vertices and their paths. > > Next i used the Reduce function on the inner DataSets so every inner DataSet > has 1 value. > > Now I have a DataSet of DataSets with 1 value each, but how do i efficiently > transform this into a a single DataSet with values? I can do a mapping on > the DataSet and use collect(), but i think that would be very costly > > > > > > -- > View this message in context: > http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Retrieving-values-from-a-dataset-of-datasets-tp10108.html > Sent from the Apache Flink User Mailing List archive. mailing list archive at > Nabble.com.
