Re: Retrieving values from a dataset of datasets

2016-11-16 Thread Gábor Gévay
The short answer is that because DataSet is not serializable. I think the main underlying problem is that Flink needs to see all DataSet operations before launching the job. However, if you have a DataSet>, then operations on the inner DataSets will end up being specified inside the UDFs of operat

Re: Retrieving values from a dataset of datasets

2016-11-15 Thread otherwise777
It seems what i tried did indeed not work. Can you explain me why that doesn't work though? -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Retrieving-values-from-a-dataset-of-datasets-tp10108p10128.html Sent from the Apache Flink User Mailin

Re: Retrieving values from a dataset of datasets

2016-11-15 Thread Gábor Gévay
Hello, How exactly do you represent the DataSet of DataSets? I'm asking because if you have something like a DataSet> that unfortunately doesn't work in Flink. Best, Gábor 2016-11-14 20:44 GMT+01:00 otherwise777 : > Hey There, > > I'm trying to calculate the betweenness in a graph with Flin