Problem with writeAsText

2016-05-01 Thread Punit Naik
I have a Dataset which contains only strings. But when I execute a writeAsText and supply a folder inside the string, it finishes with the following output but does not write any text files: org.apache.flink.api.java.operators.DataSink[String] = DataSink '' (TextOutputFormat (file://path/to/output

Re: Unable to write stream as csv

2016-05-01 Thread subash basnet
Hello there, If anyone could help me know why the below *result* DataStream get's written as text, but not as csv?. As it's in a tuple format I guess it should be the same for both text and csv. It shows no error just simply doesn't write to file when result is written as csv. DataStream> *result

Re: Count of Grouped DataSet

2016-05-01 Thread nsengupta
Hello all, This is how I have moved ahead with the implementation of finding count of a GroupedDataSet: *val k = envDefault .fromElements((1,1,2,"A"),(1,1,2,"B"),(2,1,3,"B"),(3,1,4,"C")) .groupBy(1,2) .reduceGroup(nextGroup => { val asList = nextGroup.toList