Re: save spark streaming output to single file on hdfs

2015-01-15 Thread jamborta
thanks for the replies. very useful. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/save-spark-streaming-output-to-single-file-on-hdfs-tp21124p21176.html Sent from the Apache Spark User List mailing list archive at Nabble.com

Re: save spark streaming output to single file on hdfs

2015-01-15 Thread Prannoy
scussion > below: > > http://apache-spark-user-list.1001560.n3.nabble.com/save-spark-streaming-output-to-single-file-on-hdfs-tp21124.html > To start a new topic under Apache Spark User List, email > ml-node+s1001560n1...@n3.nabble.com > To unsubscribe from Apache Spark User List, click here

Re: save spark streaming output to single file on hdfs

2015-01-13 Thread Davies Liu
AsTextFiles method. >> > >> > I'm using spark 1.2 with pyspark >> > >> > thanks, >> > >> > >> > >> > >> > >> > >> >

Re: save spark streaming output to single file on hdfs

2015-01-13 Thread Tamas Jambor
> saveAsTextFiles method. > > > > I'm using spark 1.2 with pyspark > > > > thanks, > > > > > > > > > > > > > > > > -- > > View this message in context: http://apache-spark-user-list. > 1001560.

Re: save spark streaming output to single file on hdfs

2015-01-13 Thread Davies Liu
ion multiple RDDs into single one. > It seems that each slice is saved to a separate folder, using > saveAsTextFiles method. > > I'm using spark 1.2 with pyspark > > thanks, > > > > > > > > -- > View this message in context: > http://apache-spark

save spark streaming output to single file on hdfs

2015-01-13 Thread jamborta
http://apache-spark-user-list.1001560.n3.nabble.com/save-spark-streaming-output-to-single-file-on-hdfs-tp21124.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-uns