Hm, aren't you able to use the SparkContext here? DStream operations happen on the driver. So you can parallelize() the result?
take() won't work as it's not the same as top() On Fri, Mar 13, 2015 at 11:23 AM, Akhil Das <ak...@sigmoidanalytics.com> wrote: > Like this? > > dtream.repartition(1).mapPartitions(it => it.take(5)) > > > > Thanks > Best Regards > > On Fri, Mar 13, 2015 at 4:11 PM, Laeeq Ahmed <laeeqsp...@yahoo.com.invalid> > wrote: >> >> Hi, >> >> I normally use dstream.transform whenever I need to use methods which are >> available in RDD API but not in streaming API. e.g. dstream.transform(x => >> x.sortByKey(true)) >> >> But there are other RDD methods which return types other than RDD. e.g. >> dstream.transform(x => x.top(5)) top here returns Array. >> >> In the second scenario, how can i return RDD rather than array, so that i >> can perform further steps on dstream. >> >> Regards, >> Laeeq > > --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
