These are quite different operations. One operates on RDDs in DStream and one operates on partitions of an RDD. They are not alternatives.
On Wed, Jul 8, 2015, 2:43 PM dgoldenberg <dgoldenberg...@gmail.com> wrote: > Is there a set of best practices for when to use foreachPartition vs. > foreachRDD? > > Is it generally true that using foreachPartition avoids some of the > over-network data shuffling overhead? > > When would I definitely want to use one method vs. the other? > > Thanks. > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/foreachRDD-vs-forearchPartition-tp23714.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > >
