Re: How to do nested foreach with RDD

2015-03-22 Thread Xi Shen
Hi Reza, Yes, I just found RDD.cartesian(). Very useful. Thanks, David On Sun, Mar 22, 2015 at 5:08 PM Reza Zadeh wrote: > You can do this with the 'cartesian' product method on RDD. For example: > > val rdd1 = ... > val rdd2 = ... > > val combinations = rdd1.cartesian(rdd2).filter{ case (a,b

Re: How to do nested foreach with RDD

2015-03-21 Thread Reza Zadeh
You can do this with the 'cartesian' product method on RDD. For example: val rdd1 = ... val rdd2 = ... val combinations = rdd1.cartesian(rdd2).filter{ case (a,b) => a < b } Reza On Sat, Mar 21, 2015 at 10:37 PM, Xi Shen wrote: > Hi, > > I have two big RDD, and I need to do some math against e