Re: Finding previous and next element in a sorted RDD

2014-08-23 Thread Victor Tso-Guillen
on could > know > its "neighbors". > > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Finding-previous-and-next-element-in-a-sorted-RDD-tp12621p12664.html > Sent from the Apache Sp

Re: Finding previous and next element in a sorted RDD

2014-08-22 Thread cjwang
It would be nice if an RDD that was massaged by OrderedRDDFunction could know its "neighbors". -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Finding-previous-and-next-element-in-a-sorted-RDD-tp12621p12664.html Sent from the Apache Spark User Li

Re: Finding previous and next element in a sorted RDD

2014-08-21 Thread Evan Chan
._2-1, x._1)) > > val joined = current leftOuterJoin previous leftOuterJoin next > > Code looks clean to me, but I feel uneasy about the performance of join. > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Finding-previous

Re: Finding previous and next element in a sorted RDD

2014-08-21 Thread cjwang
l next = idx.map(x => (x._2-1, x._1)) val joined = current leftOuterJoin previous leftOuterJoin next Code looks clean to me, but I feel uneasy about the performance of join. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Finding-previous-and-next-ele

Finding previous and next element in a sorted RDD

2014-08-21 Thread cjwang
ious-and-next-element-in-a-sorted-RDD-tp12621.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org