Re: Incorrect results with reduceByKey

2015-11-18 Thread tovbinm
for pointing that out. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Incorrect-results-with-reduceByKey-tp25410p25420.html Sent from the Apache Spark User List mailing list archive at Nabble.

Re: Incorrect results with reduceByKey

2015-11-17 Thread Igor Berman
partitioner we get everything as expected > val good: RDD[(String,List[T])] = data.map(r => (r.id, > List(r))).partitionBy(Partitioner.defaultPartitioner(data)).reduceByKey(_ > ++ > _) > > > Any ideas? > > Thanks in advance > > > > -- > View this

Incorrect results with reduceByKey

2015-11-17 Thread tovbinm
ta)).reduceByKey(_ ++ _) Any ideas? Thanks in advance -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Incorrect-results-with-reduceByKey-tp25410.html Sent from the Apache Spark User List mailing list archi