Re: RDD.coalesce got compilation error

I see. Thanks Akhil. On Thu, Jul 31, 2014 at 6:08 PM, Akhil Das wrote: > Hi > > According to the documentation > http://spark.apache.org/docs/1.0.0/api/java/index.html it says *coalesce >

Re: RDD.coalesce got compilation error

Hi According to the documentation http://spark.apache.org/docs/1.0.0/api/java/index.html it says *coalesce *(int numPartitions, boolean shuffle, *scala.math.Ordering<**T*

RDD.coalesce got compilation error

In my code I have something like val rdd: (WrapWithComparable[(Array[Byte], Array[Byte], Array[Byte])], Externalizer[KeyValue]) = ... val rdd_coalesced = rdd.coalesce(Math.min(1000, rdd.partitions.length)) My purpose is to limit the number of partitions (later sortByKey always reported "too many