Re: Reliance on java.math.BigInteger implementation

That would be me then ;-) I'm working on a patch. Cheers, On 14 August 2015 at 23:43, Reynold Xin wrote: > I pinged the IBM team to submit a patch that would work on IBM JVM. > > > On Fri, Aug 14, 2015 at 11:27 AM, Pete Robbins > wrote: > >> ref: https://issues.apache.org/jira/browse/SPARK-93

Re: Switch from Sort based to Hash based shuffle

Thanks guys, that did it. On Thu, Aug 13, 2015 at 6:49 PM, Akhil Das wrote: > Have a look at spark.shuffle.manager, You can switch between sort and hash > with this configuration. > > spark.shuffle.managersortImplementation to use for shuffling data. There > are two implementations available:sor