lman , dev
Date: 08/07/2016 17:26
Subject: Re: Spark 2.0.0 performance; potential large Spark core
regression
bq. we turned it off when fixing a bug
Adam:
Can you refer to the bug JIRA ?
Thanks
On Fri, Jul 8, 2016 at 9:22 AM, Adam Roberts wrote:
Thanks Michael, we can give your options
ize: 0
>
> Cheers,
>
>
>
>
> From:Michael Allman
> To:Adam Roberts/UK/IBM@IBMGB
> Cc: dev
> Date: 08/07/2016 17:05
> Subject:Re: Spark 2.0.0 performance; potential large Spark core
> regression
> --
>
WholeStageCodegen: on I think, we turned it off when fixing a bug
offHeap.enabled: false
offHeap.size: 0
Cheers,
From: Michael Allman
To: Adam Roberts/UK/IBM@IBMGB
Cc: dev
Date: 08/07/2016 17:05
Subject:Re: Spark 2.0.0 performance; potential large Spark core
regression
un
>> and prep Spark tests only, driver 8g, executor memory 16g, Kryo, 0.66 memory
>> fraction, 100 trials
>>
>> We can post the 1.6.2 comparison early next week, running lots of iterations
>> over the weekend once we get the dedicated time again
>>
>>
t;
> Cheers,
>
>
>
>
>
> From:Michael Allman
> To:Adam Roberts/UK/IBM@IBMGB
> Cc: dev
> Date: 08/07/2016 16:44
> Subject:Re: Spark 2.0.0 performance; potential large Spark core
> regression
>
>
>
> Hi
/2016 16:44
Subject: Re: Spark 2.0.0 performance; potential large Spark core
regression
Hi Adam,
Do you have your spark confs and your spark-env.sh somewhere where we can
see them? If not, can you make them available?
Cheers,
Michael
On Jul 8, 2016, at 3:17 AM, Adam Roberts wrote
Hi Adam,
Do you have your spark confs and your spark-env.sh somewhere where we can see
them? If not, can you make them available?
Cheers,
Michael
> On Jul 8, 2016, at 3:17 AM, Adam Roberts wrote:
>
> Hi, we've been testing the performance of Spark 2.0 compared to previous
> releases, unfort
