The original PR from Liye didn't include test which exercises Kryo buffer
size configured in mb which is below 2GB.
In my PR, I added such a test and it passed on Jenkins:
https://github.com/apache/spark/pull/6390
FYI
On Sun, May 24, 2015 at 8:08 AM, Ted Yu wrote:
> Please update to the follow
Please update to the following:
commit c2f0821aad3b82dcd327e914c9b297e92526649d
Author: Zhang, Liye
Date: Fri May 8 09:10:58 2015 +0100
[SPARK-7392] [CORE] bugfix: Kryo buffer size cannot be larger than 2M
On Sun, May 24, 2015 at 8:04 AM, Debasish Das
wrote:
> I am May 3rd commit:
>
> c
I am May 3rd commit:
commit 49549d5a1a867c3ba25f5e4aec351d4102444bc0
Author: WangTaoTheTonic
Date: Sun May 3 00:47:47 2015 +0100
[SPARK-7031] [THRIFTSERVER] let thrift server take SPARK_DAEMON_MEMORY
and SPARK_DAEMON_JAVA_OPTS
On Sat, May 23, 2015 at 7:54 PM, Josh Rosen wrote:
> Whic
Ah right I misread this. I get it but I dont think the PR fixes this. Let
me comment there.
On May 24, 2015 3:56 PM, "Sean Owen" wrote:
> Wait, isn't the error message just saying you can't set 8mb buffers? So it
> is correctly parsing the args. I don't understand why this has to do with
> parsin
Wait, isn't the error message just saying you can't set 8mb buffers? So it
is correctly parsing the args. I don't understand why this has to do with
parsing the value. That much works.
On May 24, 2015 2:04 AM, "Debasish Das" wrote:
> Hi,
>
> I am on last week's master but all the examples that se
Which commit of master are you building off? It looks like there was a
bugfix for an issue related to KryoSerializer buffer configuration:
https://github.com/apache/spark/pull/5934
That patch was committed two weeks ago, but you mentioned that you're
building off a newer version of master. Could
Pardon me.
Please use '8192k'
Cheers
On Sat, May 23, 2015 at 6:24 PM, Debasish Das
wrote:
> Tried "8mb"...still I am failing on the same error...
>
> On Sat, May 23, 2015 at 6:10 PM, Ted Yu wrote:
>
>> bq. it shuld be "8mb"
>>
>> Please use the above syntax.
>>
>> Cheers
>>
>> On Sat, May 23,
Tried "8mb"...still I am failing on the same error...
On Sat, May 23, 2015 at 6:10 PM, Ted Yu wrote:
> bq. it shuld be "8mb"
>
> Please use the above syntax.
>
> Cheers
>
> On Sat, May 23, 2015 at 6:04 PM, Debasish Das
> wrote:
>
>> Hi,
>>
>> I am on last week's master but all the examples that
bq. it shuld be "8mb"
Please use the above syntax.
Cheers
On Sat, May 23, 2015 at 6:04 PM, Debasish Das
wrote:
> Hi,
>
> I am on last week's master but all the examples that set up the following
>
> .set("spark.kryoserializer.buffer", "8m")
>
> are failing with the following error:
>
> Excepti
Hi,
I am on last week's master but all the examples that set up the following
.set("spark.kryoserializer.buffer", "8m")
are failing with the following error:
Exception in thread "main" java.lang.IllegalArgumentException:
spark.kryoserializer.buffer must be less than 2048 mb, got: + 8192 mb.
loo
10 matches
Mail list logo
