gt;
>
> From: Evo Eftimov [mailto:evo.efti...@isecc.com]
> Sent: Wednesday, July 8, 2015 1:26 PM
> To: 'Aniruddh Sharma'; 'user@spark.apache.org'
> Subject: RE: Out of Memory Errors on less number of cores in proportion to
> Partitions in Data
>
>
>
&g
: 'Aniruddh Sharma'; 'user@spark.apache.org'
Subject: RE: Out of Memory Errors on less number of cores in proportion to
Partitions in Data
Are you sure you have actually increased the RAM (how exactly did you do that
and does it show in Spark UI)
Also use the SPARK UI an
RAM (20 partitions x fixed RAM buffer) < Total RAM (100
partitions x fixed RAM buffer)
From: Aniruddh Sharma [mailto:asharma...@gmail.com]
Sent: Wednesday, July 8, 2015 12:22 PM
To: user@spark.apache.org
Subject: Out of Memory Errors on less number of cores in proportion to
Partitions in D
ors on less number of cores in proportion to
Partitions in Data
Hi,
I am new to Spark. I have done following tests and I am confused in
conclusions. I have 2 queries.
Following is the detail of test
Test 1) Used 11 Node Cluster where each machine has 64 GB RAM and 4 physical
cores. I ran a
Hi,
I am new to Spark. I have done following tests and I am confused in
conclusions. I have 2 queries.
Following is the detail of test
Test 1) Used 11 Node Cluster where each machine has 64 GB RAM and 4
physical cores. I ran a ALS algorithm using MilLib on 1.6 GB data set. I
ran 10 executors and
