Well, it is quite important the off-heap setting and now I am curios about
other parameters, I hope everything else is well documented or not missleading.
Best,
Ovidiu
> On 12 Feb 2016, at 19:18, Sean Owen wrote:
>
> I don't think much more is said since in fact it would affect parts of
> the i
ect: Re: off-heap certain operations
I don't think much more is said since in fact it would affect parts of
the implementations of lots of operations -- anything touching
Tungsten. It wouldn't be meaningful to try to list everything.
The difference is allocating memory on the
I don't think much more is said since in fact it would affect parts of
the implementations of lots of operations -- anything touching
Tungsten. It wouldn't be meaningful to try to list everything.
The difference is allocating memory on the heap or with
sun.misc.Unsafe. This is definitely something
I found nothing about the certain operations. Still not clear, certain is poor
documentation. Can someone give an answer so I can consider using this new
release?
spark.memory.offHeap.enabled
If true, Spark will attempt to use off-heap memory for certain operations.
> On 12 Feb 2016, at 13:21,
Ovidiu-Cristian:
Please see the following JIRA / PR :
[SPARK-12251] Document and improve off-heap memory configurations
Cheers
On Thu, Feb 11, 2016 at 11:06 PM, Sea <261810...@qq.com> wrote:
> spark.memory.offHeap.enabled (default is false) , it is wrong in spark
> docs. Spark1.6 do not recommen
