Re: Tungsten Memory Consumer

2019-02-12 Thread Jack Kolokasis
Hello,     I am sorry about my first explanation, was not concrete. Well I will explain further about TaskMemoryManager. TaskMemoryManager manages the execution memory of each task application as follow:     1. MemoryConsumer is the entry for the Spark task to run. MemoryConsumer requests ex

Re: Tungsten Memory Consumer

2019-02-11 Thread Wenchen Fan
what do you mean by ''Tungsten Consumer"? On Fri, Feb 8, 2019 at 6:11 PM Jack Kolokasis wrote: > Hello all, > I am studying about Tungsten Project and I am wondering when Spark > creates a Tungsten consumer. While I am running some applications, I see > that Spark creates Tungsten Consumer

Tungsten Memory Consumer

2019-02-08 Thread Jack Kolokasis
Hello all,     I am studying about Tungsten Project and I am wondering when Spark creates a Tungsten consumer. While I am running some applications, I see that Spark creates Tungsten Consumer while in other applications not (using the same configuration). When does this happens ? I am looking