Cc: user; Spark dev list
Subject: Re: Spark Scheduler creating Straggler Node
I don't just want to replicate all Cached Blocks. I am trying to find a way to
solve the issue which i mentioned above mail. Having replicas for all cached
blocks will add more cost to customers.
On Wed, Mar 9,
: user; Spark dev list
Subject: Re: Spark Scheduler creating Straggler Node
You just want to be able to replicate hot cached blocks right?
On Tuesday, March 8, 2016, Prabhu Joseph
mailto:prabhujose.ga...@gmail.com>> wrote:
Hi All,
When a Spark Job is running, and one of the Spark Execu
I don't just want to replicate all Cached Blocks. I am trying to find a way
to solve the issue which i mentioned above mail. Having replicas for all
cached blocks will add more cost to customers.
On Wed, Mar 9, 2016 at 9:50 AM, Reynold Xin wrote:
> You just want to be able to replicate hot cac
You just want to be able to replicate hot cached blocks right?
On Tuesday, March 8, 2016, Prabhu Joseph wrote:
> Hi All,
>
> When a Spark Job is running, and one of the Spark Executor on Node A
> has some partitions cached. Later for some other stage, Scheduler tries to
> assign a task to No
Hi All,
When a Spark Job is running, and one of the Spark Executor on Node A
has some partitions cached. Later for some other stage, Scheduler tries to
assign a task to Node A to process a cached partition (PROCESS_LOCAL). But
meanwhile the Node A is occupied with some other
tasks and got busy
