Thanks Sandy et al, I will try that. I like that I can choose the
minRegisteredResourcesRatio.
On Wed, Jun 24, 2015 at 11:04 AM, Sandy Ryza
wrote:
> Hi Arun,
>
> You can achieve this by
> setting spark.scheduler.maxRegisteredResourcesWaitingTime to some really
> high number and spark.scheduler.m
Hi Arun,
You can achieve this by
setting spark.scheduler.maxRegisteredResourcesWaitingTime to some really
high number and spark.scheduler.minRegisteredResourcesRatio to 1.0.
-Sandy
On Wed, Jun 24, 2015 at 2:21 AM, Steve Loughran
wrote:
>
> On 24 Jun 2015, at 05:55, canan chen wrote:
>
> Why
On 24 Jun 2015, at 05:55, canan chen
mailto:ccn...@gmail.com>> wrote:
Why do you want it start until all the resources are ready ? Make it start as
early as possible should make it complete earlier and increase the utilization
of resources
On Tue, Jun 23, 2015 at 10:34 PM, Arun Luthra
mailto
Why do you want it start until all the resources are ready ? Make it start
as early as possible should make it complete earlier and increase the
utilization of resources
On Tue, Jun 23, 2015 at 10:34 PM, Arun Luthra wrote:
> Sometimes if my Hortonworks yarn-enabled cluster is fairly busy, Spark
