Re: Aurora grabbing resources even when not scheduling

2014-05-02 Thread meghdoot bhattacharya
So, to summarize from large cluster perspective the resources are held to complete some expensive operations and avoid doing it frequently that also blocks the callback thread. That brings an interesting point. Is there any out of box instrumentation on the scheduler performance that one can sim

Re: Aurora grabbing resources even when not scheduling

2014-04-30 Thread Bill Farner
Aurora holds offers for a few reasons: - To avoid blocking the mesos driver callback thread while matching offers to pending tasks - To enable preemption (determine whether cluster resources are exhausted, and a low priority task should be evicted for a high priority one) - To perform optimize sche