Re: Removing the Mesos fine-grained mode

2015-11-19 Thread Heller, Chris
I was one that argued for fine-grain mode, and there is something I still appreciate about how fine-grain mode operates in terms of the way one would define a Mesos framework. That said, with dyn-allocation and Mesos support for both resource reservation, oversubscription and revocation, I think

Re: Please reply if you use Mesos fine grained mode

2015-11-04 Thread Heller, Chris
something like Tachyon to achieve in fine grain mode. From: Timothy Chen mailto:tnac...@gmail.com>> Date: Wednesday, November 4, 2015 at 11:05 AM To: "Heller, Chris" mailto:chel...@akamai.com>> Cc: Reynold Xin mailto:r...@databricks.com>>, "dev@spark.apach

Re: Please reply if you use Mesos fine grained mode

2015-11-04 Thread Heller, Chris
We’ve been making use of both. Fine-grain mode makes sense for more ad-hoc work loads, and coarse-grained for more job like loads on a common data set. My preference is the fine-grain mode in all cases, but the overhead associated with its startup and the possibility that an overloaded cluster w

Re: Sidebar: issues targeted for 1.4.0

2015-06-17 Thread Heller, Chris
I appreciate targets having the strong meaning you suggest, as its useful to get a sense of what will realistically be included in a release. Would it make sense (speaking as a relative outsider here) that we would not enter into the RC phase of a release until all JIRA targeting that release wer