Hey Brian, Lets say I have X machines that have been set aside that have a "characteristic" for running Apache Kafka.
The hardware can do a lot more than I need/want for Kafka but is within the "pool" of elasticity (so not every server but a good chunk of them (including not production)) So, I set one of these slaves like this. --resources="cpus(kafka):16; cpus(*):16; mem(kafka):48000; mem(*):248000; disk(kafka):7105340; disk(kafka):1105340; This gets around the problem of a Kafka broker going down and knowing we have resources to be able to restore the broker to that machine ( with the same broker.id and read the data that was there (like after the server crashes and comes back up)). We could make sure that we keep running brokers on Kafka deemed servers while also allowing other stuff to run on it too. /******************************************* Joe Stein Founder, Principal Consultant Big Data Open Source Security LLC http://www.stealth.ly Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop> ********************************************/ On Tue, Sep 23, 2014 at 8:31 PM, Brian Wickman <wick...@twopensource.com> wrote: > They are unrelated. That is not to say they shouldn't be supported. Any > particular use-cases that come to mind? > > On Tue, Sep 23, 2014 at 3:44 PM, Joe Stein <joe.st...@stealth.ly> wrote: > > > Hi, I was looking at resource role allocation (slave configuration > > --resource) and was wondering how this relates to Aurora and if the role > > there on the slave is the same as Aurora's role in the job key? > > > > e.g. > > > > --resources="cpus(prod):8; cpus(stage):2 mem(*):15360; disk(*):710534; > > ports(*):[31000-32000]" > > > > and > > > > cluster1/tyg/prod/workhorse > > > > I ask because the Aurora role is user but the slave role seems to be more > > like what the environment namespace components in Aurora is for? > Something > > else? > > > > Thanks! > > > > /******************************************* > > Joe Stein > > Founder, Principal Consultant > > Big Data Open Source Security LLC > > http://www.stealth.ly > > Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop> > > ********************************************/ > > >
