Camus uses MapReduce though. If Alberto uses Spark exclusively, I can see why installing MapReduce cluster (with or without YARN) is not a desirable solution.
On Fri, Mar 13, 2015 at 1:06 PM, Thunder Stumpges <tstump...@ntent.com> wrote: > Sorry to go back in time on this thread, but Camus does NOT use YARN. We have > been using camus for a while on our CDH4 (no YARN) Hadoop cluster. It really > is fairly easy to set up, and seems to be quite good so far. > > -Thunder > > > -----Original Message----- > From: amiori...@gmail.com [mailto:amiori...@gmail.com] On Behalf Of Alberto > Miorin > Sent: Friday, March 13, 2015 12:15 PM > To: users@kafka.apache.org > Cc: otis.gospodne...@gmail.com > Subject: Re: Alternative to camus > > We use spark on mesos. I don't want to partition our cluster because of one > YARN job (camus). > > Best > > Alberto > > On Fri, Mar 13, 2015 at 7:43 PM, Otis Gospodnetic < > otis.gospodne...@gmail.com> wrote: > >> Just curious - why - is Camus not suitable/working? >> >> Thanks, >> Otis >> -- >> Monitoring * Alerting * Anomaly Detection * Centralized Log Management >> Solr & Elasticsearch Support * http://sematext.com/ >> >> >> On Fri, Mar 13, 2015 at 2:33 PM, Alberto Miorin >> <amiorin78+ka...@gmail.com >> > >> wrote: >> >> > I was wondering if anybody has already tried to mirror a kafka topic >> > to hdfs just copying the log files from the topic directory of the >> > broker (like 00000000000023244237.log). >> > >> > The file format is very simple : >> > https://twitter.com/amiorin/status/576448691139121152/photo/1 >> > >> > Implementing an InputFormat should not be so difficult. >> > >> > Any drawbacks? >> > >>
