Alternative to camus

I was wondering if anybody has already tried to mirror a kafka topic to hdfs just copying the log files from the topic directory of the broker (like 23244237.log). The file format is very simple : https://twitter.com/amiorin/status/576448691139121152/photo/1 Implementing an InputForma

Re: Alternative to camus

Otis > -- > Monitoring * Alerting * Anomaly Detection * Centralized Log Management > Solr & Elasticsearch Support * http://sematext.com/ > > > On Fri, Mar 13, 2015 at 2:33 PM, Alberto Miorin > > wrote: > > > I was wondering if anybody has already tried to mirror a kafka

Re: Alternative to camus

to stream data out > of Kafka and into HDFS: > http://blog.cloudera.com/blog/2014/11/flafka-apache-flume-meets-apache-kafka-for-event-processing/ > > -Will > > On Fri, Mar 13, 2015 at 2:33 PM, Alberto Miorin > wrote: > >> I was wondering if anybody has already tried to mi

Re: Alternative to camus

system in Spark. > > On Fri, Mar 13, 2015 at 12:15 PM, Alberto Miorin > wrote: > > We use spark on mesos. I don't want to partition our cluster because of > one > > YARN job (camus). > > > > Best > > > > Alberto > > > >

Re: Alternative to camus

g.html > > -Will > > On Fri, Mar 13, 2015 at 3:28 PM, Alberto Miorin > wrote: > >> I'll try this too. It looks very promising. >> >> Thx >> >> On Fri, Mar 13, 2015 at 8:25 PM, Gwen Shapira >> wrote: >> >> > There's a K

Re: Alternative to camus

to use and set up. I’d be nice if it worked well. > > > > > > On Mar 13, 2015, at 15:38, Alberto Miorin > wrote: > > > > We are currently using spark streaming 1.2.1 with kafka and write-ahead > log. > > I will only say one thing : "a nightmare"