Re: Trying to get kafka data to Hadoop

2015-03-04 Thread Neha Narkhede
> > From: max square [max2subscr...@gmail.com] > > Received: Wednesday, 04 Mar 2015, 5:38PM > > To: users@kafka.apache.org [users@kafka.apache.org] > > Subject: Trying to get kafka data to Hadoop > > > > Hi all, > > > > I have browsed through differe

Re: Trying to get kafka data to Hadoop

2015-03-04 Thread max square
, 5:38PM > To: users@kafka.apache.org [users@kafka.apache.org] > Subject: Trying to get kafka data to Hadoop > > Hi all, > > I have browsed through different conversations around Camus, and bring this > as a kinda Kafka question. I know is not the most orthodox, but if someone >

RE: Trying to get kafka data to Hadoop

2015-03-04 Thread Thunder Stumpges
-Original Message- From: max square [max2subscr...@gmail.com] Received: Wednesday, 04 Mar 2015, 5:38PM To: users@kafka.apache.org [users@kafka.apache.org] Subject: Trying to get kafka data to Hadoop Hi all, I have browsed through different conversations around Camus, and bring this as a kinda

Re: Trying to get kafka data to Hadoop

2015-03-04 Thread Lakshmanan Muthuraman
I think the libjars is not required. Maven package command for the camus project, builds the uber jar(fat jar) which contains all the dependencies in it. I generally run camus the following way. hadoop jar camus-example-0.1.0-SNAPSHOT-shaded.jar com.linkedin.camus.etl.kafka.CamusJob -P camus.prope

Re: Trying to get kafka data to Hadoop

2015-03-04 Thread Jagat Singh
Also see the related tool http://confluent.io/downloads/ Confluent is bringing the glue together for Kafta , Avro , Camus Though there is no clarity around support (e.g update of Kafta) around it at this moment. On Thu, Mar 5, 2015 at 8:57 AM, Joel Koshy wrote: > I think the camus mailing l

Re: Trying to get kafka data to Hadoop

2015-03-04 Thread Joel Koshy
I think the camus mailing list would be more suitable for this question. Thanks, Joel On Wed, Mar 04, 2015 at 11:00:51AM -0500, max square wrote: > Hi all, > > I have browsed through different conversations around Camus, and bring this > as a kinda Kafka question. I know is not the most orthodo

Trying to get kafka data to Hadoop

2015-03-04 Thread max square
Hi all, I have browsed through different conversations around Camus, and bring this as a kinda Kafka question. I know is not the most orthodox, but if someone has some thoughts I'd appreciate ir. That said, I am trying to set up Camus, using a 3 node Kafka cluster 0.8.2.1, using a project that is