Trying to get kafka data to Hadoop

2015-03-04 Thread max square
Hi all, I have browsed through different conversations around Camus, and bring this as a kinda Kafka question. I know is not the most orthodox, but if someone has some thoughts I'd appreciate ir. That said, I am trying to set up Camus, using a 3 node Kafka cluster 0.8.2.1, using a project that is

Re: Trying to get kafka data to Hadoop

2015-03-04 Thread max square
automatically doesnt it? > > I'll take a look at the details of how we are invoking this on our site > and get back to you. > > Cheers, > Thunder > > > -Original Message- > From: max square [max2subscr...@gmail.com] > Received: Wednesday, 04 Mar 2015

topics still showing up using list command after deletion

2015-03-05 Thread max square
Hi All, I am using Kafka version 0.8.2.1. Like mentioned in the documentation, I enabled the delete.kafka.topic property in the config, restarted the brokers and issued the delete command. Then, I tried listing the topics and the topics that I deleted still shows up in the list. However, if I try

Re: Kafka to Hadoop HDFS

2015-03-06 Thread max square
This presentation from a recent Kafka meetup in NYC describes different approaches. http://www.slideshare.net/gwenshap/kafka-hadoop-for-nyc-kafka-meetup?ref=http://ingest.tips/2014/10/16/notes-from-kafka-meetup/ It´s companion blog post is this: http://ingest.tips/2014/10/16/notes-from-kafka-meetu