Re: Linkedin Camus vs kafka-hadoop-loader vs hadoop-consumer

2014-02-13 Thread Maxime Nay
Hi, Camus does support raw text messages. If I remember correctly, you just need to provide your own record decoder and record writer. We are using Camus to consume messages from Kafka and store them to S3 and it works quite well. Maxime On Thu, Feb 13, 2014 at 8:18 AM, Marcelo Valle wrote:

Re: Partition reassignment stucked

2013-12-09 Thread Maxime Nay
That's good to know. Thanks for your help! 2013/12/9 Neha Narkhede > We will announce it on this mailing list. It is probably a month away from > a release. > > Thanks, > Neha > > > On Mon, Dec 9, 2013 at 12:02 PM, Maxime Nay wrote: > > > Ok, th

Re: Partition reassignment stucked

2013-12-09 Thread Maxime Nay
Until it is ready, there isn't a good > cluster expansion solution other than spinning up a new cluster. This is > probably a little easier if you have a VIP in front of your kafka cluster. > > Thanks, > Neha > > > On Mon, Dec 9, 2013 at 9:40 AM, Maxime Nay wrote: >

Re: Partition reassignment stucked

2013-12-09 Thread Maxime Nay
> Are you using the 0.8.0 final release? Any error in controller log? > > > > Thanks, > > > > Jun > > > > > > On Fri, Dec 6, 2013 at 4:38 PM, Maxime Nay wrote: > > > > > Hi, > > > > > > We are trying to add a broker to

Partition reassignment stucked

2013-12-06 Thread Maxime Nay
Hi, We are trying to add a broker to a 10 node cluster. We have 7 different topics, each of them is divided in 10 partitions, and their replication factor is 3. To send traffic to this new node, we tried the kafka-reassign-partitions.sh tool, but for some reason, it doesnt work, and now it seems

Re: Add a new node in an existing kafka 0.8 cluster

2013-12-02 Thread Maxime Nay
the reassignment logic and the 0.8 final release is > in progress. Recommend you use 0.8 final and see how that goes. We are > fixing it further in 0.8.1, so if you feel adventurous you can try using > trunk :) > > Thanks > Neha > > > On Mon, Dec 2, 2013 at 2:12 PM, Maxim

Re: Add a new node in an existing kafka 0.8 cluster

2013-12-02 Thread Maxime Nay
ave a few leaders > and will start serving data. > > Thanks, > Neha > > > On Mon, Dec 2, 2013 at 1:50 PM, Maxime Nay wrote: > > > Hi, > > > > Last week we set-up a new kafka 0.8 cluster, using the beta1 released > > available here : http://kafka.apach

Add a new node in an existing kafka 0.8 cluster

2013-12-02 Thread Maxime Nay
Hi, Last week we set-up a new kafka 0.8 cluster, using the beta1 released available here : http://kafka.apache.org/downloads.html It worked fine until we tried to replace a node in this cluster. We shutdown a node, then bring up a new one. The new node is registered in zookeeper, but it doesn't g