Re: cannot make another partition reassignment due to the previous partition reassignment failure

2015-06-15 Thread Yu Yang
Thanks, Manikumar! On Mon, Jun 15, 2015 at 9:14 PM, Manikumar Reddy wrote: > Hi, > Jut delete the "/admin/reassign_partitions" zk node for zookeeper and > try again. > > #sh zookeeper-shell.sh localhost:2181 > delete /admin/reassign_partitions > > > Manikumar > > > On Tue, Jun 16, 2015 at 8

Re: cannot make another partition reassignment due to the previous partition reassignment failure

2015-06-15 Thread Manikumar Reddy
Hi, Jut delete the "/admin/reassign_partitions" zk node for zookeeper and try again. #sh zookeeper-shell.sh localhost:2181 delete /admin/reassign_partitions Manikumar On Tue, Jun 16, 2015 at 8:15 AM, Yu Yang wrote: > HI, > > We have a kafka 0.8.1.1 cluster. Recently I did a partition as

cannot make another partition reassignment due to the previous partition reassignment failure

2015-06-15 Thread Yu Yang
HI, We have a kafka 0.8.1.1 cluster. Recently I did a partition assignment for some topic partitions in the cluster. Due to broker failure, the partition reassignment failed. I cannot do another partition assignment now, and always get errors as follows. How can we work around this? I have tried g

At-least-once guarantees with high-level consumer

2015-06-15 Thread Carl Heymann
Hi ** Disclaimer: I know there's a new consumer API on the way, this mail is about the currently available API. I also apologise if the below has already been discussed previously. I did try to check previous discussions on ConsumerIterator ** It seems to me that the high-level consumer would be

Re: Broken auto leader rebalance after using reassign partitions tool

2015-06-15 Thread Gwen Shapira
Can you share the command you ran for partition reassignment? (and the JSON) On Mon, Jun 15, 2015 at 8:41 AM, Valentin wrote: > > Hi guys, > > today I have observed a very strange behavior of the auto leader rebalance > feature after I used the reassign partitions tool. > For some reason only th

Broken auto leader rebalance after using reassign partitions tool

2015-06-15 Thread Valentin
Hi guys, today I have observed a very strange behavior of the auto leader rebalance feature after I used the reassign partitions tool. For some reason only the first two of my six brokers are now used as leaders. Example: # ./kafka-topics.sh --zookeeper xxx --describe --topic Search Topic:Search

Re: Kafka as an event store for Event Sourcing

2015-06-15 Thread Daniel Schierbeck
I like to refer to it as "conditional write" or "conditional request", semantically similar to HTTP's If-Match header. Ben: I'm adding a comment about per-key checking to your JIRA. On Mon, Jun 15, 2015 at 4:06 AM Ben Kirwin wrote: > Yeah, it's definitely not a standard CAS, but it feels like t