Re: trouble sending produce requests to 0.9.0.0 broker cluster

2016-01-11 Thread Dave Peterson
Ok, thanks for the information. I tried setting the client ID to "bruce" and the problem disappeared. I looked at https://cwiki.apache.org/confluence/display/KAFKA/A+Guide+To+The+Kafka+Protocol and it doesn't say anything about an empty client ID not being allowed (even if it isn't allowed, Kaf

trouble upgrading from 0.8.2.1 to 0.9.0.0: invalid message

2016-01-14 Thread Dave Peterson
I was trying to upgrade an 0.8.2.1 broker cluster to 0.9.0.0 by following the instructions here: http://kafka.apache.org/documentation.html#upgrade After upgrading one broker, with inter.broker.protocol.version=0.8.2.X set, I get ACK error 2 (InvalidMessage) when I try to send produce request

Re: trouble upgrading from 0.8.2.1 to 0.9.0.0: invalid message

2016-01-15 Thread Dave Peterson
wrote: > Hi Dave, > > On Fri, Jan 15, 2016 at 2:04 AM, Dave Peterson wrote: > > > I was trying to upgrade an 0.8.2.1 broker cluster to 0.9.0.0 by following > > the instructions here: > > > > http://kafka.apache.org/documentation.html#upgrade > > &g

Re: trouble upgrading from 0.8.2.1 to 0.9.0.0: invalid message

2016-01-19 Thread Dave Peterson
rs were on 0.8.2.1 while others were on 0.9.0.0)? If so, it is expected that it won't work correctly. All the brokers should be upgraded before the clients are upgraded (otherwise the 0.8.2.1 broker will send a response that the newer clients cannot handle). Ismael On Fri, Jan 15, 2016 at 7:52 PM

Re: trouble upgrading from 0.8.2.1 to 0.9.0.0: invalid message

2016-01-20 Thread Dave Peterson
If so, it is expected that it > won't work correctly. All the brokers should be upgraded before the clients > are upgraded (otherwise the 0.8.2.1 broker will send a response that the > newer clients cannot handle). > > Ismael > > On Fri, Jan 15, 2016 at 7:52 PM, Dave Pete

Re: trouble upgrading from 0.8.2.1 to 0.9.0.0: invalid message

2016-01-24 Thread Dave Peterson
On Wed, Jan 20, 2016 at 11:43 PM, Joel Koshy wrote: > Yes - compaction is a topic-level property. You can use --describe to > verify that the topic is compacted or not and if you didn't intend it to be > compacted you can alter the configuration. > I tried using the --describe option with kafka-

Introducing Dory

2016-06-11 Thread Dave Peterson
s you would like to see in future releases, please add them to the list. Also, please contribute code if you can afford the time. Thanks, Dave Peterson

Re: Introducing Dory

2016-06-11 Thread Dave Peterson
n process. Regards, Dave On 6/11/2016 7:50 PM, Tauzell, Dave wrote: Does Dory have the option to persist messages to local disk after the Dory ack but before sending to Kafka? Dave On Jun 11, 2016, at 17:23, Dave Peterson wrote: Hello Kafka users, Version 1.1.0 of Dory is now available

Re: Introducing Dory

2016-06-12 Thread Dave Peterson
Thanks! Enjoy :-) On 6/12/2016 12:24 AM, Gwen Shapira wrote: Dory is pretty cool (even though it is named after a somewhat dorky fish). Thank you for sharing :) On Sun, Jun 12, 2016 at 1:24 AM, Dave Peterson wrote: Hello Kafka users, Version 1.1.0 of Dory is now available. See https

Re: Introducing Dory

2016-06-13 Thread Dave Peterson
. Thanks Arya Arya On Sun, Jun 12, 2016 at 8:10 PM, Dave Peterson wrote: > Thanks! Enjoy :-) > > > > On 6/12/2016 12:24 AM, Gwen Shapira wrote: > >> Dory is pretty cool (even though it is named after a somewhat dorky >> fish). Thank you for sharing :) >> >

Re: Introducing Dory

2016-06-13 Thread Dave Peterson
queue until it comes back. -J On Mon, Jun 13, 2016 at 3:00 AM, Dave Peterson wrote: > Hi Arya, > > In the case of a kernel panic or other failure serious enough to bring > a machine down (hardware failure, power outage, etc.), message loss is > definitely possible, and not tot

Re: Introducing Dory

2016-06-13 Thread Dave Peterson
Yes, the persistence feature could also be configurable on a per-topic basis. If desired, persistence could then be limited only to certain critical topics, allowing less critical data to avoid the overhead. There could also be configuration options specifying when and how to persist the data. So

Introducing Bruce, a Kafka producer daemon

2014-09-09 Thread Dave Peterson
tching and compression that is configurable on a per- topic basis. Only Snappy compression is currently supported, but Bruce was designed to support multiple compression types. For more information, see Bruce's documentation which is available on its GitHub site. Cheers, Dave Peterson Tagged, Inc.