Re: Experiences with larger message sizes

2014-06-27 Thread Luke Forehand
g? > >Are you using compression? > >Bert > >On Thursday, June 26, 2014, Luke Forehand < >luke.foreh...@networkedinsights.com> wrote: > >> I have used 50MB message size and it is not a great idea. First of all >> you need to make sure you have these sett

RE: Experiences with larger message sizes

2014-06-26 Thread Luke Forehand
I have used 50MB message size and it is not a great idea. First of all you need to make sure you have these settings in sync: message.max.bytes replica.fetch.max.bytes fetch.message.max.bytes I had not set the replica fetch setting and didn't realize one of my partitions was not replicating aft

Re: Using GetOffsetShell against non-existent topic creates the topic which cannot be deleted

2014-06-24 Thread Luke Forehand
Definitely, this is version 0.8.1.1 https://issues.apache.org/jira/browse/KAFKA-1507 Luke Forehand | Networked Insights | Software Engineer On 6/23/14, 6:58 PM, "Guozhang Wang" wrote: >Luke, > >Thanks for the findings, could you file a JIRA to keep track of th

Re: restarting a broker during partition reassignment

2014-06-24 Thread Luke Forehand
nonymous/cb79dc251d87e334cfff Thanks, Luke Forehand | Networked Insights | Software Engineer On 6/23/14, 5:57 PM, "Guozhang Wang" wrote: >Hi Luke, > >What are the exceptions/warnings you saw in the broker and controller >logs? > >Guozhang > > >On Mon, Jun 23,

Using GetOffsetShell against non-existent topic creates the topic which cannot be deleted

2014-06-23 Thread Luke Forehand
./kafka-topics.sh --zookeeper stormqa1/kafka-prod --describe --topic typo Topic:typo PartitionCount:8ReplicationFactor:1 Configs: Topic: typo Partition: 0Leader: 10 Replicas: 10Isr: 10 ... Luke Forehand | Networked Insights | Software Engineer

restarting a broker during partition reassignment

2014-06-23 Thread Luke Forehand
before I spam I was wondering if there is already a jira task for this issue or if anybody else is aware. Thanks, Luke Forehand | Networked Insights | Software Engineer

uneven message distribution

2014-06-20 Thread Luke Forehand
:1:9 luke1:2:1 luke1:3:3 luke1:4:50 luke1:5:266603 luke1:6:80035 luke1:7:3455509 luke1:8:3756164 luke1:9:5 They are very uneven, any ideas what is going on here? Thanks, Luke Forehand | Networked Insights | Software Engineer