Re: 0.8.2.1 upgrade causes much more IO

2015-08-14 Thread Jun Rao
.1.1 and > > 0.8.2.1 testing, and we still saw the IO hit on the broker side, which > > seems to confirm this). > > > > > > > > Thanks, > > > > Matt Bruce > > > > > > > > > > > > *From:* Andrew Otto [mailto:ao...@wik

Re: 0.8.2.1 upgrade causes much more IO

2015-08-13 Thread Andrew Otto
s to confirm this). > > > > Thanks, > > Matt Bruce > > > > > > *From:* Andrew Otto [mailto:ao...@wikimedia.org] > *Sent:* Tuesday, August 11, 2015 3:15 PM > *To:* users@kafka.apache.org > *Cc:* Dan Andreescu ; Joseph Allemandou < > jalleman...@wiki

RE: 0.8.2.1 upgrade causes much more IO

2015-08-11 Thread Matthew Bruce
s, Matt Bruce From: Andrew Otto [mailto:ao...@wikimedia.org] Sent: Tuesday, August 11, 2015 3:15 PM To: users@kafka.apache.org Cc: Dan Andreescu ; Joseph Allemandou Subject: Re: 0.8.2.1 upgrade causes much more IO Hi Todd, We are using snappy! And we are using version 1.1.1.6 as of our

Re: 0.8.2.1 upgrade causes much more IO

2015-08-11 Thread Todd Snyder
Hi Andrew, Are you using Snappy Compression by chance? When we tested the 0.8.2.1 upgrade initially we saw similar results and tracked it down to a problem with Snappy version 1.1.1.6 (https://issues.apache.org/jira/browse/KAFKA-2189). We’re running with Snappy 1.1.1.7 now and the performan