Re: log.retention.bytes.per.topic does not trigger deletion

2014-01-20 Thread Guozhang Wang
Yes, once 0.8.1 is released we will add a separate quick-start page. On Sun, Jan 19, 2014 at 10:57 PM, Joe Stein wrote: > There are a lot of nuance changes to the QuickStart and other changes for > 0.8.1 that will need a separate page... Not just modifications. > > > /**

Re: log.retention.bytes.per.topic does not trigger deletion

2014-01-19 Thread Joe Stein
There are a lot of nuance changes to the QuickStart and other changes for 0.8.1 that will need a separate page... Not just modifications. /*** Joe Stein Founder, Principal Consultant Big Data Open Source Security LLC http://www.stealth.ly Twitter: @al

Re: log.retention.bytes.per.topic does not trigger deletion

2014-01-19 Thread Jason Rosenberg
Please be sure to update the online config docs with this change! The per topic options are still listed there Jason On Thu, Jan 16, 2014 at 9:57 PM, Ben Summer wrote: > I see. I don't have version 0.8.1 yet. We just updated to 0.8.0 from beta > after it became the "stable version". > Good

Re: log.retention.bytes.per.topic does not trigger deletion

2014-01-16 Thread Ben Summer
I see. I don't have version 0.8.1 yet. We just updated to 0.8.0 from beta after it became the "stable version". Good to know there is a fix for this. I'll start trying it out in some non-production environments. Thanks, Ben On Thu, Jan 16, 2014 at 7:42 PM, Guozhang Wang wrote: > In the latest

Re: log.retention.bytes.per.topic does not trigger deletion

2014-01-16 Thread Guozhang Wang
In the latest version, per-topic configs have been moved to Zookeeper you and set them using admin tools instead of writing the config files. Could you try trunk HEAD and see if this issue has already been resolved: https://issues.apache.org/jira/browse/KAFKA-554 Guozhang On Thu, Jan 16, 2014 a

Re: log.retention.bytes.per.topic does not trigger deletion

2014-01-16 Thread Ben Summer
v0.8.0, (non-beta) downloaded from the website. Let me know if there is a file I can check in the installation footprint that can give you an actual change id. Is there a fix to this particular feature that you know was made in a later build? Thanks for the quick response, Ben On Thu, Jan 16, 2

Re: log.retention.bytes.per.topic does not trigger deletion

2014-01-16 Thread Guozhang Wang
Hello Ben, Which version are you using? Guozhang On Thu, Jan 16, 2014 at 3:15 PM, Ben Summer wrote: > I tried using the following two retention properties > > log.retention.bytes=3221225472 > > log.retention.bytes.per.topic=first_topic:1099511627776,second_topic:1099511627776 > > which I inte

log.retention.bytes.per.topic does not trigger deletion

2014-01-16 Thread Ben Summer
I tried using the following two retention properties log.retention.bytes=3221225472 log.retention.bytes.per.topic=first_topic:1099511627776,second_topic:1099511627776 which I interpret to mean "by default, keep 3GB per topic partition, except for first_topic and second_topic, which should retain