I think the default puts the log directory in /tmp/kafka-logs. It may be worth configuring your settings to put your logs somewhere else and seeing what happens.
On Thu, Jul 28, 2016 at 10:16 AM, David Yu <guans...@gmail.com> wrote: > Those are all with default value. Will continue investigation. > > On Wed, Jul 27, 2016 at 11:38 PM Manikumar Reddy < > manikumar.re...@gmail.com> > wrote: > > > also check if any value set for log.retention.bytes broker config > > > > On Wed, Jul 27, 2016 at 8:03 PM, Samuel Taylor <s...@samueltaylor.org> > > wrote: > > > > > Is it possible that your log directory is in /tmp/ and your OS is > > deleting > > > that directory? I know it's happened to me before. > > > > > > - Samuel > > > > > > On Jul 27, 2016 13:43, "David Yu" <guans...@gmail.com> wrote: > > > > > > > We are using Kafka 0.8.2.0 provided by CDH. Our Kafka retention is > set > > to > > > > default 7 days. One problem we have with one of our topics is that, > the > > > > logs are purged within two days. This topic does not override any > > default > > > > settings. > > > > > > > > Just wanna get some pointers as to how to debug this issue. > > > > > > > > Thanks, > > > > David > > > > > > > > > > -- *Samuel Taylor* Data Science *Square Root, Inc. <http://square-root.com/>* <http://square-root.com/>Square-Root.com <http://square-root.com/>