One possible approach is to change the retention policy on broker. How large your messages can accumulate on brokers at peak time?
Guozhang On Wed, Dec 11, 2013 at 9:09 PM, xingcan <xingc...@gmail.com> wrote: > Hi, > > In my application, the produce speed could be very high at some specific > time in a day while return > to a low speed at the rest of time. Frequently, my data logs are flushed > away before they are being > consumed by clients due to lacking disk space during the busy times. > > Increasing consume speed seems to be difficult and adding space for log > files are also not a ultimate solution. Any suggestions for this problem? > Are there any speed control mechanism in Kafka? > > Thanks. > > -- > *Xingcan* > -- -- Guozhang