See the description of log.retention.bytes here: https://kafka.apache.org/08/configuration.html
You can set a basic value per log-partition, but you'll need to do some math to work out an appropriate value based on: 1. The number of partitions per topic 2. The number of topics 3. The capacity of the disks used by the cluster nodes On Fri, Nov 21, 2014 at 9:58 AM, Nilesh Chhapru < nilesh.chha...@ugamsolutions.com> wrote: > Hi All, > > Can anyone give some inputs about retention policy as I am trying to save > larger data in the topics and hence going out of disk space. > > Regards, > Nilesh Chhapru. > > > ---------------------------------------------------------------------------------------Disclaimer---------------------------------------------------------------------------------------------- > > ****Opinions expressed in this e-mail are those of the author and do not > necessarily represent those of Ugam. Ugam does not accept any > responsibility or liability for it. This e-mail message may contain > proprietary, confidential or legally privileged information for the sole > use of the person or entity to whom this message was originally addressed. > Any review, re-transmission, dissemination or other use of or taking of any > action in reliance upon this information by persons or entities other than > the intended recipient is prohibited. If you have received this e-mail in > error, please delete it and all attachments from any servers, hard drives > or any other media. > > Warning: Sufficient measures have been taken to scan any presence of > viruses however the recipient should check this email and any attachments > for the presence of viruses. Ugam accepts no liability for any damage > caused by any virus transmitted by this email. **** >
