Hi While configuring a topic, we are specifying the retention bytes per topic as follows. Our retention time in hours is 48.
*bin/kafka-topics.sh, --zookeeper zk-1:2181,zk-2:2181,zk-3:2181 --create --topic AmazingTopic --replication-factor 2 --partitions 64 --config retention.bytes=16106127360 --force* According to Kafka documentation, when either of the condition is met, the deletion of the log happens from the rear end. Can anyone tell as to why retention.bytes is not working ? Here is the relevant Kafka config: # The minimum age of a log file to be eligible for deletion *log.retention.hours=48* # A size-based retention policy for logs. Segments are pruned from the log as long as the remaining # segments don't drop below log.retention.bytes. *log.retention.bytes=42949672960* # The maximum size of a log segment file. When this size is reached a new log segment will be created. *log.segment.bytes=1073741824* # The interval at which log segments are checked to see if they can be deleted according # to the retention policies *log.retention.check.interval.ms <http://log.retention.check.interval.ms>=300000* # By default the log cleaner is disabled and the log retention policy will default to just delete segments after their retention expires. # If log.cleaner.enable=true is set the cleaner will be enabled and individual logs can then be marked for log compaction. *log.cleaner.enable=true* Thanks.
