Steve Kecskes created KAFKA-9249:
------------------------------------
Summary: Data exists in topic longer than retention time
Key: KAFKA-9249
URL: https://issues.apache.org/jira/browse/KAFKA-9249
Project: Kafka
Issue Type: Bug
Affects Versions: 2.3.1
Reporter: Steve Kecskes
I am experiencing an issue where data on some topic longer than the retention
time is not being cleaned. The topic "Instrument" has the following
configuration
{panel}
h4. Topic Summary
{panel}
|Replication|1|
|Number of Partitions|5|
|Sum of partition offsets|3,715,976|
|Total number of Brokers|1|
|Number of Brokers for Topic|1|
|Preferred Replicas %|100|
|Brokers Skewed %|0|
|Brokers Leader Skewed %|0|
|Brokers Spread %|100|
|Under-replicated %|0|
|Leader Size| |
||Config||Value||
|min.cleanable.dirty.ratio|0.1|
|cleanup.policy|compact,delete|
|retention.ms|777600000|
|delete.retention.ms|600000|
|segment.bytes|5000000|
|segment.ms|1800000|
When reading from the topic, the first message LogAppendTime is: 2019-10-22
14:08:39.986 +0800 - this is over 30days old.
The retention.ms on the topic is equal to 9 days. It was 10, I cahnged it to 9
to see if i could trigger a cleanup.
Am I missing something further here?
--
This message was sent by Atlassian Jira
(v8.3.4#803005)