I am observing log filling up on kafka_2.10-0.8.2.0.
Following are the logs on one of kafka node:
On Topic Creation:
[2015-07-07 20:28:17,579] INFO [ReplicaFetcherManager on broker 0] Removed
fetcher for partitions [tempv1,0] (kafka.server.ReplicaFetcherManager)
[2015-07-07 20:28:17,582] INFO Completed load of log tempv1-0 with log end
offset 0 (kafka.log.Log)
[2015-07-07 20:28:17,583] INFO Created log for partition [tempv1,0] in
/tmp/kafka-logs-server1 with properties {segment.index.bytes -> 10485760,
file.delete.delay.ms -> 60000, segment.bytes -> 536870912, flush.ms ->
9223372036854775807, delete.retention.ms -> 86400000, index.interval.bytes
-> 4096, retention.bytes -> -1, min.insync.replicas -> 1, cleanup.policy ->
delete, unclean.leader.election.enable -> true, segment.ms -> 604800000,
max.message.bytes -> 1000012, flush.messages -> 9223372036854775807,
min.cleanable.dirty.ratio -> 0.5, retention.ms -> 604800000,
segment.jitter.ms -> 0}. (kafka.log.LogManager)
[2015-07-07 20:28:17,583] WARN Partition [tempv1,0] on broker 0: No
checkpointed highwatermark is found for partition [tempv1,0]
(kafka.cluster.Partition)
[2015-07-07 20:28:18,388] ERROR [Replica Manager on Broker 0]: Error when
processing fetch request for partition [tempv1,0] offset -1 from consumer
with correlation id 0. Possible cause: Request for offset -1 but we only
have log segments in the range 0 to 0. (kafka.server.ReplicaManager)
On Topic Deletion:
[2015-07-07 20:29:05,075] INFO [ReplicaFetcherManager on broker 0] Removed
fetcher for partitions [tempv1,0] (kafka.server.ReplicaFetcherManager)
[2015-07-07 20:29:05,076] INFO [ReplicaFetcherManager on broker 0] Removed
fetcher for partitions [tempv1,0] (kafka.server.ReplicaFetcherManager)
[2015-07-07 20:29:05,076] WARN [Replica Manager on Broker 0]: Fetch request
with correlation id 0 from client Channel_tempv1_0 on partition [tempv1,0]
failed due to Partition [tempv1,0] doesn't exist on 0
(kafka.server.ReplicaManager)
[2015-07-07 20:29:05,077] INFO Deleting index
/tmp/kafka-logs-server1/tempv1-0/00000000000000000000.index
(kafka.log.OffsetIndex)
[2015-07-07 20:29:05,077] INFO Deleted log for partition [tempv1,0] in
/tmp/kafka-logs-server1/tempv1-0. (kafka.log.LogManager)
[2015-07-07 20:29:05,095] INFO Closing socket connection to /10.240.213.24.
(kafka.network.Processor)
[2015-07-07 20:29:05,095] WARN [Replica Manager on Broker 0]: Fetch request
with correlation id 0 from client Channel_tempv1_0 on partition [tempv1,0]
failed due to Partition [tempv1,0] doesn't exist on 0
(kafka.server.ReplicaManager)
[2015-07-07 20:29:05,096] INFO Closing socket connection to /10.240.213.24.
(kafka.network.Processor)
[2015-07-07 20:29:05,097] WARN [Replica Manager on Broker 0]: Fetch request
with correlation id 0 from client Channel_tempv1_0 on partition [tempv1,0]
failed due to Partition [tempv1,0] doesn't exist on 0
(kafka.server.ReplicaManager)
[2015-07-07 20:29:05,098] INFO Closing socket connection to /10.240.213.24.
(kafka.network.Processor)
......
......
At the time of deletion, there was no java client running and accessing
kafka topic.
