No need to worry about this. Kafka Streams used "purge data" calls, to actively delete data from those topics after the records are processed. Hence, those topics won't grow unbounded but are "truncated" on a regular basis.
-Matthias On 8/21/19 11:38 AM, Murilo Tavares wrote: > Hi > I have a complex KafkaStreams topology, where I have a bunch of KTables > that I regroup (rekeying) and aggregate so I can join them. > I've noticed that the "-repartition" topics created by the groupBy > operations have a very long retention by default (Long.MAX_VALUE). > I'm a bit concerned about the size of these topics, as they will retain > data forever. I wonder why are they so long, and what would be the impact > of reducing this retention? > Thanks > Murilo >
signature.asc
Description: OpenPGP digital signature
