Re: Using Kafka as Primary Datastore without compaction

2018-06-24 Thread Aman Rastogi
As per my understanding, you should set the retention period to Long.MAX hours. This will ensure that your messages won't get compacted because retention period is huge. Regards, Aman On Mon, Jun 25, 2018 at 8:27 AM, Barathan Kulothongan wrote: > Hi There, I am currently reading the Kafka Defin

Using Kafka as Primary Datastore without compaction

2018-06-24 Thread Barathan Kulothongan
Hi There, I am currently reading the Kafka Definitive guide book as we wanted to Architect an application using Kafka as the primary data store. In the Log Compaction section you have mentioned the dirty records are compacted with leaving just the latest records in the topic. Actually the applic