You can control fsync with two properties: https://kafka.apache.org/documentation/#topicconfigs_flush.messages https://kafka.apache.org/documentation/#topicconfigs_flush.ms
On Wed, Aug 25, 2021 at 10:39 AM Kunal Goyal <kunal.go...@cohesity.com> wrote: > Hello, > > We are exploring using Kafka for our application. Our requirement is that > once we write some messages to Kafka, it should be guaranteed that the > messages are persisted to disk. > We found this > < > https://www.quora.com/Does-Kafka-sync-data-to-disk-asynchronously-like-Redis-does > > > article > which says that a Kafka broker acknowledges a record after it has written > the record to the buffer of the I/O device; it does not issue an explicit > fsync operation nor does it wait for the OS to confirm that the data has > been written. Is this statement true for the current implementation? If so, > is there any way in which we can ensure fsync is called before > acknowledgement of messages? > Any help would be appreciated. > > -- > > Thanks & Regards > > Kunal Goyal >
