>>If kafka client producer gets record meta data with a valid offset, do we >>consider that that message is indeed fsynced to the disk ? No, it doesn't. The meaning depends on your configuration (https://www.cloudera.com/documentation/kafka/latest/topics/kafka_ha.html). To increase the durability of messages you can have an acknowledgement mean that the broker has received the messages and replicated it to N other brokers (although they may not have actually fsynced to disk either).
>> My next related question is, if we have a single kafka server/broker, could >> we assume that all messages that we got a reply from Kafka client with a >> valid offset are successfully written to disk even in case of power failure, >>provided disks didn't crash ? No, see my above reply. -Dave -----Original Message----- From: JEVTIC, MARKO [mailto:marko.jev...@fisglobal.com] Sent: Tuesday, May 30, 2017 8:05 AM To: users@kafka.apache.org Subject: client recordmetadata meaning Hi all, I wasn't able to find in documentation firm agreement about Kafka message reply. So, before going through the source code, I would like to ask a question: If kafka client producer gets record meta data with a valid offset, do we consider that that message is indeed fsynced to the disk ? My next related question is, if we have a single kafka server/broker, could we assume that all messages that we got a reply from Kafka client with a valid offset are successfully written to disk even in case of power failure, provided disks didn't crash ? Thank you for your time. The information contained in this message is proprietary and/or confidential. If you are not the intended recipient, please: (i) delete the message and all copies; (ii) do not disclose, distribute or use the message in any manner; and (iii) notify the sender immediately. In addition, please be aware that any message addressed to our domain is subject to archiving and review by persons other than the intended recipient. Thank you. This e-mail and any files transmitted with it are confidential, may contain sensitive information, and are intended solely for the use of the individual or entity to whom they are addressed. If you have received this e-mail in error, please notify the sender by reply e-mail immediately and destroy all copies of the e-mail and any attachments.
