Hi, this consumer log line indicates that there is an open/pending transaction (ie, neither committed nor aborted) and thus, the broker does not deliver the data to the consumer.
-> highWaterMark = 5, but lastStableOffset = 0 On 11/2/17 5:25 AM, Abhishek Verma wrote: > 1871 [main] DEBUG org.apache.kafka.clients.consumer.internals.Fetcher - > Fetch READ_COMMITTED at offset 0 for partition topic-4-0 returned fetch data > (error=NONE, highWaterMark=5, lastStableOffset = 0, logStartOffset = 0, > abortedTransactions = [], recordsSizeInBytes=0) Thus, there must be an issue on the producer side, that the transactions does not get committed. Not sure why though, as producer logs indicate that the TX was committed successfully. Maybe you can dump the log segments to see what is in them? Btw: Kafka 1.0.0 was release recently, containing several bug fixes for transactions. Maybe you can try if it fixed in 1.0.0. -Matthias
signature.asc
Description: OpenPGP digital signature
