I never resolved this, but it was near the end of an engagement so it got punted. Is this something anyone else can reproduce?
I worry that some prior use of kafka has interfered. I tried wiping out zookeeper and /tmp/kafka_logs ... is there anywhere else that could be retaining something that is causing this? (it looks kind of like something gets written with the wrong format, like maybe an old version read a new or vice-versa, but I'm just guessing there) Founder, Chief Architect, Needham Software LLC Commiter & PMC member Apache Solr & Apache Lucene 508-333-5312 https://www.needhamsoftware.com On Wed, May 29, 2024 at 12:09 PM Patrick G. Heck <g...@needhamsoftware.com> wrote: > Hi folks, > > I was troubleshooting a program trying to receive a kafka message (local > kafka, for development), and decided I needed to verify kafka itself was > happy. So I created a topic named 'fubar' and started the consumer > listening to it. Then I started the console producer in another terminal > window and typed in foo<return> and it appeared nicely on the consumer > terminal. Then I typed bar<return> and got this: > > NS2-MacBook-Pro:kafka_2.13-3.7.0 gus$ bin/kafka-console-consumer.sh > --bootstrap-server localhost:9092 --topic fubar --from-beginning > > foo > > [2024-05-29 11:56:07,183] ERROR Error processing message, terminating > consumer process: (kafka.tools.ConsoleConsumer$) > > org.apache.kafka.common.protocol.types.SchemaException: Buffer underflow > while parsing response for request with header RequestHeader(apiKey=FETCH, > apiVersion=16, clientId=console-consumer, correlationId=608, > headerVersion=2) > > at > org.apache.kafka.clients.NetworkClient.parseResponse(NetworkClient.java:758) > > at > org.apache.kafka.clients.NetworkClient.handleCompletedReceives(NetworkClient.java:929) > > at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:594) > > at > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:281) > > at > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:252) > > at > org.apache.kafka.clients.consumer.internals.LegacyKafkaConsumer.pollForFetches(LegacyKafkaConsumer.java:686) > > at > org.apache.kafka.clients.consumer.internals.LegacyKafkaConsumer.poll(LegacyKafkaConsumer.java:617) > > at > org.apache.kafka.clients.consumer.internals.LegacyKafkaConsumer.poll(LegacyKafkaConsumer.java:590) > > at > org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:874) > > at > kafka.tools.ConsoleConsumer$ConsumerWrapper.receive(ConsoleConsumer.scala:473) > > at kafka.tools.ConsoleConsumer$.process(ConsoleConsumer.scala:103) > > at kafka.tools.ConsoleConsumer$.run(ConsoleConsumer.scala:77) > > at kafka.tools.ConsoleConsumer$.main(ConsoleConsumer.scala:54) > > at kafka.tools.ConsoleConsumer.main(ConsoleConsumer.scala) > > Caused by: java.nio.BufferUnderflowException > > at java.base/java.nio.Buffer.nextGetIndex(Buffer.java:651) > > at java.base/java.nio.HeapByteBuffer.getInt(HeapByteBuffer.java:402) > > at > org.apache.kafka.common.protocol.ByteBufferAccessor.readInt(ByteBufferAccessor.java:43) > > at > org.apache.kafka.common.message.ResponseHeaderData.read(ResponseHeaderData.java:90) > > at > org.apache.kafka.common.message.ResponseHeaderData.<init>(ResponseHeaderData.java:66) > > at > org.apache.kafka.common.requests.ResponseHeader.parse(ResponseHeader.java:100) > > at > org.apache.kafka.common.requests.AbstractResponse.parseResponse(AbstractResponse.java:100) > > at > org.apache.kafka.clients.NetworkClient.parseResponse(NetworkClient.java:756) > > ... 13 more > > [2024-05-29 11:56:07,183] ERROR [Consumer clientId=console-consumer, > groupId=console-consumer-59661] Heartbeat thread failed due to unexpected > error (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator) > > java.lang.IllegalStateException: There are no in-flight requests for node 0 > > at > org.apache.kafka.clients.InFlightRequests.requestQueue(InFlightRequests.java:62) > > at > org.apache.kafka.clients.InFlightRequests.completeNext(InFlightRequests.java:70) > > at > org.apache.kafka.clients.NetworkClient.handleCompletedReceives(NetworkClient.java:927) > > at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:594) > > at > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:281) > > at > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.pollNoWakeup(ConsumerNetworkClient.java:322) > > at > org.apache.kafka.clients.consumer.internals.AbstractCoordinator$HeartbeatThread.run(AbstractCoordinator.java:1490) > > Processed a total of 1 messages > > NS2-MacBook-Pro:kafka_2.13-3.7.0 gus$ > > > Any idea what's happening? Certainly doesn't look copacetic. > > Producer was started like this: > > NS2-MacBook-Pro:kafka_2.13-3.7.0 gus$ bin/kafka-topics.sh --list > --bootstrap-server localhost:9092 > > __consumer_offsets > > fubar > > NS2-MacBook-Pro:kafka_2.13-3.7.0 gus$ bin/kafka-console-producer.sh > --bootstrap-server localhost:9092 --topic fubar > > >foo > > >bar > > > > > -Gus > > Founder, Chief Architect, Needham Software LLC > Commiter & PMC member Apache Solr & Apache Lucene > 508-333-5312 > https://www.needhamsoftware.com > >
