While consuming from the topics I get an IlegalArgumentException and all consumption stops, the error keeps on throwing.
I've tracked it down to FectchResponse.scala line 33 The error happens when the FetchResponsePartitionData object's readFrom method calls: messageSetBuffer.limit(messageSetSize) I put in some debug code the the messageSetSize is 671758648, while the buffer.capacity() gives 155733313, for some reason the buffer is smaller than the required message size. I don't know the consumer code enough to debug this. It doesn't matter if compression is used or not. I've created a jira ticket for this: https://issues.apache.org/jira/browse/KAFKA-1196 this is a real pain for me because I'm unable to consume from kafka at all :( Any ideas on possible config? or code changes I could try to fix? Regards, Gerrit