We're expecting to occasionally have to deal with pretty large messages being sent to Kafka. We will of course set the fetch size appropriately high, but are concerned about the behavior when the message exceeds the fetch size. As far as I can tell the current behavior when a message that is too large is encountered is to pretend it is not there and not notify the consumer in any way. IMO it would be better to throw an exception than silently ignoring the issue (with the current code one can't really distinguish a large message from no data at all).
Thoughts? /Sam