Re: Consume Kafka messages in a batch

2023-03-22 Thread Mark Nuttall
Thanks Otavio! Option 1 won't work because the Camel code, while it does consume a batch based on those settings and iterates over the enumeration, it only ever passes one at a time. I thought about hacking that class but when we update camel versions, i'd have to remember i did that. :) . We can

Re: Consume Kafka messages in a batch

2023-03-22 Thread Otavio Rodolfo Piske
Hi, Some ideas worth investigating: 1. Using a mix of current kafka client options (i.e.: like maxPollrecords, maxPollInterval, etc) along with aggregate EIP 2. Create your own KafkaClientFactory that wraps a custom Producer/Consumer wrapping the Spring Kafka Consumer. If none of this works, the