Max message size and compression

2017-06-18 Thread Eli Jordan
Hi max.message.bytes controls the maximum message size the kafka server will process message.max.bytes controls the maximum message size the consumer will process max.request.size controls the maximum request size for the producer Whats not clear to me (and I can't find documented anywhere) i

Re: Max message size and compression

2017-06-22 Thread Eli Jordan
t's specified in these parameters. > > On Sat, Jun 17, 2017 at 7:46 PM, Eli Jordan > wrote: > >> Hi >> >> max.message.bytes controls the maximum message size the kafka server will >> process >> >> message.max.bytes controls the maximum message siz

Kafka Streams: Pseudo Wallclock Punctuate

2017-08-24 Thread Eli Jordan
Hi I have a kafka streams application, that uses a couple of stateful (i.e. using key value stores) custom transformer implementations. I'm aware that the scheduling of the punctuate method is based on stream time. However, for my use case, this is not what I want, I need wallclock scheduling.

Re: Kafka Streams: Pseudo Wallclock Punctuate

2017-08-24 Thread Eli Jordan
? > On 25 Aug 2017, at 9:57 am, Eli Jordan wrote: > > Hi > > I have a kafka streams application, that uses a couple of stateful (i.e. > using key value stores) custom transformer implementations. > > I'm aware that the scheduling of the punctuate method is based on st

Re: Kafka Streams: Pseudo Wallclock Punctuate

2017-08-25 Thread Eli Jordan
mestampExtractor. It's not a nice solution, but I > don't have any better idea atm. > > > -Matthias > >> On 8/24/17 9:37 PM, Eli Jordan wrote: >> Update on this. Modifying the state store on another thread actually doesn’t >> work. I receive the error &

KIP 179 - AdminClient Partition Assignment

2018-07-02 Thread Eli Jordan
Hi I recently cam a cross a use case where I would like to have the ability to increase the replication factor of a topic using the admin client. This is currently not possible, and the KIP https://cwiki.apache.org/confluence/display/KAFKA/KIP-179+-+Change+ReassignPartitionsCommand+to+use+Admin