Re: Question regarding Samza's Kafka consumer

2018-07-10 Thread Thomas Becker
Thanks for your reply Jagadish. We will certainly do some testing, I was just curious if anyone had tried or knew what we could expect. The broker format change is actually over 2 years old now, so I assumed someone had tried this by now ;) -Tommy On Mon, 2018-07-09 at 12:22 -0700, Jagadish Ve

Re: Question regarding Samza's Kafka consumer

2018-07-09 Thread Jagadish Venkatraman
Hi Thomas, >> Has Samza been tested against newer broker versions using the new message format, and if so does it have a significant performance impact? We have not benchmarked Kafka broker performance with the new message format. Any benchmarking may not be reliably reproducible since there are

Re: Question regarding Samza's Kafka consumer

2018-07-09 Thread Thomas Becker
Anyone have any input here? On Mon, 2018-07-02 at 11:50 +, Thomas Becker wrote: Hey folks, I have a question regarding potential performance impacts of running Samza against newer Kafka brokers. We have languished on the old on- disk message format for Kafka for some time, and want to upg

Question regarding Samza's Kafka consumer

2018-07-02 Thread Thomas Becker
Hey folks, I have a question regarding potential performance impacts of running Samza against newer Kafka brokers. We have languished on the old on- disk message format for Kafka for some time, and want to upgrade to the newer format which supports timestamps. Samza currently accounts for quite a