Re: [VOTE] 3.1.1 RC0

2022-04-12 Thread Guozhang Wang
Thanks Tom. I took a quick pass on the release notes, javadocs, downloaded the rc (zip only) and compiled with no issues. +1 Guozhang On Fri, Apr 8, 2022 at 9:18 AM Tom Bentley wrote: > Hello Kafka users, developers and client-developers, > > This is the first candidate for release of Apache

Re: Move all partitions from one log.dir to another

2022-04-12 Thread Fares Oueslati
Thanks Luke for your answer. Are you aware of any way to throttle the movement of data between disks? The —throttle option of the ˋKafka-reassign-partitions` allows to throttle inter broker throughput only. Le jeu. 7 avr. 2022 à 05:11, Luke Chen a écrit : > Hi Fares, > > I don't know if there

Re: [VOTE] 3.1.1 RC0

2022-04-12 Thread David Jacot
Hi Tom, Thanks for running the release. I wonder if we should include: https://github.com/apache/kafka/commit/134c432d6452de1bfb99d0f6b455a58c16bc626a. This is a follow up of KAFKA-13794. What do you think? Best, David On Fri, Apr 8, 2022 at 6:18 PM Tom Bentley wrote: > > Hello Kafka users, de

Re: [VOTE] 3.1.1 RC0

2022-04-12 Thread Luke Chen
Thanks for pointing that out, David. +1 to include this PR since we've already included the first fix for KAFKA-13794, and this is a follow up fix for it. Thank you. Luke On Wed, Apr 13, 2022 at 2:31 AM David Jacot wrote: > Hi Tom, > > Thanks for running the release. I wonder if we should inclu

Re: Move all partitions from one log.dir to another

2022-04-12 Thread Luke Chen
Hi Fares, > Are you aware of any way to throttle the movement of data between disks? Interesting question! We've never considered the throttle in disk IO. Does it impact the normal throughput a lot? Thank you. Luke On Wed, Apr 13, 2022 at 1:50 AM Fares Oueslati wrote: > Thanks Luke for your a

Re: Move all partitions from one log.dir to another

2022-04-12 Thread Fares Oueslati
Hi Luke, For now I’m validating the operation on a 3 brokers test cluster with ~50Gb of data on a single topic (generated using kafka-producer-perf-test.sh) with one test producer that is reporting a spike of latency during the operation, going from 2ms on average to 2 seconds. I’m using ssd disks