Re: Logging configuration to see from which AZ consumers are fetching data in AWS environment

2024-10-30 Thread Ömer Şiar Baysal
Hi, The log shown on the blog post was for the console consumer tool. These log messages emitted for the consumer process so you need to configure log4j configuration for the kafka tools if you want to achieve the same thing. The functionality provided by the KIP-392 is only realized only if cli

Re: [ANNOUNCE] Apache Kafka 3.8.1

2024-10-30 Thread Josep Prat
Hi Jesús, I just fixed the links in the Downloads page. Thanks for reporting it. Best, -- Josep Prat Open Source Engineering Director, Aiven josep.p...@aiven.io | +491715557497 | aiven.io Aiven Deutschland GmbH Alexanderufer 3-7, 10117 Berlin Geschäftsführer: Oskari Saarenmaa

Re: [ANNOUNCE] Apache Kafka 3.8.1

2024-10-30 Thread Jesus Cea
On 30/10/24 18:15, Jesus Cea wrote: On 29/10/24 15:23, Josep Prat wrote: The Apache Kafka community is pleased to announce the release for Apache Kafka 3.8.1 This is a bug fix release and it includes fixes and improvements. All of the changes in this release can be found in the release notes:

Re: [ANNOUNCE] Apache Kafka 3.8.1

2024-10-30 Thread Jesus Cea
On 30/10/24 18:18, Jesus Cea wrote: On 30/10/24 18:15, Jesus Cea wrote: On 29/10/24 15:23, Josep Prat wrote: The Apache Kafka community is pleased to announce the release for Apache Kafka 3.8.1 This is a bug fix release and it includes fixes and improvements. All of the changes in this releas

Re: [ANNOUNCE] Apache Kafka 3.8.1

2024-10-30 Thread Jesus Cea
On 29/10/24 15:23, Josep Prat wrote: The Apache Kafka community is pleased to announce the release for Apache Kafka 3.8.1 This is a bug fix release and it includes fixes and improvements. All of the changes in this release can be found in the release notes: https://www.apache.org/dist/kafka/3.8

Logging configuration to see from which AZ consumers are fetching data in AWS environment

2024-10-30 Thread Soham Chakraborty
Hi, We are trying to implement the feature from KIP 392 to allow consumers to fetch from the closest replica. We are using AWS and Kubernetes (kOps) and the consumers do not always fetch from the broker in the same AZ, resulting in cross AZ traffic cost. The entire purpose of this mail/exercise is

Re: Kafka Tiered Storage Disablement Implement in ZK Mode Question

2024-10-30 Thread Luke Chen
Hi Jianfeng, The reason we don't support ZK mode is because the ZK is going to be removed in v4.0.0, so we decided to only implement it in KRaft mode. > I read the source code and seems kafka broker only updates the LogConfig and then invokes maybeUpdateRemoteLogComponents to cancel some tasks. S