Re: RemoteStorageManager.fetchLogSegment - how to deal with InterruptedException?

Hi, Is there a possibility to keep fetching segments instead of cancelling the underlying request? The reason I'm asking is that with the current implementation (I'm using aiven s3 plugin) there is a possibility that consumer never make any progress if the fetch.max.wait.ms is set too low and they

Re: [DISCUSS] KIP-956: Tiered Storage Quotas

Hi, I see that the ticket has been left untouched since a while now. Should it be included in the tiered storage v1? We've observed that lacking a way to throttle uploads to tiered storage has a major impact on producers and consumers when tiered storage access recovers (starving disk IOps/through

Problematic new HWM increment behaviour introduced by KIP-207 and KIP-966

We identified a bug/new behaviour that would lead to consumer lagging for a long time and ListOffsets requests failing during that time frame. While the ListOffsets requests failure is expected and has been introduced by KIP-207

Re: [VOTE] KIP-1058: Txn consumer exerts pressure on remote storage when reading non-txn topic

Could we vote on this? This is causing a bunch of tiered storage read issues as many consumers default to READ_COMMITTED (eg. librdkafka) Thanks, F. On Mon, Sep 16, 2024 at 7:20 AM Kamal Chandraprakash < kamal.chandraprak...@gmail.com> wrote: > Bumping this thread for vote. PTAL. > > On Mon, Sep

[jira] [Resolved] (KAFKA-13872) Partitions are truncated when leader is replaced

[ https://issues.apache.org/jira/browse/KAFKA-13872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Francois Visconte resolved KAFKA-13872. --- Resolution: Won't Fix transitioning to won't fix as this seems th

[jira] [Created] (KAFKA-15477) Kafka won't shutdown when deleting remote segment

Francois Visconte created KAFKA-15477: - Summary: Kafka won't shutdown when deleting remote segment Key: KAFKA-15477 URL: https://issues.apache.org/jira/browse/KAFKA-15477 Project:

[jira] [Created] (KAFKA-15525) Segment uploads stop working following a broker failure

Francois Visconte created KAFKA-15525: - Summary: Segment uploads stop working following a broker failure Key: KAFKA-15525 URL: https://issues.apache.org/jira/browse/KAFKA-15525 Project: Kafka

[jira] [Created] (KAFKA-15802) Trying to access uncopied segments metadata on listOffsets

Francois Visconte created KAFKA-15802: - Summary: Trying to access uncopied segments metadata on listOffsets Key: KAFKA-15802 URL: https://issues.apache.org/jira/browse/KAFKA-15802 Project: Kafka

[jira] [Created] (KAFKA-16890) Failing to build aux state on broker failover

Francois Visconte created KAFKA-16890: - Summary: Failing to build aux state on broker failover Key: KAFKA-16890 URL: https://issues.apache.org/jira/browse/KAFKA-16890 Project: Kafka

[jira] [Created] (KAFKA-16895) RemoteCopyLagSegments metric taking active segment into account

Francois Visconte created KAFKA-16895: - Summary: RemoteCopyLagSegments metric taking active segment into account Key: KAFKA-16895 URL: https://issues.apache.org/jira/browse/KAFKA-16895 Project

[jira] [Created] (KAFKA-17184) Remote index cache noisy logging

Francois Visconte created KAFKA-17184: - Summary: Remote index cache noisy logging Key: KAFKA-17184 URL: https://issues.apache.org/jira/browse/KAFKA-17184 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-16511) Leaking tiered segments

Francois Visconte created KAFKA-16511: - Summary: Leaking tiered segments Key: KAFKA-16511 URL: https://issues.apache.org/jira/browse/KAFKA-16511 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-13872) Partitions are truncated when leader is replaced

Francois Visconte created KAFKA-13872: - Summary: Partitions are truncated when leader is replaced Key: KAFKA-13872 URL: https://issues.apache.org/jira/browse/KAFKA-13872 Project: Kafka

[jira] [Created] (KAFKA-2624) Truncate warn message logged after truncating partitions

Francois Visconte created KAFKA-2624: Summary: Truncate warn message logged after truncating partitions Key: KAFKA-2624 URL: https://issues.apache.org/jira/browse/KAFKA-2624 Project: Kafka

[jira] [Updated] (KAFKA-2624) Truncate warn message logged after truncating partitions

[ https://issues.apache.org/jira/browse/KAFKA-2624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Francois Visconte updated KAFKA-2624: - Priority: Trivial (was: Major) > Truncate warn message logged after truncat

[jira] [Created] (KAFKA-17678) Problematic new HWM increment behaviour introduced by KIP-207 and KIP-966

Francois Visconte created KAFKA-17678: - Summary: Problematic new HWM increment behaviour introduced by KIP-207 and KIP-966 Key: KAFKA-17678 URL: https://issues.apache.org/jira/browse/KAFKA-17678