reviving KIP-723: Add socket.tcp.no.delay property to Kafka Config

092 --include test-topic-. --consumer-property fetch.max.wait.ms=1 --consumer-property heartbeat.interval.ms=2 --consumer-property session.timeout.ms=6 --consumer-property fetch.min.bytes=5 Cheers! Francois

Re: RemoteStorageManager.fetchLogSegment - how to deal with InterruptedException?

Hi, Is there a possibility to keep fetching segments instead of cancelling the underlying request? The reason I'm asking is that with the current implementation (I'm using aiven s3 plugin) there is a possibility that consumer never make any progress if the fetch.max.wait.ms is set too low and they

Re: [PROPOSAL] Add commercial support page on website

Hi Justine, You're right, Kafka is a part of my business (training, consulting, architecture design, sla...) and most of the time, users/customers said that it was hard for them to find a commercial support (in France for my case) after searching on the Kafka website (Google didn't help them).

Re: [PROPOSAL] Add commercial support page on website

s more like a search optimization problem, and thus it seems out-of-scope what we can solve. As I said, I am not strictly against it, but I just don't see much value either. -Matthias On 1/11/24 12:55 PM, Francois Papon wrote: Hi Justine, You're right, Kafka is a part of my

Re: [PROPOSAL] Add commercial support page on website

I am not strictly against it, but I just don't see much value either. -Matthias On 1/11/24 12:55 PM, Francois Papon wrote: Hi Justine, You're right, Kafka is a part of my business (training, consulting, architecture design, sla...) and most of the time, users/customers said that it

Re: [DISCUSS] KIP-956: Tiered Storage Quotas

Hi, I see that the ticket has been left untouched since a while now. Should it be included in the tiered storage v1? We've observed that lacking a way to throttle uploads to tiered storage has a major impact on producers and consumers when tiered storage access recovers (starving disk IOps/through

Problematic new HWM increment behaviour introduced by KIP-207 and KIP-966

We identified a bug/new behaviour that would lead to consumer lagging for a long time and ListOffsets requests failing during that time frame. While the ListOffsets requests failure is expected and has been introduced by KIP-207

Re: [VOTE] KIP-1058: Txn consumer exerts pressure on remote storage when reading non-txn topic

Could we vote on this? This is causing a bunch of tiered storage read issues as many consumers default to READ_COMMITTED (eg. librdkafka) Thanks, F. On Mon, Sep 16, 2024 at 7:20 AM Kamal Chandraprakash < kamal.chandraprak...@gmail.com> wrote: > Bumping this thread for vote. PTAL. > > On Mon, Sep

[jira] [Resolved] (KAFKA-13872) Partitions are truncated when leader is replaced

[ https://issues.apache.org/jira/browse/KAFKA-13872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Francois Visconte resolved KAFKA-13872. --- Resolution: Won't Fix transitioning to won't fix as this seems th

[jira] [Created] (KAFKA-15477) Kafka won't shutdown when deleting remote segment

Francois Visconte created KAFKA-15477: - Summary: Kafka won't shutdown when deleting remote segment Key: KAFKA-15477 URL: https://issues.apache.org/jira/browse/KAFKA-15477 Project:

[jira] [Created] (KAFKA-15525) Segment uploads stop working following a broker failure

Francois Visconte created KAFKA-15525: - Summary: Segment uploads stop working following a broker failure Key: KAFKA-15525 URL: https://issues.apache.org/jira/browse/KAFKA-15525 Project: Kafka

[jira] [Created] (KAFKA-15802) Trying to access uncopied segments metadata on listOffsets

Francois Visconte created KAFKA-15802: - Summary: Trying to access uncopied segments metadata on listOffsets Key: KAFKA-15802 URL: https://issues.apache.org/jira/browse/KAFKA-15802 Project: Kafka

[jira] [Created] (KAFKA-16890) Failing to build aux state on broker failover

Francois Visconte created KAFKA-16890: - Summary: Failing to build aux state on broker failover Key: KAFKA-16890 URL: https://issues.apache.org/jira/browse/KAFKA-16890 Project: Kafka

[jira] [Created] (KAFKA-16895) RemoteCopyLagSegments metric taking active segment into account

Francois Visconte created KAFKA-16895: - Summary: RemoteCopyLagSegments metric taking active segment into account Key: KAFKA-16895 URL: https://issues.apache.org/jira/browse/KAFKA-16895 Project

[jira] [Created] (KAFKA-17184) Remote index cache noisy logging

Francois Visconte created KAFKA-17184: - Summary: Remote index cache noisy logging Key: KAFKA-17184 URL: https://issues.apache.org/jira/browse/KAFKA-17184 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-16511) Leaking tiered segments

Francois Visconte created KAFKA-16511: - Summary: Leaking tiered segments Key: KAFKA-16511 URL: https://issues.apache.org/jira/browse/KAFKA-16511 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-10099) Kerberos authentication sets java authrizedId to authenticationId not autherizationId

Francois Fernando created KAFKA-10099: - Summary: Kerberos authentication sets java authrizedId to authenticationId not autherizationId Key: KAFKA-10099 URL: https://issues.apache.org/jira/browse/KAFKA-10099

[jira] [Created] (KAFKA-13872) Partitions are truncated when leader is replaced

Francois Visconte created KAFKA-13872: - Summary: Partitions are truncated when leader is replaced Key: KAFKA-13872 URL: https://issues.apache.org/jira/browse/KAFKA-13872 Project: Kafka

[jira] [Created] (KAFKA-2624) Truncate warn message logged after truncating partitions

Francois Visconte created KAFKA-2624: Summary: Truncate warn message logged after truncating partitions Key: KAFKA-2624 URL: https://issues.apache.org/jira/browse/KAFKA-2624 Project: Kafka

[jira] [Updated] (KAFKA-2624) Truncate warn message logged after truncating partitions

[ https://issues.apache.org/jira/browse/KAFKA-2624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Francois Visconte updated KAFKA-2624: - Priority: Trivial (was: Major) > Truncate warn message logged after truncat

[jira] [Created] (KAFKA-17678) Problematic new HWM increment behaviour introduced by KIP-207 and KIP-966

Francois Visconte created KAFKA-17678: - Summary: Problematic new HWM increment behaviour introduced by KIP-207 and KIP-966 Key: KAFKA-17678 URL: https://issues.apache.org/jira/browse/KAFKA-17678

[jira] [Resolved] (KAFKA-1889) Refactor shell wrapper scripts

[ https://issues.apache.org/jira/browse/KAFKA-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Francois Saint-Jacques resolved KAFKA-1889. --- Resolution: Won't Fix > Refactor shell wrapper

[jira] [Updated] (KAFKA-1889) Refactor shell wrapper scripts

[ https://issues.apache.org/jira/browse/KAFKA-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Francois Saint-Jacques updated KAFKA-1889: -- Attachment: refactor-scripts-v1.patch > Refactor shell wrapper scri

[jira] [Created] (KAFKA-1889) Refactor shell wrapper scripts

Francois Saint-Jacques created KAFKA-1889: - Summary: Refactor shell wrapper scripts Key: KAFKA-1889 URL: https://issues.apache.org/jira/browse/KAFKA-1889 Project: Kafka Issue Type

[jira] [Comment Edited] (KAFKA-1889) Refactor shell wrapper scripts

[ https://issues.apache.org/jira/browse/KAFKA-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14286006#comment-14286006 ] Francois Saint-Jacques edited comment on KAFKA-1889 at 1/21/15 6:2

[jira] [Commented] (KAFKA-1889) Refactor shell wrapper scripts

[ https://issues.apache.org/jira/browse/KAFKA-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14286006#comment-14286006 ] Francois Saint-Jacques commented on KAFKA-1889: --- I have multiple o

[jira] [Updated] (KAFKA-1889) Refactor shell wrapper scripts

[ https://issues.apache.org/jira/browse/KAFKA-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Francois Saint-Jacques updated KAFKA-1889: -- Assignee: Francois Saint-Jacques Status: Patch Available (was: Open

[jira] [Updated] (KAFKA-1889) Refactor shell wrapper scripts

[ https://issues.apache.org/jira/browse/KAFKA-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Francois Saint-Jacques updated KAFKA-1889: -- Attachment: refactor-scripts-v2.patch > Refactor shell wrapper scri

[jira] [Commented] (KAFKA-1889) Refactor shell wrapper scripts

[ https://issues.apache.org/jira/browse/KAFKA-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14286097#comment-14286097 ] Francois Saint-Jacques commented on KAFKA-1889: --- The second patch sh

[jira] [Comment Edited] (KAFKA-1889) Refactor shell wrapper scripts

[ https://issues.apache.org/jira/browse/KAFKA-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14286097#comment-14286097 ] Francois Saint-Jacques edited comment on KAFKA-1889 at 1/21/15 7:1

[jira] [Updated] (KAFKA-1889) Refactor shell wrapper scripts

[ https://issues.apache.org/jira/browse/KAFKA-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Francois Saint-Jacques updated KAFKA-1889: -- Status: Open (was: Patch Available) > Refactor shell wrapper scri

[jira] [Commented] (KAFKA-1889) Refactor shell wrapper scripts

[ https://issues.apache.org/jira/browse/KAFKA-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288120#comment-14288120 ] Francois Saint-Jacques commented on KAFKA-1889: --- My goal is to fix

[jira] [Commented] (KAFKA-1889) Refactor shell wrapper scripts

[ https://issues.apache.org/jira/browse/KAFKA-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288193#comment-14288193 ] Francois Saint-Jacques commented on KAFKA-1889: --- It's not abou

[jira] [Commented] (KAFKA-1889) Refactor shell wrapper scripts

[ https://issues.apache.org/jira/browse/KAFKA-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288205#comment-14288205 ] Francois Saint-Jacques commented on KAFKA-1889: --- Also note that this p

[jira] [Commented] (KAFKA-1889) Refactor shell wrapper scripts

[ https://issues.apache.org/jira/browse/KAFKA-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14291967#comment-14291967 ] Francois Saint-Jacques commented on KAFKA-1889: --- Do you think it could

[jira] [Commented] (KAFKA-1367) Broker topic metadata not kept in sync with ZooKeeper

[ https://issues.apache.org/jira/browse/KAFKA-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14309966#comment-14309966 ] Francois Saint-Jacques commented on KAFKA-1367: --- Instead of sile

[jira] [Created] (KAFKA-1781) Readme should specify that Gradle 2.0 is required for initial bootstrap

Jean-Francois Im created KAFKA-1781: --- Summary: Readme should specify that Gradle 2.0 is required for initial bootstrap Key: KAFKA-1781 URL: https://issues.apache.org/jira/browse/KAFKA-1781 Project

[jira] [Updated] (KAFKA-1781) Readme should specify that Gradle 2.0 is required for initial bootstrap

[ https://issues.apache.org/jira/browse/KAFKA-1781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Francois Im updated KAFKA-1781: Attachment: gradle-2.0-readme.patch Documentation patch that changes README.md to say &quo

[jira] [Commented] (KAFKA-1781) Readme should specify that Gradle 2.0 is required for initial bootstrap

[ https://issues.apache.org/jira/browse/KAFKA-1781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14214969#comment-14214969 ] Jean-Francois Im commented on KAFKA-1781: - It doesn't seem to work

[jira] [Commented] (KAFKA-1781) Readme should specify that Gradle 2.0 is required for initial bootstrap

[ https://issues.apache.org/jira/browse/KAFKA-1781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14215013#comment-14215013 ] Jean-Francois Im commented on KAFKA-1781: - It is weird! This is what I

[jira] [Commented] (KAFKA-1781) Readme should specify that Gradle 2.0 is required for initial bootstrap

[ https://issues.apache.org/jira/browse/KAFKA-1781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14215036#comment-14215036 ] Jean-Francois Im commented on KAFKA-1781: - It seems to work with 1.8 and 1.1

[jira] [Commented] (KAFKA-1781) Readme should specify that Gradle 2.0 is required for initial bootstrap

[ https://issues.apache.org/jira/browse/KAFKA-1781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14215074#comment-14215074 ] Jean-Francois Im commented on KAFKA-1781: - I think the two are related to J

[jira] [Commented] (KAFKA-1781) Readme should specify that Gradle 2.0 is required for initial bootstrap

[ https://issues.apache.org/jira/browse/KAFKA-1781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14215079#comment-14215079 ] Jean-Francois Im commented on KAFKA-1781: - Also, see https://issues.gradle

[jira] [Updated] (KAFKA-1783) Missing slash in documentation for the Zookeeper paths in ZookeeperConsumerConnector

[ https://issues.apache.org/jira/browse/KAFKA-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Francois Im updated KAFKA-1783: Attachment: kafka-missing-doc-slash.patch Patch that adds the missing slash for the

[jira] [Created] (KAFKA-1783) Missing slash in documentation for the Zookeeper paths in ZookeeperConsumerConnector

Jean-Francois Im created KAFKA-1783: --- Summary: Missing slash in documentation for the Zookeeper paths in ZookeeperConsumerConnector Key: KAFKA-1783 URL: https://issues.apache.org/jira/browse/KAFKA-1783

[jira] [Created] (KAFKA-1081) kafka-run-class.sh is broken

Francois Saint-Jacques created KAFKA-1081: - Summary: kafka-run-class.sh is broken Key: KAFKA-1081 URL: https://issues.apache.org/jira/browse/KAFKA-1081 Project: Kafka Issue Type: Bug

[jira] [Commented] (KAFKA-1081) kafka-run-class.sh is broken

[ https://issues.apache.org/jira/browse/KAFKA-1081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13791819#comment-13791819 ] Francois Saint-Jacques commented on KAFKA-1081: --- Look for the 3 last l

[jira] [Commented] (KAFKA-1081) kafka-run-class.sh is broken

[ https://issues.apache.org/jira/browse/KAFKA-1081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13791870#comment-13791870 ] Francois Saint-Jacques commented on KAFKA-1081: --- Look, this is an ugly

[jira] [Commented] (KAFKA-1081) kafka-run-class.sh is broken

[ https://issues.apache.org/jira/browse/KAFKA-1081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13791901#comment-13791901 ] Francois Saint-Jacques commented on KAFKA-1081: --- I know you guys ha

[jira] [Updated] (KAFKA-1084) Validate properties for custom serializers

[ https://issues.apache.org/jira/browse/KAFKA-1084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Francois Saint-Jacques updated KAFKA-1084: -- Attachment: validate-external-properties.patch > Validate properties

[jira] [Created] (KAFKA-1084) Validate properties for custom serializers

Francois Saint-Jacques created KAFKA-1084: - Summary: Validate properties for custom serializers Key: KAFKA-1084 URL: https://issues.apache.org/jira/browse/KAFKA-1084 Project: Kafka

[jira] [Commented] (KAFKA-1084) Validate properties for custom serializers

[ https://issues.apache.org/jira/browse/KAFKA-1084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13795202#comment-13795202 ] Francois Saint-Jacques commented on KAFKA-1084: --- I believe a warning

[jira] [Created] (KAFKA-1115) producer performance affected by trace/debug calls

Francois Saint-Jacques created KAFKA-1115: - Summary: producer performance affected by trace/debug calls Key: KAFKA-1115 URL: https://issues.apache.org/jira/browse/KAFKA-1115 Project: Kafka

[jira] [Updated] (KAFKA-1115) producer performance affected by trace/debug calls

[ https://issues.apache.org/jira/browse/KAFKA-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Francois Saint-Jacques updated KAFKA-1115: -- Status: Patch Available (was: Open) > producer performance affected by tr

[jira] [Updated] (KAFKA-1115) producer performance affected by trace/debug calls

[ https://issues.apache.org/jira/browse/KAFKA-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Francois Saint-Jacques updated KAFKA-1115: -- Attachment: producer-performance-fix.patch > producer performance affected

[jira] [Updated] (KAFKA-1115) producer performance affected by trace/debug calls

[ https://issues.apache.org/jira/browse/KAFKA-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Francois Saint-Jacques updated KAFKA-1115: -- Status: Open (was: Patch Available) > producer performance affected by tr

[jira] [Commented] (KAFKA-1115) producer performance affected by trace/debug calls

[ https://issues.apache.org/jira/browse/KAFKA-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13811759#comment-13811759 ] Francois Saint-Jacques commented on KAFKA-1115: --- This is not the pro

[jira] [Commented] (KAFKA-1115) producer performance affected by trace/debug calls

[ https://issues.apache.org/jira/browse/KAFKA-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13812550#comment-13812550 ] Francois Saint-Jacques commented on KAFKA-1115: --- You are right, an