[jira] [Created] (KAFKA-8571) Not complete delayed produce requests when processing StopReplicaRequest causing high produce latency for acks=all

Zhanxiang (Patrick) Huang created KAFKA-8571: Summary: Not complete delayed produce requests when processing StopReplicaRequest causing high produce latency for acks=all Key: KAFKA-8571 URL: https://is

Partition Reassignment in Cloud

Hi I have been trying a small experiment with partition reassignment in cloud. where instead of copying data between brokers using network, I moved the disk between the 2 brokers and ran the partition reassignment. This actually increased the speed of partition reassignment significantly. (As i

Partition Reassignment in Cloud

Hi I have been trying a small experiment with partition reassignment in cloud. where instead of copying data between brokers using network, I moved the disk between the 2 brokers and ran the partition reassignment. This actually increased the speed of partition reassignment significantly. (As i

Jenkins build is back to normal : kafka-2.3-jdk8 #54

See

[jira] [Created] (KAFKA-8570) Downconversion could fail when log contains out of order message formats

Dhruvil Shah created KAFKA-8570: --- Summary: Downconversion could fail when log contains out of order message formats Key: KAFKA-8570 URL: https://issues.apache.org/jira/browse/KAFKA-8570 Project: Kafka

Build failed in Jenkins: kafka-2.2-jdk8 #140

See Changes: [jason] KAFKA-8564; Fix NPE on deleted partition dir when no segments remain -- [...truncated 2.75 MB...] kafka.controller.PartitionLeaderElectionAlgorithmsTest

Build failed in Jenkins: kafka-trunk-jdk11 #645

See Changes: [jason] KAFKA-8564; Fix NPE on deleted partition dir when no segments remain -- [...truncated 2.68 MB...] org.apache.kafka.connect.transforms.CastTest > cast

Build failed in Jenkins: kafka-trunk-jdk8 #3737

See Changes: [jason] KAFKA-8564; Fix NPE on deleted partition dir when no segments remain -- [...truncated 2.51 MB...] org.apache.kafka.streams.test.OutputVerifierTest >

Jenkins build is back to normal : kafka-2.1-jdk8 #206

See

[VOTE] 2.3.0 RC3

Hi all, We discovered some problems with the second release candidate (RC2) of 2.3.0. Specifically, KAFKA-8564. I've created a new RC which includes the fix for this issue. Check out the release notes for the 2.3.0 release here: https://home.apache.org/~cmccabe/kafka-2.3.0-rc3/RELEASE_NOTES.h

Build failed in Jenkins: kafka-trunk-jdk8 #3736

See Changes: [bbejeck] KAFKA-8452: Compressed BufferValue review follow-up (#6940) -- [...truncated 4.67 MB...] org.apache.kafka.streams.test.OutputVerifierTest > shouldF

Re: [VOTE] KIP-471: Expose RocksDB Metrics in Kafka Streams

+1 (non-binding) Thanks! Best regards Patrik > Am 19.06.2019 um 21:55 schrieb Bill Bejeck : > > +1 (binding) > > Thanks, > Bill > >> On Wed, Jun 19, 2019 at 1:19 PM John Roesler wrote: >> >> I'm +1 (nonbinding) >> >> Thanks! >> -John >> >>> On Tue, Jun 18, 2019 at 7:48 AM Bruno Cadonna w

[jira] [Resolved] (KAFKA-7857) Add AbstractCoordinatorConfig class to consolidate consumer coordinator configs between Consumer and Connect

[ https://issues.apache.org/jira/browse/KAFKA-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Chen resolved KAFKA-7857. Resolution: Fixed [https://github.com/apache/kafka/pull/6854] fixes it > Add AbstractCoordinatorCo

Build failed in Jenkins: kafka-trunk-jdk11 #644

See Changes: [bbejeck] KAFKA-8452: Compressed BufferValue review follow-up (#6940) -- [...truncated 2.52 MB...] org.apache.kafka.connect.transforms.MaskFieldTest > schemal

[jira] [Created] (KAFKA-8569) Integrate the poll timeout warning with leave group call

Boyang Chen created KAFKA-8569: -- Summary: Integrate the poll timeout warning with leave group call Key: KAFKA-8569 URL: https://issues.apache.org/jira/browse/KAFKA-8569 Project: Kafka Issue Type

[jira] [Resolved] (KAFKA-8500) member.id should always update upon static member rejoin despite of group state

[ https://issues.apache.org/jira/browse/KAFKA-8500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Chen resolved KAFKA-8500. Resolution: Fixed > member.id should always update upon static member rejoin despite of group > st

Re: [VOTE] KIP-471: Expose RocksDB Metrics in Kafka Streams

+1 (binding) Thanks, Bill On Wed, Jun 19, 2019 at 1:19 PM John Roesler wrote: > I'm +1 (nonbinding) > > Thanks! > -John > > On Tue, Jun 18, 2019 at 7:48 AM Bruno Cadonna wrote: > > > > Hi, > > > > I would like to start the voting on KIP-471: > > > https://cwiki.apache.org/confluence/display/KA

Re: [DISCUSS] KIP-471: Expose RocksDB Metrics in Kafka Streams

Hi Bruno, Just getting caught up on this KIP thread. Looks good to me, and I don't have any additional comments to what's already been presented. Thanks, Bill On Wed, Jun 19, 2019 at 1:42 PM Bruno Cadonna wrote: > John and Guozhang, > > thank you for your comments. > > @Guozhang could you ple

Re: [DISCUSS] KIP-478 Strongly Typed Processor API

Hi all, In response to the feedback so far, I changed the package name from `processor2` to `processor.generic`. Thanks, -John On Mon, Jun 17, 2019 at 4:49 PM John Roesler wrote: > > Thanks for the feedback, Sophie! > > I actually felt a little uneasy when I wrote that remark, because it's > no

Re: [DISCUSS] KIP-479: Add Materialized to Join

Hi Bill, Thanks for the KIP! Awesome job catching this unexpected consequence of the prior KIPs before it was released. The proposal looks good to me. On top of just fixing the problem, it seems to address two other pain points: * that naming a state store automatically causes it to become queria

Re: Become a contributer

Hi, Garvit, Thanks for your interest. Added you to the contributor list. Jun On Wed, Jun 19, 2019 at 10:18 AM Garvit Sharma wrote: > Hi, > > I would like to contribute to Apache Kafka, Could you please give me > contributor permission? > JIRA ID: garvitlnmiit > Github ID: garvitlnmiit > Github

[jira] [Resolved] (KAFKA-1889) Refactor shell wrapper scripts

[ https://issues.apache.org/jira/browse/KAFKA-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Francois Saint-Jacques resolved KAFKA-1889. --- Resolution: Won't Fix > Refactor shell wrapper scripts >

Re: [DISCUSS] KIP-471: Expose RocksDB Metrics in Kafka Streams

John and Guozhang, thank you for your comments. @Guozhang could you please also vote on the voting thread so that we have all votes in one place. @John, the only situation I can think of where a non-uniform configuration of segments would make sense is to account for seasonality. But this would

Re: [VOTE] 2.3.0 RC2

Hi Ismael, Good find. Yes, I think this qualifies as a blocker. Let's sink this R I'll create an RC3 today with the fix. best, Colin On Wed, Jun 19, 2019, at 08:12, Ismael Juma wrote: > Hi Colin, > > Thanks for this. One potential blocker (recent regression in the log layer) > was filed yes

Re: [VOTE] KIP-471: Expose RocksDB Metrics in Kafka Streams

I'm +1 (nonbinding) Thanks! -John On Tue, Jun 18, 2019 at 7:48 AM Bruno Cadonna wrote: > > Hi, > > I would like to start the voting on KIP-471: > https://cwiki.apache.org/confluence/display/KAFKA/KIP-471%3A+Expose+RocksDB+Metrics+in+Kafka+Streams > > You can find the discussion here: > https://l

Become a contributer

Hi, I would like to contribute to Apache Kafka, Could you please give me contributor permission? JIRA ID: garvitlnmiit Github ID: garvitlnmiit Github Email: garvit...@gmail.com Thanks, -- Garvit Sharma github.com/garvitlnmiit/ No Body is a Scholar by birth, its only hard work and strong deter

Re: [DISCUSS] KIP-471: Expose RocksDB Metrics in Kafka Streams

One last thought. I think it makes sense what you propose for merging the metrics when a logical store is composed of multiple physical stores. The basic standard for these metrics is that they should be relevant to performance, and they should be controllable via configurations, specifically via

Re: [DISCUSS] KIP-471: Expose RocksDB Metrics in Kafka Streams

Bruno, thanks for the clarification. I agree that we should not rely on parsing strings to expose as metrics since they are 1) not very reliable and also 2) may evolve its format / representation over time. I think we can potentially add some documentations aligned with your explanations above to

Re: [DISCUSS] KIP-471: Expose RocksDB Metrics in Kafka Streams

Just taking a look over the metrics again, I had one thought... Stuff that happens in a background thread (like compaction metrics) can't directly identify compactions as a bottleneck from Streams' perspective. I.e., a DB might do a lot of compactions, but if those compactions never delay a write

Re: [DISCUSS] KIP-471: Expose RocksDB Metrics in Kafka Streams

Thanks for the updates. Personally, I'd be in favor of not going out on a limb with unsupported metrics APIs. We should take care to make sure that what we add in KIP-471 is stable and well supported, even if it's not the complete picture. We can always do follow-on work to tackle complex metrics

Re: Github PR 5454 needs a review/merge (Scala 2.13 gradle build)

I added a comment. On Wed, Jun 19, 2019 at 8:10 AM Dejan Stojadinović wrote: > Skip to this comment, please: > https://github.com/apache/kafka/pull/5454#issuecomment-501969180 > > Regards, > Dejan >

Re: [VOTE] 2.3.0 RC2

Hi Colin, Thanks for this. One potential blocker (recent regression in the log layer) was filed yesterday: https://issues.apache.org/jira/browse/KAFKA-8564 Do you think this qualifies as a blocker? Ismael On Wed, Jun 12, 2019 at 3:55 PM Colin McCabe wrote: > Hi all, > > We discovered some pr

Github PR 5454 needs a review/merge (Scala 2.13 gradle build)

Skip to this comment, please: https://github.com/apache/kafka/pull/5454#issuecomment-501969180 Regards, Dejan

Re: Preliminary blog post for the Apache Kafka 2.3.0 release

Looks great, Colin. I have also enjoyed Stephane Maarek's "What's New in Kafka..." series of videos (e.g. https://www.youtube.com/watch?v=kaWbp1Cnfo4&t=10s). Having summaries like this in both formats -- blog and video -- for every release would be helpful as different people have different prefe

[jira] [Created] (KAFKA-8568) MirrorMaker 2.0 resource leak

Péter Gergő Barna created KAFKA-8568: Summary: MirrorMaker 2.0 resource leak Key: KAFKA-8568 URL: https://issues.apache.org/jira/browse/KAFKA-8568 Project: Kafka Issue Type: Bug

Build failed in Jenkins: kafka-trunk-jdk8 #3735

See Changes: [ismael] KAFKA-8559: Allocate ArrayList with correct size in PartitionStates -- [...truncated 2.14 MB...] kafka.log.LogCleanerParameterizedIntegrationTest > c

Re: [DISCUSS] KIP-471: Expose RocksDB Metrics in Kafka Streams

Hi Guozhang, Regarding your comments about the wiki page: 1) Exactly, I rephrased the paragraph to make it more clear. 2) Yes, I used the wrong term. All hit related metrics are ratios. I corrected the names of the affected metrics. Regarding your meta comments: 1) The plan is to expose the hi

[jira] [Created] (KAFKA-8567) Application kafka-configs.sh can’t describe the confings of a topic

Alvaro Peris created KAFKA-8567: --- Summary: Application kafka-configs.sh can’t describe the confings of a topic Key: KAFKA-8567 URL: https://issues.apache.org/jira/browse/KAFKA-8567 Project: Kafka

Re: [DISCUSS] KIP-455: Create an Administrative API for Replica Reassignment

Hey there Colin, Thanks for the work on this KIP. It is a much-needed improvement and I'm excited to see it. Sorry for coming in so late to the discussion, I have one question to better understand the change and a small suggestion. I see we allow reassignment cancellation at the partition level -

[jira] [Created] (KAFKA-8566) Force Topic Deletion

Viktor Somogyi-Vass created KAFKA-8566: -- Summary: Force Topic Deletion Key: KAFKA-8566 URL: https://issues.apache.org/jira/browse/KAFKA-8566 Project: Kafka Issue Type: Improvement Af

[jira] [Created] (KAFKA-8565) Random IllegalStateException in producer

Patrick Oswald created KAFKA-8565: - Summary: Random IllegalStateException in producer Key: KAFKA-8565 URL: https://issues.apache.org/jira/browse/KAFKA-8565 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-8564) NullPointerException when loading logs at startup

Mickael Maison created KAFKA-8564: - Summary: NullPointerException when loading logs at startup Key: KAFKA-8564 URL: https://issues.apache.org/jira/browse/KAFKA-8564 Project: Kafka Issue Type:

Jenkins build is back to normal : kafka-trunk-jdk11 #643

See