[jira] [Created] (KAFKA-12671) Out of order processing with a transactional producer can lead to a stuck LastStableOffset

2021-04-15 Thread Travis Bischel (Jira)
Travis Bischel created KAFKA-12671: -- Summary: Out of order processing with a transactional producer can lead to a stuck LastStableOffset Key: KAFKA-12671 URL: https://issues.apache.org/jira/browse/KAFKA-12671

Re: [VOTE] 2.6.2 RC1

2021-04-15 Thread Tom Bentley
Hi Sophie, I have verified the signatures and checksums, built from source jars, ran the tests. +1 (non-binding). Many thanks, Tom On Thu, Apr 15, 2021 at 12:24 AM John Roesler wrote: > I verified the signatures and checksums, ran the tests, and > spot-checked the license. > > I'm +1 (bindin

[VOTE] KIP-727 Add --under-preferred-replica-partitions option to describe topics command

2021-04-15 Thread wenbing shen
Hi all, I'd like to start a vote on KIP-727 to add two options (--non-preferred-leader and --non-preferred-leader-json) in TopicCommand to directly get the list of partitions whose leader is in the non-preferred replica and support to output it to json format. https://cwiki.apache.org/confluen

Re: [VOTE] KIP-732: Deprecate eos-alpha and replace eos-beta with eos-v2

2021-04-15 Thread Bruno Cadonna
Sophie, Thank you for the KIP! +1 (binding) Best, Bruno On 15.04.21 01:59, Sophie Blee-Goldman wrote: Hey all, I'd like to kick off the vote on KIP-732, to deprecate eos-alpha in Kafka Streams and migrate away from the "eos-beta" terminology by replacing it with "eos-v2" to shore up user con

Re: [VOTE] KIP-732: Deprecate eos-alpha and replace eos-beta with eos-v2

2021-04-15 Thread Ismael Juma
Thanks for the KIP, +1 (binding). On Wed, Apr 14, 2021 at 4:59 PM Sophie Blee-Goldman wrote: > Hey all, > > I'd like to kick off the vote on KIP-732, to deprecate eos-alpha in Kafka > Streams and migrate away from the "eos-beta" terminology by replacing it > with "eos-v2" to shore up user confid

Re: [VOTE] 2.6.2 RC1

2021-04-15 Thread Bill Bejeck
Sophie, thanks for running the release. I verified the signatures checksums, built from source, and ran the unit tests. +1(binding) -Bill On Thu, Apr 15, 2021 at 9:19 AM Tom Bentley wrote: > Hi Sophie, > > I have verified the signatures and checksums, built from source jars, ran > the tests.

Re: [VOTE] KIP-732: Deprecate eos-alpha and replace eos-beta with eos-v2

2021-04-15 Thread John Roesler
Thanks, Sophie, I'm +1 (binding) -John On Wed, 2021-04-14 at 16:59 -0700, Sophie Blee-Goldman wrote: > Hey all, > > I'd like to kick off the vote on KIP-732, to deprecate eos-alpha in Kafka > Streams and migrate away from the "eos-beta" terminology by replacing it > with "eos-v2" to shore up us

Re: [VOTE] KIP-732: Deprecate eos-alpha and replace eos-beta with eos-v2

2021-04-15 Thread Bruno Cadonna
Sophie, Thank you for the KIP! +1 (binding) Best, Bruno On 15.04.21 01:59, Sophie Blee-Goldman wrote: Hey all, I'd like to kick off the vote on KIP-732, to deprecate eos-alpha in Kafka Streams and migrate away from the "eos-beta" terminology by replacing it with "eos-v2" to shore up user con

Re: [DISCUSS] KIP-494 Connect REST Endpoint for Transformations (SMTs) and other Plugins

2021-04-15 Thread Cyrus Vafadari
Hi Tom, Thanks for taking the time to respond with thoughtful questions: 1. I propose HTTP-400, will update the KIP to reflect this proposal 2. I think the schema should be of the same format. It is quite minimal, so there is room to add fields in the future without breaking compatibility. I will

[DISCUSS] KIP-734: Improve AdminClient.listOffsets to return timestamp and offset for the record with the largest timestamp

2021-04-15 Thread Thomas Scott
Hey all, I'd like to open up the discussion on a KIP-734. This adds a new OffsetSpec to AdminClient.listOffsets so that we can easily determine the offset and timestamp of the message with the largest timestamp on a partition. Please give it a look over and let me know what you think. https:

Re: [VOTE] 2.8.0 RC2

2021-04-15 Thread Bill Bejeck
Hi John, Validation steps taken: 1. Validated the signatures and checksums, 2. Built the project from the src tgz file, and ran the unit tests 3. Went through the quickstart and the Kafka Streams quickstart 4. Ran the quickstart for the KRaft module 1. Created a topic 2. P

Re: [VOTE] 2.7.1 RC2

2021-04-15 Thread Bill Bejeck
Mickael, Thanks for running the release. I validated the checksums and signatures, built the project from src, and ran the unit tests. I'm +1(binding). -Bill On Wed, Apr 14, 2021 at 7:31 PM John Roesler wrote: > Hi Mickael, > > I verified the signatures and checksums, ran the tests, and > spo

Re: [DISCUSS] KIP-494 Connect REST Endpoint for Transformations (SMTs) and other Plugins

2021-04-15 Thread Tom Bentley
Hi Cyrus, Re 2: A very minor thing but while type=source|sink for a connector, it doesn't makes sense for the other plugin types, but so the json for those plugins should omit that property rather than have type=null. Apart from that it seems reasonable to me. Thanks again, Tom On Thu, Apr 15,

[jira] [Created] (KAFKA-12672) Running test-kraft-server-start results in error

2021-04-15 Thread Bill Bejeck (Jira)
Bill Bejeck created KAFKA-12672: --- Summary: Running test-kraft-server-start results in error Key: KAFKA-12672 URL: https://issues.apache.org/jira/browse/KAFKA-12672 Project: Kafka Issue Type: Bu

Re: [VOTE] KIP-727 Add --under-preferred-replica-partitions option to describe topics command

2021-04-15 Thread Tom Bentley
Hi Wenbing, Thanks for the KIP, I think this would be a useful addition. +1 (binding). Kind regards, Tom On Thu, Apr 15, 2021 at 2:36 PM wenbing shen wrote: > Hi all, > > I'd like to start a vote on KIP-727 to add two options > (--non-preferred-leader and --non-preferred-leader-json) in Topic

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #41

2021-04-15 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-494 Connect REST Endpoint for Transformations (SMTs) and other Plugins

2021-04-15 Thread Cyrus Vafadari
What do you think of "type" field remaining in, and returning "transformation", "converter" or whatever type it is. This way the schema remains consistent, and you can programmatically understand what plugins are returned on the holistic "GET /plugins" endpoint? It will be slightly redundant in the

Re: [DISCUSS] KIP-716: Allow configuring the location of the offset-syncs topic with MirrorMaker2

2021-04-15 Thread Tom Bentley
Hi Mickael, In Connect distributed mode the KIP says "it's necessary to set the config on both the Source and Checkpoint connectors". There's no way to detect this misconfiguration, because connect just sees two distinct connections. So if the user gets this wrong then the source connector would t

[jira] [Created] (KAFKA-12673) Kafka and zookeeper dependency

2021-04-15 Thread suhas (Jira)
suhas created KAFKA-12673: - Summary: Kafka and zookeeper dependency Key: KAFKA-12673 URL: https://issues.apache.org/jira/browse/KAFKA-12673 Project: Kafka Issue Type: Task Reporter: suhas

Re: [VOTE} KIP-733: change Kafka Streams default replication factor config

2021-04-15 Thread Guozhang Wang
+1 as well. Thanks! On Wed, Apr 14, 2021 at 4:30 PM Bill Bejeck wrote: > Thanks for the KIP Matthias. > > +1 (binding) > > -Bill > > On Wed, Apr 14, 2021 at 7:06 PM Sophie Blee-Goldman > wrote: > > > Thanks Matthias. I'm +1 (binding) > > > > -Sophie > > > > On Wed, Apr 14, 2021 at 3:36 PM Matth

Re: [VOTE] KIP-732: Deprecate eos-alpha and replace eos-beta with eos-v2

2021-04-15 Thread Guozhang Wang
+1 as well (binding). Thanks Sophie! On Thu, Apr 15, 2021 at 7:29 AM Bruno Cadonna wrote: > Sophie, > > Thank you for the KIP! > > +1 (binding) > > Best, > Bruno > > On 15.04.21 01:59, Sophie Blee-Goldman wrote: > > Hey all, > > > > I'd like to kick off the vote on KIP-732, to deprecate eos-alph

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #42

2021-04-15 Thread Apache Jenkins Server
See

Re: [VOTE} KIP-733: change Kafka Streams default replication factor config

2021-04-15 Thread Israel Ekpo
Makes perfect sense to me +1 as well. Thanks Matthias. On Thu, Apr 15, 2021 at 2:41 PM Guozhang Wang wrote: > +1 as well. Thanks! > > On Wed, Apr 14, 2021 at 4:30 PM Bill Bejeck wrote: > > > Thanks for the KIP Matthias. > > > > +1 (binding) > > > > -Bill > > > > On Wed, Apr 14, 2021 at 7:06

Re: [VOTE] KIP-732: Deprecate eos-alpha and replace eos-beta with eos-v2

2021-04-15 Thread Israel Ekpo
1+ I agree. I think besides just merging the changes, specific attention should be brought to the KIP in the 3.0 release through blogs and tutorials to make the community more aware of the change in 3.0, upcoming removal of deprecated features in 4.0, it's prerequisites (broker version etc) and be

Re: [VOTE] 2.8.0 RC2

2021-04-15 Thread Israel Ekpo
I just checked the documentation page and could not find any reference to the KIP-631 configurations like process.roles, node.id and any of the controller.quorum.* configs https://kafka.apache.org/28/documentation.html Were these left out on purpose or should there be included in the 2.8 documenta

Re: [VOTE] 2.8.0 RC2

2021-04-15 Thread Gwen Shapira
Historically, "beta" features were not added to the documentation. I complained that MirrorMaker 2 was missing and I was pointed to the readme... I can't say I love this, but it seems to be The Kafka Way of doing things. So not a release blocker IMO. On Thu, Apr 15, 2021 at 1:46 PM Israel Ekpo w

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #43

2021-04-15 Thread Apache Jenkins Server
See

[GitHub] [kafka-site] afireinside09 opened a new pull request #347: adding New Relic description and media asset to powered-by page

2021-04-15 Thread GitBox
afireinside09 opened a new pull request #347: URL: https://github.com/apache/kafka-site/pull/347 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this se

Re: [VOTE] 2.8.0 RC2

2021-04-15 Thread Israel Ekpo
Thanks for the clarification, Gwen. I was not aware of that. I am new to the process so I am still learning. I have completed my checks and I am comfortable with this release candidate. Voting +1 for this release candidate. On Thu, Apr 15, 2021 at 5:31 PM Gwen Shapira wrote: > Historically,

Re: [VOTE} KIP-733: change Kafka Streams default replication factor config

2021-04-15 Thread Jorge Esteban Quilcate Otoya
+1 Thanks Matthias! On Thu, 15 Apr 2021, 20:48 Israel Ekpo, wrote: > Makes perfect sense to me > > +1 as well. > > Thanks Matthias. > > > On Thu, Apr 15, 2021 at 2:41 PM Guozhang Wang wrote: > > > +1 as well. Thanks! > > > > On Wed, Apr 14, 2021 at 4:30 PM Bill Bejeck wrote: > > > > > Thanks

[jira] [Created] (KAFKA-12674) Client failover takes 2-4 seconds on clean broker shutdown

2021-04-15 Thread Gwen Shapira (Jira)
Gwen Shapira created KAFKA-12674: Summary: Client failover takes 2-4 seconds on clean broker shutdown Key: KAFKA-12674 URL: https://issues.apache.org/jira/browse/KAFKA-12674 Project: Kafka Is

Re: [DISCUSS] KIP-731: Record Rate Limiting for Kafka Connect

2021-04-15 Thread Ryanne Dolan
Bump! On Fri, Apr 9, 2021, 1:41 PM Ryanne Dolan wrote: > Hey y'all, I'd like to draw you attention to a new KIP: > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-731%3A+Record+Rate+Limiting+for+Kafka+Connect > > Lemme know what you think. Thanks! > > Ryanne >

Re: [VOTE] KIP-732: Deprecate eos-alpha and replace eos-beta with eos-v2

2021-04-15 Thread Matthias J. Sax
+1 (binding) On 4/15/21 12:56 PM, Israel Ekpo wrote: > 1+ I agree. > > I think besides just merging the changes, specific attention should be > brought to the KIP in the 3.0 release through blogs and tutorials to make > the community more aware of the change in 3.0, upcoming removal of > deprecat

[jira] [Created] (KAFKA-12675) Improve sticky general assignor scalability and performance

2021-04-15 Thread Luke Chen (Jira)
Luke Chen created KAFKA-12675: - Summary: Improve sticky general assignor scalability and performance Key: KAFKA-12675 URL: https://issues.apache.org/jira/browse/KAFKA-12675 Project: Kafka Issue

[jira] [Created] (KAFKA-12676) Improve sticky general assignor underlying algorithm for the imbalanced case

2021-04-15 Thread Luke Chen (Jira)
Luke Chen created KAFKA-12676: - Summary: Improve sticky general assignor underlying algorithm for the imbalanced case Key: KAFKA-12676 URL: https://issues.apache.org/jira/browse/KAFKA-12676 Project: Kafka

[GitHub] [kafka-site] hachikuji merged pull request #346: Add HolidayCheck to the list of the "Powered By"

2021-04-15 Thread GitBox
hachikuji merged pull request #346: URL: https://github.com/apache/kafka-site/pull/346 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, ple

[GitHub] [kafka-site] hachikuji merged pull request #347: adding New Relic description and media asset to powered-by page

2021-04-15 Thread GitBox
hachikuji merged pull request #347: URL: https://github.com/apache/kafka-site/pull/347 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, ple

[GitHub] [kafka-site] afireinside09 commented on pull request #347: adding New Relic description and media asset to powered-by page

2021-04-15 Thread GitBox
afireinside09 commented on pull request #347: URL: https://github.com/apache/kafka-site/pull/347#issuecomment-820911009 thank you! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 2.8 #14

2021-04-15 Thread Apache Jenkins Server
See

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #44

2021-04-15 Thread Apache Jenkins Server
See Changes: -- [...truncated 407433 lines...] [2021-04-16T06:17:25.429Z] [2021-04-16T06:17:25.429Z] SaslPlainSslEndToEndAuthorizationTest > testProduceConsumeTopicAutoCrea