[jira] [Created] (KAFKA-12960) WindowStore and SessionStore do not enforce strict retention time

Matthias J. Sax created KAFKA-12960: --- Summary: WindowStore and SessionStore do not enforce strict retention time Key: KAFKA-12960 URL: https://issues.apache.org/jira/browse/KAFKA-12960 Project: Kafk

[jira] [Created] (KAFKA-12959) Prioritize assigning standby tasks to threads without any active tasks

Ravi Bhardwaj created KAFKA-12959: - Summary: Prioritize assigning standby tasks to threads without any active tasks Key: KAFKA-12959 URL: https://issues.apache.org/jira/browse/KAFKA-12959 Project: Kaf

KAFKA-12889 pull request review request

hi kafka devlopers. I have created a jira KAFKA-12889 and a pull requst 10818 for fix log cleaner may left empty segments about every 2^31 messages. It has been about two weeks since the pr, but not got any review. ping some commiter on github but still no response. so, can some one review this

Re: [DISCUSS] KIP-714: Client metrics and observability

Magnus, I think these are arguments for observability in general, but not why kafka should sit between a client and a metics collector. Ryanne On Wed, Jun 16, 2021, 10:27 AM Magnus Edenhill wrote: > Hi Ryanne, > > this proposal stems from a need to improve troubleshooting Kafka issues. > > As i

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #227

See

Re: [VOTE] KIP-633: Drop 24 hour default of grace period in Streams

Quick follow up. I did a small update to the KIP with regard to https://issues.apache.org/jira/browse/KAFKA-12909 Israel, Sophie, and Guozhang did agree to this change. I don't think we need to re-vote. Please let us know if there are any concerns. -Matthias On 4/8/21 9:19 PM, Sophie Blee-Gold

Re: [VOTE] KIP-663: API to Start and Shut Down Stream Threads and to Request Closing of Kafka Streams Clients

Yes. Sorry about this mistake. On 6/16/21 2:29 PM, Israel Ekpo wrote: > Thanks for clarifying that @Sophie it is in regards to KIP-633 > > On Wed, Jun 16, 2021 at 4:00 PM Sophie Blee-Goldman > wrote: > >> Matthias, I'm guessing you meant to send this to the KIP-633 list? This is >> KIP-663 >> >

Re: [DISCUSS] KIP-714: Client metrics and observability

Hi Magnus, Thanks for the KIP. This is certainly something I've been wishing for for a while. Maybe we should emphasize more that the metrics that are being gathered here are Kafka metrics, not general application business logic metrics. That seems like a point of confusion in some of the repl

[jira] [Created] (KAFKA-12958) Add similation invariant for leadership and snapshot

Jose Armando Garcia Sancio created KAFKA-12958: -- Summary: Add similation invariant for leadership and snapshot Key: KAFKA-12958 URL: https://issues.apache.org/jira/browse/KAFKA-12958 Proje

Re: [DISCUSS] KIP-714: Client metrics and observability

On Sun, Jun 13, 2021, at 21:51, Travis Bischel wrote: > Hi! I have a few thoughts on this KIP. First, I'd like to thank you for > the writeup, > clearly a lot of thought has gone into it and it is very thorough. > However, I'm not > convinced it's the right approach from a fundamental level. > >

Re: [VOTE] KIP-478 Strongly Typed Streams Processor API

Hello again, all, Since it would be confusing to continue indefinitely with the old and now PAPIs both not deprecated, I have decided to go ahead with deprecating the old PAPI in AK 3.0. Since KAFKA-10603 has not seen any progress, this means that we actually do have to go ahead and deprecate+rep

[jira] [Resolved] (KAFKA-12955) Fix LogLoader to pass materialized view of segments for deletion

[ https://issues.apache.org/jira/browse/KAFKA-12955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-12955. - Fix Version/s: 3.0.0 Assignee: Kowshik Prakasam Resolution: Fixed Merged the PR to trunk

Re: [DISCUSS] KIP-739: Block Less on KafkaProducer#send

Blocking in the constructor to fetch metadata doesn't solve the problem, since metadata still needs to be periodically refreshed over time. best, Colin On Wed, Jun 16, 2021, at 09:51, Jesse Feinman wrote: > Hi Moses, > > Specifically, on blocking in the constructor to fetch metadata, while I

Re: [VOTE] KIP-663: API to Start and Shut Down Stream Threads and to Request Closing of Kafka Streams Clients

Thanks for clarifying that @Sophie it is in regards to KIP-633 On Wed, Jun 16, 2021 at 4:00 PM Sophie Blee-Goldman wrote: > Matthias, I'm guessing you meant to send this to the KIP-633 list? This is > KIP-663 > > On Wed, Jun 16, 2021 at 12:37 PM Matthias J. Sax wrote: > > > Quick follow up. I d

Re: [VOTE] KIP-663: API to Start and Shut Down Stream Threads and to Request Closing of Kafka Streams Clients

Matthias, I'm guessing you meant to send this to the KIP-633 list? This is KIP-663 On Wed, Jun 16, 2021 at 12:37 PM Matthias J. Sax wrote: > Quick follow up. I did a small update to the KIP with regard to > https://issues.apache.org/jira/browse/KAFKA-12909 > > Israel, Sophie, and Guozhang did ag

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #226

See

Re: [DISCUSS] KIP-739: Block Less on KafkaProducer#send

Hi Moses, Specifically, on blocking in the constructor to fetch metadata, while I like the idea of specifying the topics in the constructor and fetching the metadata then, I think it leads to a few scenarios that could be unexpected. First is if you try to use a topic that wasn't included in t

Consumer Reporting error

Hello Kafka experts The consumer team is reporting issue while consuming the data from the topic as Singularity Header issue. Can some one please tell on how to resolve this issue. Error looks like ; Starting offset: 1226716 offset: 1226716 position: 0 CreateTime: 1583780622665 isvalid: true key

Re: [VOTE] KIP-663: API to Start and Shut Down Stream Threads and to Request Closing of Kafka Streams Clients

Quick follow up. I did a small update to the KIP with regard to https://issues.apache.org/jira/browse/KAFKA-12909 Israel, Sophie, and Guozhang did agree to this change. I don't think we need to re-vote. Please let us know if there are any concerns. -Matthias On 1/27/21 12:48 PM, Sophie Blee-Go

[jira] [Created] (KAFKA-12957) Refactor Streams Logical Plan Generation

Guozhang Wang created KAFKA-12957: - Summary: Refactor Streams Logical Plan Generation Key: KAFKA-12957 URL: https://issues.apache.org/jira/browse/KAFKA-12957 Project: Kafka Issue Type: Improv

Re: [DISCUSS] KIP-714: Client metrics and observability

Hi Ryanne, this proposal stems from a need to improve troubleshooting Kafka issues. As it currently stands, when an application team is experiencing Kafka service degradation, or the Kafka operator is seeing misbehaving clients, there are plenty of steps that needs to be taken before any client-s

Re: [DISCUSS] KIP-714: Client metrics and observability

Thanks for your feedback, Travis! I believe there are different audiences and uses for application (business logic) and client (infrastructure) metrics. Kafka clients are part of the infrastructure, not the business logic, and should be monitored as such by the organization, sub-organization, or t

Re: [DISCUSS] KIP-747 Add support for basic aggregation APIs

Mohan / Mathias, > > I think extending min/max to non-numeric types makes sense. Wondering > > why we should require a `Comparator` or if we should require that the > > types implement `Comparable` instead? > > > Good question. This is what it would look like: > > KTable min_comparable() > KTable

[jira] [Created] (KAFKA-12956) Validate the snapshot id when the state machine freeze a snapshot

Haoran Xuan created KAFKA-12956: --- Summary: Validate the snapshot id when the state machine freeze a snapshot Key: KAFKA-12956 URL: https://issues.apache.org/jira/browse/KAFKA-12956 Project: Kafka

Re: [VOTE] KIP-749: Add --files and --file-separator options to the ConsoleProducer

Thanks, Boyang and Luke, As of present: - binding: +1 (Boyang) - non-binding: +1 (Luke) Can anyone else review this KIP? Regards, Wenbing On 2021/06/16 10:36:14, wenbing shen wrote: > Thanks for your comments Boyang. > > I updated the KIP to remove the code details you mentioned that are not

Re: [VOTE] KIP-749: Add --files and --file-separator options to the ConsoleProducer

Thanks for your comments Boyang. I updated the KIP to remove the code details you mentioned that are not necessary to be shown in the kip. And I submitted a PR for review: https://github.com/apache/kafka/pull/10889 Thanks, Wenbing Boyang Chen 于2021年6月12日周六 上午11:44写道： > Thanks for the updates

Re: Wiki Permissions Request

Hi Garmes, I gave you the requested permissions. Thank you for your interest in Apache Kafka! Best, Bruno On 16.06.21 09:40, Garmes Amine wrote: Wiki ID: mgarmes I need to create a new KIP page. Thank you for your help! Garmes

[jira] [Created] (KAFKA-12955) Fix LogLoader to pass materialized list of segments for deletion

Kowshik Prakasam created KAFKA-12955: Summary: Fix LogLoader to pass materialized list of segments for deletion Key: KAFKA-12955 URL: https://issues.apache.org/jira/browse/KAFKA-12955 Project: Kaf

Wiki Permissions Request

Wiki ID: mgarmes I need to create a new KIP page. Thank you for your help! Garmes

[jira] [Created] (KAFKA-12954) Add Support for Scala 3 in 4.0.0

Josep Prat created KAFKA-12954: -- Summary: Add Support for Scala 3 in 4.0.0 Key: KAFKA-12954 URL: https://issues.apache.org/jira/browse/KAFKA-12954 Project: Kafka Issue Type: Improvement