Re: [VOTE] KIP-837 Allow MultiCasting a Result Record.

2022-08-17 Thread Sophie Blee-Goldman
Hey Sagar, thanks for the KIP! Just some cosmetic points to make it absolutely clear what this KIP is doing: 1) could you clarify up front in the Motivation section that this is focused on Kafka Streams applications, and not the plain Producer client? 2) you included the entire implementation of t

[jira] [Resolved] (KAFKA-14167) Unexpected UNKNOWN_SERVER_ERROR raised from kraft controller

2022-08-17 Thread Jason Gustafson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-14167. - Resolution: Fixed > Unexpected UNKNOWN_SERVER_ERROR raised from kraft controller > -

[jira] [Resolved] (KAFKA-13940) DescribeQuorum returns INVALID_REQUEST if not handled by leader

2022-08-17 Thread Jason Gustafson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-13940. - Resolution: Fixed > DescribeQuorum returns INVALID_REQUEST if not handled by leader > --

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1149

2022-08-17 Thread Apache Jenkins Server
See Changes: -- [...truncated 4038 lines...] [2022-08-17T21:26:07.424Z] > Task :storage:testClasses [2022-08-17T21:26:10.987Z] > Task :storage:checkstyleTest [2022-08-17T21

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1148

2022-08-17 Thread Apache Jenkins Server
See Changes: -- [...truncated 418826 lines...] [2022-08-17T21:12:42.992Z] TableTableJoinIntegrationTest > [caching enabled = false] > org.apache.kafka.streams.integration

[jira] [Created] (KAFKA-14170) KRaft Controller: Possible NPE when we remove topics with any offline partitions in the cluster

2022-08-17 Thread Akhilesh Chaganti (Jira)
Akhilesh Chaganti created KAFKA-14170: - Summary: KRaft Controller: Possible NPE when we remove topics with any offline partitions in the cluster Key: KAFKA-14170 URL: https://issues.apache.org/jira/browse/KAFK

Re: [DISCUSS] KIP-854 Separate configuration for producer ID expiry

2022-08-17 Thread Ismael Juma
Why does this have to be an external config? We can provide an internal mechanism to configure this, no? Ismael On Wed, Aug 17, 2022 at 9:22 AM Justine Olshan wrote: > Hey all, > Quick update to this KIP. While working on the PR and tests I realized that > we have a hardcoded value for how ofte

Re: [DISCUSS] KIP-854 Separate configuration for producer ID expiry

2022-08-17 Thread Justine Olshan
Hey all, Quick update to this KIP. While working on the PR and tests I realized that we have a hardcoded value for how often we clean up producer IDs. Currently this value is 10 minutes and is defined in LogManager. I thought for better testing and ease of use of the new configuration, we should al

Re: [DISCUSS] KIP-844: Transactional State Stores

2022-08-17 Thread Sagar
Hi Alex, Thanks for your response. Yeah I kind of mixed the EOS behaviour with state stores. Thanks for clarifying. I think what you are suggesting wrt querying secondary stores makes sense. What I had imagined was trying to leverage the fact that the keys are sorted in a known order. So, before

Re: [DISCUSS] KIP-844: Transactional State Stores

2022-08-17 Thread Alexander Sorokoumov
Hey Sagar, I'll start from the end. if EOS is enabled, it would return only committed data. I think you might refer to Kafka's consumer isolation levels. To my knowledge, they only work for consuming data from a topic. For example, READ_COMMITTED prevents reading data from an ongoing Kafka trans

Re: [Discuss] KIP-581: Value of optional null field which has default value

2022-08-17 Thread Mickael Maison
Hi Cheng Pan, Thanks for the updates. I have a few more questions: 1) Since this KIP is targeting JsonConverter, I think we should add this new config to JsonConverterConfig instead of ConverterConfig. 2) What about renaming the new field to something like "use.null.for.optional.fields"? Thanks

Re: [DISCUSS] KIP-844: Transactional State Stores

2022-08-17 Thread Sagar
Hi Alex, I went through the KIP again and it looks good to me. I just had a question on the secondary state stores: *All writes and deletes go to the temporary store. Reads query the temporary store; if the data is missing, query the regular store. Range reads query both stores and return a KeyVa

Re: [DISCUSS] KIP-855: Add schema.namespace parameter to SetSchemaMetadata SMT in Kafka Connect

2022-08-17 Thread Mickael Maison
Hi Michael, Thanks for the KIP! Sorry for the delay, I finally took some time to take a look. In both the "Public Interfaces" and "Compatibility, Deprecation, and Migration Plan" sections it mentions the new config is "transforms.transformschema.schema.name". However if I understand correctly the

Kafka/Azul swag

2022-08-17 Thread Geertjan Wielenga
Hi Apache Kafka devs, I'm on the Apache NetBeans PMC but, aside from that, in my day job I work at Azul (azul.com), a Java vendor. For upcoming Kafka conferences, we at Azul would like to make a hat as swag that has both our Azul logo as well as Kafka's logo (with the message that that is a good