[jira] [Created] (KAFKA-13529) kafka mm2 consumer configurattion invalid

2021-12-09 Thread chengang (Jira)
chengang created KAFKA-13529: Summary: kafka mm2 consumer configurattion invalid Key: KAFKA-13529 URL: https://issues.apache.org/jira/browse/KAFKA-13529 Project: Kafka Issue Type: Bug Affects

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.1 #32

2021-12-09 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-785 Automatic storage formatting

2021-12-09 Thread Igor Soarez
Hi Colin, Thank you for your kind and thoughtful reply. Thank also you for clarifying why it is important to distinguish between disk problems and first boot for a log directory. I completely agree that loosing all metadata is a very serious issue and we should strive to make that as least lik

Re: [DISCUSS] KIP-591: Add Kafka Streams config to set default state store

2021-12-09 Thread Guozhang Wang
Thanks Luke for the updated KIP. One major change the new proposal has it to change the original enum store type with a new interface. Where in the enum approach our internal implementations would be something like: " Stores#keyValueBytesStoreSupplier(storeImplTypes, storeName, ...) Stores#window

Re: [DISCUSS] KIP-714: Client metrics and observability

2021-12-09 Thread Jun Rao
Hi, Magnus. Thanks for the KIP. A few comments below. 10. There seems to be some questions on the use cases of this KIP since we already have a client side metric reporter. It would be useful to provide a bit more details on that. To me, there are 3 potential use cases: (1) not all organizations

[jira] [Created] (KAFKA-13528) KRaft RegisterBroker should validate that the cluster ID matches

2021-12-09 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-13528: Summary: KRaft RegisterBroker should validate that the cluster ID matches Key: KAFKA-13528 URL: https://issues.apache.org/jira/browse/KAFKA-13528 Project: Kafka

Re: [DISCUSS] KIP-805: Add range and scan query support in IQ v2

2021-12-09 Thread Guozhang Wang
Hi Vicky, Thanks for the KIP. Just for a bit more clarification, could you elaborate an example for windowed stores, beyond a key-value store (I think the `myStore` is for kv-store right?). Otherwise LGTM. Guozhang On Wed, Dec 8, 2021 at 4:18 PM Matthias J. Sax wrote: > Thanks for the details

Re: [VOTE] KIP-792: Add "generation" field into consumer protocol

2021-12-09 Thread Guozhang Wang
Thanks Luke, in that case I'm +1 on this KIP. On Thu, Dec 9, 2021 at 1:46 AM Luke Chen wrote: > Hi Guozhang, > > Thanks for your comment. > > > we need to make sure the old-versioned leader would be able to ignore the > new > field during an upgrade e.g. without crashing. > > Yes, I understand.

[jira] [Resolved] (KAFKA-13512) topicIdsToNames and topicNamesToIds allocate unnecessary maps

2021-12-09 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-13512. -- Resolution: Fixed > topicIdsToNames and topicNamesToIds allocate unnecessary maps > --

[DISCUSS] KIP-808: Add support for unix epoch precision in TimestampConverter SMT

2021-12-09 Thread Julien Chanaud
Hi everyone, I would like to start a discussion for KIP-808 https://cwiki.apache.org/confluence/display/KAFKA/KIP-808%3A+Add+support+for+unix+epoch+precision+in+TimestampConverter+SMT This seems like a simple change but I suspect there are several things to consider, most notably regarding the ja

Re: [DISCUSS] KIP-807: Refactor KafkaStreams exposed metadata hierarchy

2021-12-09 Thread Josep Prat
Hi Guozhang, Thanks a lot for your feedback! I agree that adding some code snippets to illustrate the use cases will make this clearer. We can also add those to the documentation site afterwards. I'll update the KIP accordingly. Thanks again for your help! Best, ——— Josep Prat Aiven Deutschla

Re: [DISCUSS] KIP-807: Refactor KafkaStreams exposed metadata hierarchy

2021-12-09 Thread Guozhang Wang
Hi Josep, Thanks for the proposed KIP. It looks good to me overall. One meta comment is that in order to illustrate whether that fits more cleanly to the actual metadata use cases, we could add a few examples each with its code snippet based on the new APIs. The ones I'm having in mind are: 1) Gi

Re: Permission to create KIP

2021-12-09 Thread Bill Bejeck
Hi Julien, You're all set up now on Jira and the wiki. Thanks for your interest in Apache Kafka. -Bill On Thu, Dec 9, 2021 at 6:25 AM Julien Chanaud wrote: > Hello, > I would like to be able to contribute to Apache Kafka and create a KIP. > > wiki id: twobeeb > jira id: Twobeeb > > Thanks, >

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.0 #161

2021-12-09 Thread Apache Jenkins Server
See

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.1 #31

2021-12-09 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-10333) Provide an API to retrieve Kafka Connect task configurations

2021-12-09 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-10333. Fix Version/s: 2.8.0 Resolution: Duplicate DUP of KAFKA-10833 > Provide an API to

Re: [DISCUSS] KIP-782: Expandable batch size in producer

2021-12-09 Thread Luke Chen
Hi Jun, 11. In addition to Artem's comment, I think the reason to have additional "batch.max.size" is to have more flexibility to users. For example: With linger.ms=100ms, batch.size=16KB, now, we have 20KB of data coming to a partition within 50ms. Now, sender is ready to pick up the batch to sen

Permission to create KIP

2021-12-09 Thread Julien Chanaud
Hello, I would like to be able to contribute to Apache Kafka and create a KIP. wiki id: twobeeb jira id: Twobeeb Thanks, Julien

[jira] [Created] (KAFKA-13527) Add top-level error code field to DescribeLogDirsResponse

2021-12-09 Thread Mickael Maison (Jira)
Mickael Maison created KAFKA-13527: -- Summary: Add top-level error code field to DescribeLogDirsResponse Key: KAFKA-13527 URL: https://issues.apache.org/jira/browse/KAFKA-13527 Project: Kafka

Re: [VOTE] KIP-792: Add "generation" field into consumer protocol

2021-12-09 Thread Luke Chen
Hi Guozhang, Thanks for your comment. > we need to make sure the old-versioned leader would be able to ignore the new field during an upgrade e.g. without crashing. Yes, I understand. I'll be careful to make sure it won't crash the old versioned leader. But basically, it won't, because we append

Re: AccessDeniedException Kafka 3.0.0 on Windows

2021-12-09 Thread Luke Chen
Hi Martijn, The v3.1.0 should be released soon. It's been code freezed, and we're fixing some blocker issues now. FYI Thank you. Luke On Thu, Dec 9, 2021 at 5:36 PM de Bruijn, M. (Martijn) wrote: > Thanks Luke for your reply. It's good to see its fixed already. When will > it be released? > Re

RE: AccessDeniedException Kafka 3.0.0 on Windows

2021-12-09 Thread de Bruijn, M. (Martijn)
Thanks Luke for your reply. It's good to see its fixed already. When will it be released? Regards, Martijn -Original Message- From: Luke Chen Sent: donderdag 9 december 2021 10:30 To: dev Subject: Re: AccessDeniedException Kafka 3.0.0 on Windows Hi Martijn de Bruijn Thanks for report

Re: AccessDeniedException Kafka 3.0.0 on Windows

2021-12-09 Thread Luke Chen
Hi Martijn de Bruijn Thanks for reporting the issue. This is a known issue and it will be fixed in V3.0.1/V3.1.0 in this ticket: https://issues.apache.org/jira/browse/KAFKA-13391. FYI Thank you. Luke On Thu, Dec 9, 2021 at 4:08 PM de Bruijn, M. (Martijn) wrote: > On Windows, Kafka 3.0.0 is

AccessDeniedException Kafka 3.0.0 on Windows

2021-12-09 Thread de Bruijn, M. (Martijn)
On Windows, Kafka 3.0.0 is producing AccessDeniedException's. Mainly due to using FileChannel.open(path, StandardOpenOption.READ) on a directory which will always fail on Windows. (https://mail.openjdk.java.net/pipermail/nio-dev/2013-February/002123.html) Example error code: org.apache.kafka.comm