[jira] [Created] (KAFKA-13176) frequent ISR shrinks and expansion with default num.replica.fetchers (1) under very low throughput conditions.

2021-08-08 Thread kaushik srinivas (Jira)
kaushik srinivas created KAFKA-13176: Summary: frequent ISR shrinks and expansion with default num.replica.fetchers (1) under very low throughput conditions. Key: KAFKA-13176 URL: https://issues.apache.org/jir

[jira] [Created] (KAFKA-13177) partition failures and fewer shrink but a lot of isr expansions with increased num.replica.fetchers in kafka brokers

2021-08-08 Thread kaushik srinivas (Jira)
kaushik srinivas created KAFKA-13177: Summary: partition failures and fewer shrink but a lot of isr expansions with increased num.replica.fetchers in kafka brokers Key: KAFKA-13177 URL: https://issues.apache.o

[jira] [Created] (KAFKA-13178) frequent network_exception trace at kafka producer.

2021-08-08 Thread kaushik srinivas (Jira)
kaushik srinivas created KAFKA-13178: Summary: frequent network_exception trace at kafka producer. Key: KAFKA-13178 URL: https://issues.apache.org/jira/browse/KAFKA-13178 Project: Kafka I

Re: [DISCUSS] KIP-766: fetch/findSessions queries with open endpoints for SessionStore/WindowStore

2021-08-08 Thread Luke Chen
Hi all, Sorry that I found the KIP link I provided in the previous email is wrong. Updated link is as below. https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=186876596 Thank you. Luke On Thu, Aug 5, 2021 at 2:31 PM Luke Chen wrote: > Hi everyone, > > I'd like to start the discu

Re: [DISCUSS] KIP-747 Add support for basic aggregation APIs

2021-08-08 Thread Mohan Parthasarathy
On Tue, Aug 3, 2021 at 6:56 PM Matthias J. Sax wrote: > I was playing with the code a little bit, but it seems not to be easy to > use generics to enforce that V is `Comparable`... > > We would need to introduce a new interface > > interface ComparableStream> > extends KStream > { > KTa

High kafka latency on simple benchmark

2021-08-08 Thread Виталий Ромашкин
Hi Devs,   Currently, I am bench-marking different transports. The first one is Kafka. I created a repo in my GitHub — https://github.com/rvit34/transport-benchmark The result for Kafka is not so good. For RPS 25K and higher latency is about 1second and higher. Maybe I'm doing something complete

Re: [DISCUSS] KIP-747 Add support for basic aggregation APIs

2021-08-08 Thread Matthias J. Sax
>>> Not sure. Also, do you have an opinion on Long vs Double ? Not sure what you mean by `Long vs Double` ? Can you elaborate? -Matthias On 8/8/21 7:41 AM, Mohan Parthasarathy wrote: > On Tue, Aug 3, 2021 at 6:56 PM Matthias J. Sax wrote: > >> I was playing with the code a little bit, but it

Re: [DISCUSS] KIP-759: Unneeded repartition canceling

2021-08-08 Thread Matthias J. Sax
Hi, I originally had a similar thought about `markAsPartitioned()` vs extending `selectKey()` et al. with a config. While I agree that it might be conceptually cleaner to use a config object, I did not propose it as the API impact (deprecating stuff and adding new stuff) is quite big... If we thin

Re: [DISCUSS] KIP-655: Windowed "Distinct" Operation for KStream

2021-08-08 Thread Matthias J. Sax
Thanks for sharing your thoughts. I guess my first question about why using the key boils down to the use case, and maybe you have something else in mind than I do. >> I see it this way: we define 'distinct' operation as returning a single >> record per time window per selected key, I believe thi

Re: [DISCUSS] KIP-747 Add support for basic aggregation APIs

2021-08-08 Thread Mohan Parthasarathy
On Sun, Aug 8, 2021 at 3:56 PM Matthias J. Sax wrote: > >>> Not sure. Also, do you have an opinion on Long vs Double ? > > Not sure what you mean by `Long vs Double` ? Can you elaborate? > > We were discussing the return value for "sum". Alex suggested using "Double" and you had "Long" in one of

Re: [VOTE] KIP-764 Configurable backlog size for creating Acceptor

2021-08-08 Thread Haruki Okada
Thanks for your comment LI-san. Could anyone else review and vote for the KIP? I think the situation described in the KIP's motivation can happen in any large-scale Kafka deployment, so may be helpful for many users while the proposed changes are small enough. Thanks, 2021年8月3日(火) 15:49 Xiangy