[jira] [Created] (KAFKA-8334) Occasional OffsetCommit Timeout

windkithk created KAFKA-8334: Summary: Occasional OffsetCommit Timeout Key: KAFKA-8334 URL: https://issues.apache.org/jira/browse/KAFKA-8334 Project: Kafka Issue Type: Bug Components: c

Build failed in Jenkins: kafka-trunk-jdk11 #497

See Changes: [github] KAFKA-8158: Add EntityType for Kafka RPC fields (#6503) -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remote

Re: I want to contribute to Apache Kafka

Hi, Sorry, JIRA doesn't seem to have any user named 15332318...@189.cn best, Colin On Sat, May 4, 2019, at 21:21, 15332318...@189.cn wrote: > Hi, > > I want to contribute to Apache Kafka. > Would you please give me the contributor permission? > My JIRA ID is 15332318...@189.cn. > > > > >

Build failed in Jenkins: kafka-trunk-jdk11 #496

See Changes: [cshapi] MINOR: correctly parse version OffsetCommitResponse version < 3 -- Started by an SCM change [EnvInject] - Loading node environment variables. Buildin

Build failed in Jenkins: kafka-trunk-jdk11 #495

See Changes: [wangguoz] KAFKA-8284: enable static membership on KStream (#6673) -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remo

Re: [DISCUSS] KIP-454: Expansion of the ConnectClusterState interface

Hi all, Now that KAFKA-8304 (https://issues.apache.org/jira/browse/KAFKA-8304), which was a blocker, has been addressed, I've published a PR for these changes: https://github.com/apache/kafka/pull/6584 Thanks to everyone who's voted so far! If anyone else is interested, the voting thread can be

[jira] [Created] (KAFKA-8333) Load high watermark checkpoint only once when handling LeaderAndIsr requests

Jason Gustafson created KAFKA-8333: -- Summary: Load high watermark checkpoint only once when handling LeaderAndIsr requests Key: KAFKA-8333 URL: https://issues.apache.org/jira/browse/KAFKA-8333 Projec

[jira] [Created] (KAFKA-8332) Regression in handling of JoinGroupRequest disallows deterministic protocol selection based on order of preference

Konstantine Karantasis created KAFKA-8332: - Summary: Regression in handling of JoinGroupRequest disallows deterministic protocol selection based on order of preference Key: KAFKA-8332 URL: https://issues.a

Re: [DISCUSS] KIP-439: Deprecate Interface WindowStoreIterator

Thanks John. I think I'm convinced about not collapsing the metrics measuring for various function calls. Regarding the possible solution I'm a bit inclined to just distinguish on the metric names directly over on tags: since our current metrics naming are a tad messed up anyways, fixing them in o

[jira] [Created] (KAFKA-8331) Add system test for enabling static membership on KStream

Boyang Chen created KAFKA-8331: -- Summary: Add system test for enabling static membership on KStream Key: KAFKA-8331 URL: https://issues.apache.org/jira/browse/KAFKA-8331 Project: Kafka Issue Typ

[jira] [Resolved] (KAFKA-8304) Connect susceptible to deadlock while registering REST extensions

[ https://issues.apache.org/jira/browse/KAFKA-8304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Randall Hauch resolved KAFKA-8304. -- Resolution: Fixed Merged onto `trunk`, and backported to `2.2`, `2.1`, and `2.0`. > Connect su

Re: [VOT] KIP-449: Add connector contexts to Connect worker logs (vote thread)

+1 (binding) On Mon, May 6, 2019 at 3:53 PM Konstantine Karantasis < konstant...@confluent.io> wrote: > Great improvement for multi-tenancy. > Thanks Randall! > > +1 (non-binding) > > Konstantine > > On Tue, Apr 30, 2019 at 9:18 PM Chris Egerton wrote: > > > +1 (non-binding) > > > > Really looki

Build failed in Jenkins: kafka-trunk-jdk11 #494

See Changes: [rhauch] KAFKA-8304: Fix registration of Connect REST extensions (#6651) -- Started by an SCM change [EnvInject] - Loading node environment variables. Buildin

Re: [DISCUSS] KIP-461 - Improving replica fetcher behavior in case of partition failures

Hi Colin! Whenever the thread has all of its partitions marked as failed (i.e. thread is idle), the thread would be shut down. The errors that are not per-partition would probably retry or behave just as before. On Tue, May 7, 2019 at 9:57 AM Colin McCabe wrote: > Hi Aishwarya, > > This looks

Build failed in Jenkins: kafka-trunk-jdk11 #493

See Changes: [github] KAFKA-8275; Take throttling into account when choosing least loaded node -- Started by an SCM change [EnvInject] - Loading node environment variable

[jira] [Resolved] (KAFKA-8275) NetworkClient leastLoadedNode selection should consider throttled nodes

[ https://issues.apache.org/jira/browse/KAFKA-8275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-8275. Resolution: Fixed Fix Version/s: 2.3.0 > NetworkClient leastLoadedNode selection sho

Re: [DISCUSS] KIP-456: Helper classes to make it simpler to write test logic with TopologyTestDriver

Thanks for the responses, Jukka! Thanks for the reference to the javadocs in your library, but I actually meant they should be part of the KIP document. As a general comment, I did get that your intent is to smooth over some rough spots with the current testing library, and that many of your API/

Re: [DISCUSSION] KIP-422: Add support for user/client configuration in the Kafka Admin Client

Hello Colin, Rajini and Jun, I think it makes sense to have new APIs defined in the AdminClient for quota management only, as Colin described above. For the request and response protocol, It seems like we can leverage the existing requests: *IncrementalAlterConfigsRequest* and *DescribeConfigsRequ

Re: [DISCUSS] 2.2.1 Bug Fix Release

Hi John, Thanks for checking, and sorry for the delay. I'm working on it. I'm working through some issues with the release script / my environment. Hopefully not much longer :) Thanks, --Vahid On Tue, May 7, 2019 at 10:53 AM John Roesler wrote: > Hi Vahid, > > Can you let us know the status of

Re: [DISCUSS] KIP-466: Add support for List serialization and deserialization

Thanks for that update. Do you mind making changes primarily on the KIP document ? (https://cwiki.apache.org/confluence/display/KAFKA/KIP-466%3A+Add+support+for+List%3CT%3E+serialization+and+deserialization) This is the design document that we have to agree on and vote for, the PR comes later. It

Build failed in Jenkins: kafka-trunk-jdk11 #492

See Changes: [bbejeck] KAFKA-3522: Interactive Queries must return timestamped stores (#6661) -- Started by an SCM change [EnvInject] - Loading node environment variables.

Re: [DISCUSS] 2.2.1 Bug Fix Release

Hi Vahid, Can you let us know the status of the release? I don't mean to pressure you, but I actually just had someone ask me for a status update on some of my bugfixes. Thanks again for driving this! -John On Fri, May 3, 2019 at 5:51 PM Vahid Hashemian wrote: > > Hi Sophie, > > Thanks for the

Re: [DISCUSS] KIP-466: Add support for List serialization and deserialization

Absolutely agree. Already pushed another commit to remove comparator argument: https://github.com/apache/kafka/pull/6592 Thank you for your input John! I really appreciate it. What about this point I made: 1. Since type for List serde needs to be dec

Re: [VOTE] KIP-460: Admin Leader Election RPC

Thanks Gwen for the clarification! On Mon, May 6, 2019 at 5:03 PM Gwen Shapira wrote: > All committer votes are binding, so you have binding +1 from Colin, Jason > and myself - which is just the 3 you need for the KIP to be accepted. > Mickael added non-binding community support, which is great

Manual Partition Trigger

Hi, I would like to know if there is any provision by which we can initiate a re-partition once all the partition are assigned a consumer. This will help in scaling consumers as with re-partition of partition, there would be more partitions available and hence more consumer can be attached. Usi

[VOTE] KIP-458: Connector Client Config Override Policy

Hi All, I would like to start a vote on https://cwiki.apache.org/confluence/display/KAFKA/KIP-458%3A+Connector+Client+Config+Override+Policy The discussion thread can be found here . Thanks, Magesh

Re: [VOTE] KIP-458: Connector Client Config Override Policy

Hi Magesh, This looks great! Very excited to see these changes finally coming to Connect. +1 (non-binding) Cheers, Chris On Tue, May 7, 2019 at 9:51 AM Magesh Nandakumar wrote: > Hi All, > > I would like to start a vote on > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-458%3A+Conne

Re: [DISCUSS] KIP-461 - Improving replica fetcher behavior in case of partition failures

Hi Aishwarya, This looks like a great improvement! Will a fetcher thread exit if all of its partitions have been marked failed? Or will it continue to run? After this KIP is adopted, are there any remaining situations where we would exit a fetcher thread? I guess some errors are not per-part

[VOTE] KIP-458: Connector Client Config Override Policy

Hi All, I would like to start a vote on https://cwiki.apache.org/confluence/display/KAFKA/KIP-458%3A+Connector+Client+Config+Override+Policy The discussion thread can be found here . Thanks, Magesh On Tue, May 7, 2019 at 9:35 AM M

Re: [DISCUSS] KIP-458: Connector Client Config Override Policy

I have addressed all the outstanding discussion points and I believe we have consensus on the design. Thanks, everyone for the feedback. I will start a VOTE thread on this KIP. On Mon, May 6, 2019 at 10:13 PM Magesh Nandakumar wrote: > Randall, > > Thanks a lot for the suggestions. I have incorp

Build failed in Jenkins: kafka-trunk-jdk11 #491

See Changes: [jason] KAFKA-8131; Move --version implementation into CommandLineUtils (#6481) [jason] MINOR: Remove unused field in `ListenerConnectionQuota` [wangguoz] MINOR: MetricsIntegrationTest should set

Re: [DISCUSS] KIP-466: Add support for List serialization and deserialization

Thanks for the reply Daniyar, That makes much more sense! I thought I must be missing something, but I couldn't for the life of me figure it out. What do you think about just taking an argument, instead of for a Comparator, for the Serde of the inner type? That way, the user can control how exact

Re: [VOTE] KIP-434: Dead replica fetcher and log cleaner metrics

Thanks for the kip. LGTM +1. -Harsha On Mon, Apr 29, 2019, at 8:14 AM, Viktor Somogyi-Vass wrote: > Hi Jason, > > I too agree this is more of a problem in older versions and therefore we > could backport it. Were you thinking of any specific versions? I guess the > 2.x and 1.x versions are defin

Re: [VOTE] KIP-453: Add close() method to RocksDBConfigSetter

+1 （binding） On Mon, May 6, 2019 at 6:44 PM Kamal Chandraprakash < kamal.chandraprak...@gmail.com> wrote: > +1 (non-binding). Thanks for the KIP. > > On Tue, May 7, 2019 at 3:50 AM Bill Bejeck wrote: > > > Thanks for the KIP Sophie. > > > > +1(binding) > > > > On Mon, May 6, 2019 at 4:51 PM John

Re: [VOTE] KIP-419: Safely notify Kafka Connect SourceTask is stopped

It should be possible to get this small KIP into Kafka 2.3 but it's proving hard to get some binding votes. Please could the committers with background in Kafka Connect take a look and vote this week. Thanks, Andrew Schofield On 25/04/2019, 16:11, "Andrew Schofield" wrote: I'd like to en

[jira] [Created] (KAFKA-8330) Separate Replica and Reassignment Throttling

Viktor Somogyi-Vass created KAFKA-8330: -- Summary: Separate Replica and Reassignment Throttling Key: KAFKA-8330 URL: https://issues.apache.org/jira/browse/KAFKA-8330 Project: Kafka Issue

[jira] [Created] (KAFKA-8329) Flaky Test LogOffsetTest#testEmptyLogsGetOffsets

Matthias J. Sax created KAFKA-8329: -- Summary: Flaky Test LogOffsetTest#testEmptyLogsGetOffsets Key: KAFKA-8329 URL: https://issues.apache.org/jira/browse/KAFKA-8329 Project: Kafka Issue Type

Re: Cleaning up command line tools argument parsing a little

Hi Colin, thanks! While I personally don't like the current command line tools I realistically think we'll be stuck with them for a while yet, so a cleanup might make sense. So I'll start looking into that. Regarding a central entrypoint, that would indeed be brilliant and I'd love to work on tha

Re: [DISCUSS] KIP-456: Helper classes to make it simpler to write test logic with TopologyTestDriver

Thanks John for feedback. General comment first, which affect many of the individual answers. My current approach has been abstracting the current functionality of TopologyTestDriver and ConsumerRecordFactory and that way the Contructors and pipe-methods signatures of TestInputTopic are replicated