Re: [VOTE] KIP-228 Negative record timestamp support

Hi, Konstandin, Thanks for the KIP. I agree with Magnus on the protocol version changes. As for the sentinel value, currently ConsumerRecord.NO_TIMESTAMP (-1) is used for V0 message format. For compatibility, it seems that we still need to preserve that. Jun On Thu, Dec 6, 2018 at 2:32 AM Magnus

Re: [DISCUSS] KIP-382: MirrorMaker 2.0

Hi, Ryanne, Thanks for the KIP. At the high level, this looks like a reasonable proposal. A few comments below. 1. About using a single connector cluster to manage connectors accessing multiple Kafka clusters. It's good that you brought this up. The following are the tradeoffs that I see. The be

[jira] [Created] (KAFKA-7715) Connect should have a parameter to disable WADL output for OPTIONS method

Oleksandr Diachenko created KAFKA-7715: -- Summary: Connect should have a parameter to disable WADL output for OPTIONS method Key: KAFKA-7715 URL: https://issues.apache.org/jira/browse/KAFKA-7715 P

Re: KIP creation permission

Done. Looking forward to you KIP :) On 12/7/18 11:23 AM, Paul Whalen wrote: > Based on some other messages the mailing list seems like this is the best > place to ask for permissions. Can it be granted on the wiki for pgwhalen? > Gonna try to write something up for this: > https://issues.apache.or

[DISCUSS]KIP-400:Add option in ConsoleProducer so user can decide how to handle errors

Hi all, Please take a look at KIP-400 and give me your feedback. https://cwiki.apache.org/confluence/pages/resumedraft.action?draftId=97553607&draftShareId=20701d88-2553-4fa4-b260-9ba0063ad503 thanks Kamal

[jira] [Created] (KAFKA-7714) Scala streams API should use Options in left and outer joins

Charles Crain created KAFKA-7714: Summary: Scala streams API should use Options in left and outer joins Key: KAFKA-7714 URL: https://issues.apache.org/jira/browse/KAFKA-7714 Project: Kafka I

Re: [DISCUSS] KIP-382: MirrorMaker 2.0

Michael, thanks for the comments! > would like to see support for this to be done by hops, as well [...] This then allows ring (hops = number of brokers in the ring), mesh (every cluster interconnected so hop=1), or even a tree (more fine grained setup) cluster topology. That's a good idea, thou

KIP creation permission

Based on some other messages the mailing list seems like this is the best place to ask for permissions. Can it be granted on the wiki for pgwhalen? Gonna try to write something up for this: https://issues.apache.org/jira/browse/KAFKA-7523 Thanks! Paul

Re: [NOTICE] Mandatory relocation of Apache git repositories on git-wip-us.apache.org

Thanks Daniel and Christopher! My bad for missing the header. :) Ismael On Fri, Dec 7, 2018, 9:31 AM Daniel Gruno On 12/7/18 6:28 PM, Ismael Juma wrote: > > Hi Daniel, > > > > We moved to Gitbox a while back for kafka and kafka-site. Which > > repository is still using git-wip-us.apache.org > >

Re: [DISCUSS] KIP-373: Allow users to create delegation tokens for other users

Hi Mani, Overall KIP looks good to me. Can we call this Impersonation support, which is what the KIP is doing? Also instead of using super.uses as the config which essentially giving cluster-wide support to the users, we can introduce impersonation.users as a config and users liste

Re: [NOTICE] Mandatory relocation of Apache git repositories on git-wip-us.apache.org

On Fri, Dec 7, 2018 at 12:29 PM Ismael Juma wrote: > > Hi Daniel, > > We moved to Gitbox a while back for kafka and kafka-site. Which repository is > still using git-wip-us.apache.org? > > Ismael None of yours. The message was sent to every PMC. I believe https://git1-us-west.apache.org/repos/as

Re: [NOTICE] Mandatory relocation of Apache git repositories on git-wip-us.apache.org

On 12/7/18 6:28 PM, Ismael Juma wrote: Hi Daniel, We moved to Gitbox a while back for kafka and kafka-site. Which repository is still using git-wip-us.apache.org ? Ismael Hi Ismael, You do not have any repositories that need to be moved, Kafka can safely disr

Re: [NOTICE] Mandatory relocation of Apache git repositories on git-wip-us.apache.org

Hi Daniel, We moved to Gitbox a while back for kafka and kafka-site. Which repository is still using git-wip-us.apache.org? Ismael On Fri, Dec 7, 2018 at 8:53 AM Daniel Gruno wrote: > [IF YOUR PROJECT DOES NOT HAVE GIT REPOSITORIES ON GIT-WIP-US PLEASE > DISREGARD THIS EMAIL; IT WAS MASS-MAI

[NOTICE] Mandatory relocation of Apache git repositories on git-wip-us.apache.org

[IF YOUR PROJECT DOES NOT HAVE GIT REPOSITORIES ON GIT-WIP-US PLEASE DISREGARD THIS EMAIL; IT WAS MASS-MAILED TO ALL APACHE PROJECTS] Hello Apache projects, I am writing to you because you may have git repositories on the git-wip-us server, which is slated to be decommissioned in the coming mon

Re: Finding reviewrs for a Kafka issue fix

I can take a look at the PR over the weekend. --Vahid On Fri, Dec 7, 2018 at 4:42 AM lk gen wrote: > As a Kafka development newbe, what is the process for selecting reviewers > ? Is there some kind of list of reviewers ? Is it possible to assign > reviewers without checking with them ? is ther

Re: Kafka Cluster Setup

Hi Abhimanyu, Suman already answered your cluster upgrade question. To move all partitions from one broker to another, you can use the kafka-topics (with --describe) command to list all topic partitions and their current replicas. You can use that, replace all instances of broker B to broker A, a

[jira] [Created] (KAFKA-7713) producer io-wait-ratio > 1

dan norwood created KAFKA-7713: -- Summary: producer io-wait-ratio > 1 Key: KAFKA-7713 URL: https://issues.apache.org/jira/browse/KAFKA-7713 Project: Kafka Issue Type: Bug Affects Versions: 2.

Re: [Discuss] KIP-389: Enforce group.max.size to cap member metadata growth

Yep, LGTM on my side. Thanks Stanislav! From: Stanislav Kozlovski Sent: Friday, December 7, 2018 8:51 PM To: dev@kafka.apache.org Subject: Re: [Discuss] KIP-389: Enforce group.max.size to cap member metadata growth Hi, We discussed this offline with Boyang and f

Re: [Discuss] KIP-389: Enforce group.max.size to cap member metadata growth

Hi, We discussed this offline with Boyang and figured that it's best to not wait on the Cooperative Rebalancing proposal. Our thinking is that we can just force a rebalance from the broker, allowing consumers to commit offsets if their rebalanceListener is configured correctly. When rebalancing im

Re: Finding reviewrs for a Kafka issue fix

As a Kafka development newbe, what is the process for selecting reviewers ? Is there some kind of list of reviewers ? Is it possible to assign reviewers without checking with them ? is there some kind of bulletin board for finding reviewers ? On Fri, Dec 7, 2018 at 11:18 AM Gwen Shapira wrote:

[jira] [Created] (KAFKA-7712) Handle exceptions from immediately connected channels in Selector

Rajini Sivaram created KAFKA-7712: - Summary: Handle exceptions from immediately connected channels in Selector Key: KAFKA-7712 URL: https://issues.apache.org/jira/browse/KAFKA-7712 Project: Kafka

Re: Kafka Cluster Setup

-On adding a new Kafka Broker(B) to the cluster. Will all data present on broker A will be distributed automatically? If not what I need to do distribute the data. Automatic distribution doesn't happen. Use kafka-reassign-partitions.sh command to distribute load manually. - Not let's supp

DisconnectException stop Kafka Stream app consuming from topic

Hello, hope you all are great today! am using a Kafka Stream application: ... *final* StreamsBuilder streamsBuilder = *new* StreamsBuilder(); *final* KStream, MyObject> myObjects = streamsBuilder .stream(inputTopicNames, Consumed.*with*( myObjectsWindowSerde, myObjectsAv

Re: [DISCUSS] KIP-373: Allow users to create delegation tokens for other users

Bump up! to get some attention. BTW, recently Apache Spark added support for Kafka delegation token. https://issues.apache.org/jira/browse/SPARK-25501 On Fri, Dec 7, 2018 at 5:27 PM Manikumar wrote: > Bump up! to get some attention. > > BTW, recently Apache Spark added for Kafka delegation tok

Re: [DISCUSS] KIP-373: Allow users to create delegation tokens for other users

Bump up! to get some attention. BTW, recently Apache Spark added for Kafka delegation token support. https://issues.apache.org/jira/browse/SPARK-25501 On Tue, Sep 25, 2018 at 9:56 PM Manikumar wrote: > Hi all, > > I have created a KIP that proposes to allow users to create delegation > tokens f

Re: Finding reviewrs for a Kafka issue fix

We normally self-select. I think in this case, the challenge is finding reviewers who are comfortable with windows... On Fri, Dec 7, 2018 at 10:17 PM lk gen wrote: > > I have fixed a Kafka issue over a week ago with a CI passing pull > request, but there are no reviewers > > How are reviewers

Finding reviewrs for a Kafka issue fix

I have fixed a Kafka issue over a week ago with a CI passing pull request, but there are no reviewers How are reviewers added/chosen for Kafka issues fixes ? https://issues.apache.org/jira/browse/KAFKA-6988

Re: [DISCUSS] KIP-201: Rationalising Policy interfaces

Hi Anna and Mickael, Sorry for remaining silent on this for so long. I should have time to look at this again next week. Kind regards, Tom On Mon, 3 Dec 2018 at 10:11, Mickael Maison wrote: > Hi Tom, > > This is a very interesting KIP. If you are not going to continue > working on it, would i