Re: [DISCUSS] KIP-451: Make TopologyTestDriver output iterable

Hi, I played around with Patrick's KAFKA-8200 branch and I tested it with combined with my draft version of KIP-456. Some comments: These two version of iterableOutput methods are working now differently, if you reuse same fetched Iterable object after piping in new inputs. Version without serde

[DISCUSS] 2.2.1 Bug Fix Release

Hi all, I'd like to volunteer for the release manager of the 2.2.1 bug fix release. Kafka 2.2.0 was released on March 22, 2019. At this point, there are 29 resolved JIRA issues scheduled for inclusion in 2.2.1: https://issues.apache.org/jira/issues/?jql=project%20%3D%20KAFKA%20AND%20status%20in%2

[jira] [Resolved] (KAFKA-8237) Untangle TopicDeletionManager and add test cases

[ https://issues.apache.org/jira/browse/KAFKA-8237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-8237. Resolution: Fixed > Untangle TopicDeletionManager and add test cases >

Re: [DISCUSS] KIP-460: Admin Leader Election RPC

Thanks for the reply. Comments below. On Wed, Apr 24, 2019 at 6:07 PM Colin McCabe wrote: > Hi Jose, > > Thanks for the KIP, looks valuable. > > If I use a PreferredLeaderElection RPC to specifically request an unclean > leader election, will this take effect even if unclean leader elections are

Build failed in Jenkins: kafka-2.1-jdk8 #172

See Changes: [bill] KAFKA-8227 DOCS Fixed missing links duality of streams tables (#6625) -- [...truncated 919.08 KB...] kafka.log.ProducerStateManagerTest > testSequenceNo

Re: Apply for contributor permission

Thanks, Matthias. And congratulations for you becoming a new PMC member ! Matthias J. Sax 于2019年4月25日周四 上午5:54写道： > Done. > > Welcome to the community! Looking forward to your first PR! > > > -Matthias > > > On 4/24/19 3:50 AM, Lifei Chen wrote: > > Hi, all: > > > > I am very interested in kaf

Re: [DISCUSS] KIP-460: Admin Leader Election RPC

Hi Jose, Thanks for the KIP, looks valuable. If I use a PreferredLeaderElection RPC to specifically request an unclean leader election, will this take effect even if unclean leader elections are disabled on the topic involved? I assume that the answer is yes, but it would be good to clarify t

[jira] [Created] (KAFKA-8287) JVM global map to fence duplicate client id

Boyang Chen created KAFKA-8287: -- Summary: JVM global map to fence duplicate client id Key: KAFKA-8287 URL: https://issues.apache.org/jira/browse/KAFKA-8287 Project: Kafka Issue Type: Sub-task

[VOTE] KIP-401: TransformerSupplier/ProcessorSupplier StateStore connecting

Hi all, After some good discussion on and adjustments to KIP-401 (which I renamed slightly for clarity), chatter has died down so I figured I may as well start a vote. KIP: TransformerSupplier/ProcessorSupplier StateStore connecting

Build failed in Jenkins: kafka-2.0-jdk8 #255

See Changes: [bill] KAFKA-8227 DOCS Fixed missing links duality of streams tables (#6625) -- [...truncated 442.58 KB...] kafka.zk.LiteralAclStoreTest > shouldRoundTripChangeN

Re: [DISCUSS] KIP-454: Expansion of the ConnectClusterState interface

Hi Chris, Instead of calling it ConnectClusterId, perhaps call it ConnectClusterDetails which can include things like groupid, underlying kafkaclusterId, standalone or distributed, etc. This will help expose any cluster related information in the future. Let me know if that would work? Thanks, Ma

Re: [DISCUSS] KIP-454: Expansion of the ConnectClusterState interface

Hi Magesh, 1. After ruminating for a little while on the inclusion of a method to retrieve task configurations I've tentatively decided to remove it from the proposal and place it in the rejected alternatives section. If anyone presents a reasonable use case for it I'll be happy to discuss further

[DISCUSS] KIP-460: Admin Leader Election RPC

Hi all, We would like to extend the "preferred leader election" RPC for the admin client to also support unclean leader elections. The KIP can be found here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-460%3A+Admin+Leader+Election+RPC Thanks! -Jose

[jira] [Created] (KAFKA-8286) KIP-460 Admin Leader Election RPC

Jose Armando Garcia Sancio created KAFKA-8286: - Summary: KIP-460 Admin Leader Election RPC Key: KAFKA-8286 URL: https://issues.apache.org/jira/browse/KAFKA-8286 Project: Kafka Iss

[jira] [Resolved] (KAFKA-8227) Missing Links in Duality of Streams and Tables section

[ https://issues.apache.org/jira/browse/KAFKA-8227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck resolved KAFKA-8227. Resolution: Fixed > Missing Links in Duality of Streams and Tables section > --

Re: Permission to create a KIP

I got permission now. Thanks! On Wed, Apr 24, 2019 at 12:02 PM Jose Armando Garcia Sancio < jsan...@confluent.io> wrote: > Hello, > > Can I get permission to create a KIP in the Apache Kafka wiki page? > > Thanks! > > -- > -Jose > -- -Jose

Re: Apply for contributor permission

Done. Welcome to the community! Looking forward to your first PR! -Matthias On 4/24/19 3:50 AM, Lifei Chen wrote: > Hi, all: > > I am very interested in kafka streams, and willing to learn more about it > and contribute to it when there is appropriate issue for me. > > Could someone help

[jira] [Reopened] (KAFKA-3729) Auto-configure non-default SerDes passed alongside the topology builder

[ https://issues.apache.org/jira/browse/KAFKA-3729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-3729: > Auto-configure non-default SerDes passed alongside the topology builder > --

[jira] [Created] (KAFKA-8285) Handle thread-id random switch on JVM for KStream

Boyang Chen created KAFKA-8285: -- Summary: Handle thread-id random switch on JVM for KStream Key: KAFKA-8285 URL: https://issues.apache.org/jira/browse/KAFKA-8285 Project: Kafka Issue Type: Sub-t

[jira] [Created] (KAFKA-8284) Enable static membership on KStream

Boyang Chen created KAFKA-8284: -- Summary: Enable static membership on KStream Key: KAFKA-8284 URL: https://issues.apache.org/jira/browse/KAFKA-8284 Project: Kafka Issue Type: Sub-task

Permission to create a KIP

Hello, Can I get permission to create a KIP in the Apache Kafka wiki page? Thanks! -- -Jose

Re: [DISCUSS] KIP-458: Connector Client Config Override Policy

HI Chrise, You are right about the "admin." prefix creating conflicts. Here are few options that I can think of 1. Use `dlq.admin` since admin client is used only for DLQ. But this might not really be the case in the future. So, we should possibly drop this idea :) 2. Use `connector.producer`, `

Re: [DISCUSS] KIP-236 Interruptible Partition Reassignment

Hi George, I think focusing on the admin API for cancellation in this KIP is reasonable. Colin wrote up KIP-455 which adds APIs to submit a reassignment and to list reassignments in progress. Probably as long as we make these APIs all consistent with each other, it is fine to do them separately.

Re: [DISCUSS] KIP-458: Connector Client Config Override Policy

Hi Magesh, Next round :) 1. It looks like MM2 will also support "admin." properties that affect AdminClients it creates and uses, which IIUC is the same prefix name to be used for managing the DLQ for sink connectors in this KIP. Doesn't that still leave room for conflict? I'm imagining a scenari

Re: [VOTE] KIP-421: Automatically resolve external configurations.

Thanks Dongjin for taking time to review the KIP and vote Thanks, Tejal On 2019/04/24 01:19:36, Dongjin Lee wrote: > @Colin I see. Thanks for the correction! > @Tejal Thanks for the excellent proposal! +1k! > > Thanks, > Dongjin > > On Mon, Apr 22, 2019 at 10:26 PM Colin McCabe wrote: > >

Re: [VOTE] KIP-433: Block old clients on brokers

Hi Harsha, Comments inline. On Fri, Apr 12, 2019 at 8:22 PM Harsha wrote: > Hi Ismael, > I meant to say blocking clients based on their API version > https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/api/ApiVersion.scala#L48 > But If I understand what you are sayi

Re: [VOTE] KIP-433: Block old clients on brokers

Hi Gwen & Ismael, Do you have any feedback on with the proposed approach, min.api.version allowing users to specify versions for every request. Thanks, Harsha On Fri, Apr 19, 2019, at 10:24 AM, Harsha wrote: > Thanks Ying for updating the KIP. > Hi Ismael, > Give

Apply for contributor permission

Hi, all: I am very interested in kafka streams, and willing to learn more about it and contribute to it when there is appropriate issue for me. Could someone help to give me the contributor permission? My jira id is hustclf . Thanks a lot. Best. Lifei

Re: [VOTE] KIP-334 Include partitions in exceptions raised during consumer record deserialization/validation

Stanislav, Any updates on this KIP? We have internal users who want to skip the corrupted message while consuming the records. On Fri, Oct 19, 2018 at 11:34 PM Matthias J. Sax wrote: > I am not 100% familiar with the details of the consumer code, however I > tend to disagree with: > > > There'