[jira] [Created] (KAFKA-7743) "pure virtual method called" error message thrown for unit tests which PASS

Sarvesh Tamba created KAFKA-7743: Summary: "pure virtual method called" error message thrown for unit tests which PASS Key: KAFKA-7743 URL: https://issues.apache.org/jira/browse/KAFKA-7743 Project: Ka

[jira] [Created] (KAFKA-7744) Type in java

Andrii Abramov created KAFKA-7744: - Summary: Type in java Key: KAFKA-7744 URL: https://issues.apache.org/jira/browse/KAFKA-7744 Project: Kafka Issue Type: Bug Components: documentat

RE: [VOTE] [REMINDER] KIP-383 Pluggable interface for SSL Factory

I'm new here. Is this vote binding or not? -Original Message- From: Harsha [mailto:ka...@harsha.io] Sent: Saturday, December 15, 2018 1:59 PM To: dev@kafka.apache.org Subject: Re: [VOTE] [REMINDER] KIP-383 Pluggable interface for SSL Factory Overall LGTM. +1. Thanks, Harsha

[jira] [Created] (KAFKA-7745) Kafka Connect doesn't create tombstone record for tasks of deleted connector

Andrey Pustovetov created KAFKA-7745: Summary: Kafka Connect doesn't create tombstone record for tasks of deleted connector Key: KAFKA-7745 URL: https://issues.apache.org/jira/browse/KAFKA-7745 Pr

Re: KIP-213 - Scalable/Usable Foreign-Key KTable joins - Rebooted.

Hi John & Guozhang @John & @Guozhang Wang - I have cleaned up the KIP, pruned much of what I wrote and put a simplified diagram near the top to illustrate the workflow. I encapsulated Jan's content at the bottom of the document. I believe it is simpler to read by far now. @Guozhang Wang : > #1:

Re: [DISCUSS] KIP-258: Allow to Store Record Timestamps in RocksDB

Dear all, I finally managed to update the KIP. To address the concerns about the complex upgrade path, I simplified the design. We don't need any configs and the upgrade can be done with the simple single rolling bounce pattern. The suggestion is to exploit RocksDB column families to isolate old

Re: [DISCUSS] KIP-404: Add Kafka Connect configuration parameter for disabling WADL output on OPTIONS request

Thanks for considering removal Alex. I totally agree with your assessment. Still, I'd be in favor of making KIP-404 a small KIP that describes that this option is now being disabled. (If I'm not mistaken, one place I've noticed this feature being used is in Connect's unit tests for the rest interfa

Build failed in Jenkins: kafka-trunk-jdk8 #3264

See Changes: [github] MINOR: improve Streams error message (#5975) -- [...truncated 4.49 MB...] org.apache.kafka.streams.test.OutputVerifierTest > shouldFailIfValueIsDiff

[jira] [Created] (KAFKA-7746) sasl.jaas.config dynamic broker configuration does not accept "=" in value

Tom Scott created KAFKA-7746: Summary: sasl.jaas.config dynamic broker configuration does not accept "=" in value Key: KAFKA-7746 URL: https://issues.apache.org/jira/browse/KAFKA-7746 Project: Kafka

[jira] [Created] (KAFKA-7747) Consumer should check for truncation after leader changes

Jason Gustafson created KAFKA-7747: -- Summary: Consumer should check for truncation after leader changes Key: KAFKA-7747 URL: https://issues.apache.org/jira/browse/KAFKA-7747 Project: Kafka I

Re: [DISCUSS] KIP-382: MirrorMaker 2.0

Hi, Sonke, Ryanne, Thanks for the explanation. To me, the single connect cluster model could be useful for any connector, not just MM. So, if we want to add it, it seems it would be useful to do it in a backward compatible way in the connect framework, rather than sth specific to MM. I am not sure

Re: KIP-406: GlobalStreamThread should honor custom reset policy

Hi Matthias, It would be great if we got your input on this. On Sun, Dec 16, 2018 at 3:06 PM Richard Yu wrote: > Hi everybody, > > There is a new KIP regarding the resilience of GlobalStreamThread which > could be seen below: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-406%3A+Glo

[jira] [Created] (KAFKA-7748) Add wall clock TimeDefinition for suppression of intermediate events

Jonathan Gordon created KAFKA-7748: -- Summary: Add wall clock TimeDefinition for suppression of intermediate events Key: KAFKA-7748 URL: https://issues.apache.org/jira/browse/KAFKA-7748 Project: Kafka

Re: [DISCUSS] KIP-307: Allow to define custom processor names with KStreams DSL

Hi Florian / John, Just wanted to throw a couple minor thoughts on the current proposal: 1) Regarding the interface / function name, I'd propose we call the interface `NamedOperation` which would be implemented by Produced / Consumed / Printed / Joined / Grouped / Suppressed (note I intentionally

Re: KIP-213 - Scalable/Usable Foreign-Key KTable joins - Rebooted.

Hi John, Just made a pass on your diagram (nice hand-drawing btw!), and obviously we are thinking about the same thing :) A neat difference that I like, is that in the pre-join repartition topic we can still send message in the format of `K=k, V=(i=2)` while using "i" as the partition key in Strea

Re: [VOTE] KIP-345: Introduce static membership protocol to reduce consumer rebalances

Hi Boyang, Thanks, the KIP looks good. Just one comment. The new schema for the LeaveGroup request is slightly odd since it is handling both the single consumer use case and the administrative use case. I wonder we could make it consistent from a batching perspective. In other words, instead of

Re: KIP-213 - Scalable/Usable Foreign-Key KTable joins - Rebooted.

Hi John and Guozhang Ah yes, I lost that in the mix! Thanks for the convergent solutions - I do think that the attachment that John included makes for a better design. It should also help with overall performance as very high-cardinality foreign keyed data (say millions of events with the same ent

Re: Kafka Summit NYC and London in 2019

Hi, Everyone, This is a reminder about the deadline for proposal this Thursday. Thanks, Jun On Tue, Dec 4, 2018 at 1:49 PM Jun Rao wrote: > Hi, Everyone, > > We have two upcoming Kafka Summits, one in NYC and another in London. The > deadline for summiting proposals is Dec 20 for both events.

Build failed in Jenkins: kafka-2.0-jdk8 #203

See Changes: [jason] KAFKA-7616; Make MockConsumer only add entries to the partition map -- [...truncated 888.51 KB...] kafka.zk.ReassignPartitionsZNodeTest > testDecodeValid

Re: [VOTE] KIP-228 Negative record timestamp support

Hi. Guozhang, For fetch/produce requests, even though there is no protocol change, it is a semantic change if the timestamp can be negative. Some client implementations may depend on that. So, it's probably better to bump up the version of those requests. Thanks, Jun On Sun, Dec 9, 2018 at 9:21

Re: [VOTE] KIP-228 Negative record timestamp support

Guozhang, Can you speak to the following note under "impact on existing users": "No impact on current users, they should update their infrastructure in that order: Broker, Consumers, Producers." I think this isn't true, but if it is - we need to fix the proposal and make sure we allow upgrade at

[jira] [Created] (KAFKA-7749) confluent does not provide option to set consumer properties at connector level

Manjeet Duhan created KAFKA-7749: Summary: confluent does not provide option to set consumer properties at connector level Key: KAFKA-7749 URL: https://issues.apache.org/jira/browse/KAFKA-7749 Project

Build failed in Jenkins: kafka-trunk-jdk8 #3265

See Changes: [github] MINOR: Include additional detail in fetch error message (#6036) -- [...truncated 4.49 MB...] org.apache.kafka.streams.test.OutputVerifierTest > shou

Build failed in Jenkins: kafka-2.1-jdk8 #86

See Changes: [jason] MINOR: Include additional detail in fetch error message (#6036) -- [...truncated 910.27 KB...] kafka.security.auth.SimpleAclAuthorizerTest > testAddAclsO

RE: what happens when a vote ends with no votes?

Then let's nag. I got one vote for KIP-383. I need more votes folks. -Original Message- From: John Roesler [mailto:j...@confluent.io] Sent: Friday, December 14, 2018 4:49 PM To: dev@kafka.apache.org Subject: Re: what happens when a vote ends with no votes? I guess it would be different i

[jira] [Created] (KAFKA-7750) Hjson support in kafka connect

Manjeet Duhan created KAFKA-7750: Summary: Hjson support in kafka connect Key: KAFKA-7750 URL: https://issues.apache.org/jira/browse/KAFKA-7750 Project: Kafka Issue Type: Improvement

Re: [DISCUSS] KIP-382: MirrorMaker 2.0

> So, if we want to add it, it seems it would be useful to do it in a backward compatible way in the connect framework, rather than sth specific to MM Jun, that sgtm. The MirrorMaker driver I have right now creates multiple Herders (for multiple Kafka clusters) and exposes them through a high-leve

Doubts regarding kafka-reassign-partitions.sh

so we're currently trying to use Kafka 2.1.0 and are pretty much in a proof-of-concept-phase. We've only just started to look into it and are trying to figure out, if it's what we need. The current setup is as follows: - 3 Kafka brokers on different hosts: kafka1,kafka2,kafka3 - 3 Zookeeper

Jenkins build is back to normal : kafka-trunk-jdk8 #3266

See

Re: Doubts regarding kafka-reassign-partitions.sh

Can you paste the producer and consumer configs as well? Thanks, Suman On Tue, Dec 18, 2018 at 11:49 AM Abhimanyu Nagrath < abhimanyunagr...@gmail.com> wrote: > so we're currently trying to use Kafka 2.1.0 and are pretty much in a > proof-of-concept-phase. We've only just started to look into it

Re: Doubts regarding kafka-reassign-partitions.sh

I have not changed anything in producer and consumer. I am using the default Kafka config. Regards, Abhimanyu On Tue, Dec 18, 2018 at 12:38 PM Suman B N wrote: > Can you paste the producer and consumer configs as well? > > Thanks, > Suman > > On Tue, Dec 18, 2018 at 11:49 AM Abhimanyu Nagrath <