[jira] [Created] (KAFKA-8144) Flaky Test ControllerIntegrationTest#testMetadataPropagationOnControlPlane

2019-03-21 Thread Matthias J. Sax (JIRA)
Matthias J. Sax created KAFKA-8144: -- Summary: Flaky Test ControllerIntegrationTest#testMetadataPropagationOnControlPlane Key: KAFKA-8144 URL: https://issues.apache.org/jira/browse/KAFKA-8144 Project:

Re: Question on performance data for Kafka vs NATS

2019-03-21 Thread Hans Jespersen
Thats a 4.5 year old benchmark and it was run with a single broker node and only 1 producer and 1 consumer all running on a single MacBookPro. Definitely not the target production environment for Kafka. -hans > On Mar 21, 2019, at 11:43 AM, M. Manna wrote: > > HI All, > > https://nats.io/ab

Re: [DISCUSS] KIP-236 Interruptible Partition Reassignment

2019-03-21 Thread George Li
Hi Colin, I agree with your proposal of having administrative APIs through RPC instead of ZooKeeper. But seems like it will incur significant changes to both submitting reassignments and this KIP's cancelling pending reassignments.  To make this KIP simple and moving along, I will be happy to

Build failed in Jenkins: kafka-trunk-jdk8 #3485

2019-03-21 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-7243: Add unit integration tests to validate metrics in Kafka -- [...truncated 2.33 MB...] org.apache.kafka.streams.test.OutputVerifierTest >

[jira] [Resolved] (KAFKA-8143) Kafka-Streams GlobalStore cannot be read after application restart

2019-03-21 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-8143. Resolution: Duplicate Thanks for reporting this [~lukestephenson]! Closing this as duplicat

[jira] [Created] (KAFKA-8143) Kafka-Streams GlobalStore cannot be read after application restart

2019-03-21 Thread Luke Stephenson (JIRA)
Luke Stephenson created KAFKA-8143: -- Summary: Kafka-Streams GlobalStore cannot be read after application restart Key: KAFKA-8143 URL: https://issues.apache.org/jira/browse/KAFKA-8143 Project: Kafka

Jenkins build is back to normal : kafka-trunk-jdk11 #393

2019-03-21 Thread Apache Jenkins Server
See

Re: [DISCUSSION] KIP-418: A method-chaining way to branch KStream

2019-03-21 Thread Bill Bejeck
Hi Ivan, Thanks for the KIP. I have one question, the KafkaStreamsBrancher takes a Consumer as a second argument which returns nothing, and the example in the KIP shows each stream from the branch using a terminal node (KafkaStreams#to() in this case). Maybe I've missed something, but how would

Re: [VOTE] 2.2.0 RC2

2019-03-21 Thread Ewen Cheslack-Postava
+1 -Ewen On Thu, Mar 21, 2019 at 10:33 AM Harsha wrote: > +1 (non-bidning) > - Download artifacts, setup 3 node cluster > - Ran producer/consumer clients > > Thanks, > Harsha > > On Thu, Mar 21, 2019, at 5:54 AM, Andrew Schofield wrote: > > +1 (non-binding) > > > > - Downloaded the artifacts >

[DISCUSSION] KIP-418: A method-chaining way to branch KStream

2019-03-21 Thread Bill Bejeck
All, I'd like to jump-start the discussion for KIP- 418. Here's the original message: Hello, I'd like to start a discussion about KIP-418. Please take a look at the KIP if you can, I would appreciate any feedback :) KIP-418: https://cwiki.apache.org/confluence/display/KAFKA/KIP-418%3A+A+metho

Jenkins build is back to normal : kafka-trunk-jdk8 #3483

2019-03-21 Thread Apache Jenkins Server
See

[Vote] KIP-421: Support resolving externalized secrets in AbstractConfig

2019-03-21 Thread TEJAL ADSUL
Hi All, I would like to start the vote thread for KIP-421: Support resolving externalized secrets in AbstractConfig. https://cwiki.apache.org/confluence/display/KAFKA/KIP-421%3A+Support+resolving+externalized+secrets+in+AbstractConfig Thanks! Regards, Tejal

Re: [DISCUSSION] KIP-421: Support resolving externalized secrets in AbstractConfig

2019-03-21 Thread Tejal Adsul
I have addressed the comments 1 and 2 in the KIP. 3. The example is a bit misleading with the password in it. I have modified it. We basically wanted to show that you cam pass any additional parameters required by the config provider 4. Yes all the public config classes (ProducerConfig, Consumer

Re: [DISCUSSION] KIP-421: Support resolving externalized secrets in AbstractConfig

2019-03-21 Thread Tejal Adsul
@Colin we won’t be supporting the subscriber mode currently and it will be added as a future work 2. By disabling the feature the constructor will work as it earlier. If we know the configs don’t have any indirect values or we want the indirect values to remain unresolved we will can just do so

Build failed in Jenkins: kafka-trunk-jdk11 #392

2019-03-21 Thread Apache Jenkins Server
See Changes: [colin] KAFKA-7819: Improve RoundTripWorker (#6187) -- [...truncated 2.33 MB...] org.apache.kafka.streams.MockProcessorContextTest > shouldCaptureOutputReco

Question on performance data for Kafka vs NATS

2019-03-21 Thread M. Manna
HI All, https://nats.io/about/ this shows a general comparison of sender/receiver throughputs for NATS and other messaging system including our favourite Kafka. It appears that Kafka, despite taking the 2nd place, has a very low throughput. My question is, where does Kafka win over NATS? is it t

[jira] [Created] (KAFKA-8142) Kafka Streams fails with NPE if records contains null-value in header

2019-03-21 Thread Matthias J. Sax (JIRA)
Matthias J. Sax created KAFKA-8142: -- Summary: Kafka Streams fails with NPE if records contains null-value in header Key: KAFKA-8142 URL: https://issues.apache.org/jira/browse/KAFKA-8142 Project: Kafk

Re: [VOTE] 2.2.0 RC2

2019-03-21 Thread Harsha
+1 (non-bidning) - Download artifacts, setup 3 node cluster - Ran producer/consumer clients Thanks, Harsha On Thu, Mar 21, 2019, at 5:54 AM, Andrew Schofield wrote: > +1 (non-binding) > > - Downloaded the artifacts > - Ran Kafka Connect connectors > > Thanks, > Andrew Schofield > IBM Event Str

Can apache kafka be persistent? Is apache zookeeper able to use persistent disks?

2019-03-21 Thread Назаркин Николай
Hello. I use confluent zookeeper and confluent kafka brokers in gcloud k8s environment. I have deployed zookeeper as a statefulset in cluster with persistent disk mounted on /var/lib/zookeeper dataDir and dataLogdir are /var/lib/zookeeper/data and /var/lib/zookeeper/log I create some topics. I

Build failed in Jenkins: kafka-2.2-jdk8 #69

2019-03-21 Thread Apache Jenkins Server
See Changes: [rajinisivaram] KAFKA-7989: RequestQuotaTest should wait for quota config change before -- [...truncated 2.73 MB...] kafka.controller.PartitionLeaderElectionAlgo

Error Message with Kafka

2019-03-21 Thread Mang Onuoha
Hello, I'm trying to install a tool that uses kafka and zookeeper as well to an integration server. When trying to start the new service I installed, I receive the following error: "Failed to construct kafka producer Caused by: org.apache.kafka.common.config.ConfigException: No resolvable boots

Build failed in Jenkins: kafka-trunk-jdk8 #3482

2019-03-21 Thread Apache Jenkins Server
See Changes: [rajinisivaram] KAFKA-7989: RequestQuotaTest should wait for quota config change before -- [...truncated 5.53 MB...] org.apache.kafka.connect.converters.Sho

Re: [VOTE] 2.2.0 RC2

2019-03-21 Thread Andrew Schofield
+1 (non-binding) - Downloaded the artifacts - Ran Kafka Connect connectors Thanks, Andrew Schofield IBM Event Streams On 19/03/2019, 19:13, "Manikumar" wrote: +1 (non-binding) - Verified the artifacts, build from src, ran tests - Verified the quickstart, ran producer/consumer

[jira] [Resolved] (KAFKA-8123) Flaky Test RequestQuotaTest#testResponseThrottleTimeWhenBothProduceAndRequestQuotasViolated

2019-03-21 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-8123. --- Resolution: Duplicate Fix Version/s: 2.2.1 > Flaky Test > RequestQuotaTest#testRespon

[jira] [Resolved] (KAFKA-7989) Flaky Test RequestQuotaTest#testResponseThrottleTimeWhenBothFetchAndRequestQuotasViolated

2019-03-21 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-7989. --- Resolution: Fixed Reviewer: Rajini Sivaram > Flaky Test > RequestQuotaTest#testRespons