Build failed in Jenkins: kafka-trunk-jdk8 #3250

2018-12-09 Thread Apache Jenkins Server
See Changes: [github] KAFKA-6036: Local Materialization for Source KTable (#5779) -- [...truncated 2.24 MB...] org.apache.kafka.streams.test.OutputVerifierTest > shouldNo

Re: Kafka replication error

2018-12-09 Thread Suman B N
Thanks Tony. How can I check the number of pending requests and the idle percentage of the requests handler on node 6? Are there any metrics for those? Controller logs confirm that the controller is not able to send updateMetadataRequest() to that particular node acting as the follower. Whereas t

Re: Kafka replication error

2018-12-09 Thread Tony Liu
yes, Kafka provides those metrics for monitoring the pending requests and idle request handler, check their documents, you should get it, otherwise, let me know. from the operations you did: 1. Restarting service is not help should be expected, since that broker is already being a bottlenec

[DISCUSS] KIP-401 TransformerSupplier/ProcessorSupplier enhancements

2018-12-09 Thread Paul Whalen
Here's KIP-401 for discussion, a minor Kafka Streams API change that I think could greatly increase the usability of the low-level processor API. I have some code written but will wait to see if there is buy in before going all out and creating a pull request. It seems like most of the work would

Build failed in Jenkins: kafka-trunk-jdk8 #3251

2018-12-09 Thread Apache Jenkins Server
See Changes: [github] KAFKA-6036: Follow-up; cleanup sendOldValues logic -- [...truncated 2.24 MB...] org.apache.kafka.connect.runtime.ConnectMetricsTest > testRecreateWit

Build failed in Jenkins: kafka-trunk-jdk11 #148

2018-12-09 Thread Apache Jenkins Server
See Changes: [github] KAFKA-6036: Follow-up; cleanup sendOldValues logic -- [...truncated 2.24 MB...] org.apache.kafka.streams.integration.StreamTableJoinIntegrationTest

Re: [VOTE] KIP-228 Negative record timestamp support

2018-12-09 Thread Guozhang Wang
Hi folks, Thanks for your replies! Just to clarify, the proposal itself does not introduce any additional fields in the message format (some new attributes are mentioned in the Rejected Alternatives though), so my understand is that we do not need to increment the magic byte version of the message

Re: [DISCUSS] KIP-401 TransformerSupplier/ProcessorSupplier enhancements

2018-12-09 Thread Guozhang Wang
Hello Paul, Thanks for the great writeup (very detailed and crystal motivation sections!). This is quite an interesting idea and I do like the API cleanness you proposed. The original motivation of letting StreamsTopology to add state stores though, is to allow different processors to share the s

Re: KIP-213 - Scalable/Usable Foreign-Key KTable joins - Rebooted.

2018-12-09 Thread Guozhang Wang
Hello Adam / Jan / John, Sorry for being late on this thread! I've finally got some time this weekend to cleanup a load of tasks on my queue (actually I've also realized there are a bunch of other things I need to enqueue while cleaning them up --- sth I need to improve on my side). So here are my