[jira] [Work started] (KAFKA-4828) ProcessorTopologyTestDriver does not work when using .through()

2017-03-04 Thread Hamidreza Afzali (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-4828 started by Hamidreza Afzali. --- > ProcessorTopologyTestDriver does not work when using .through() > ---

[GitHub] kafka pull request #2632: KAFKA-3182: Fix Transient Test Failure (kafka.netw...

2017-03-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2632 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-3182) Failure in kafka.network.SocketServerTest.testSocketsCloseOnShutdown

2017-03-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15895721#comment-15895721 ] ASF GitHub Bot commented on KAFKA-3182: --- Github user asfgit closed the pull request

[jira] [Resolved] (KAFKA-3182) Failure in kafka.network.SocketServerTest.testSocketsCloseOnShutdown

2017-03-04 Thread Armin Braun (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Armin Braun resolved KAFKA-3182. Resolution: Fixed fixed > Failure in kafka.network.SocketServerTest.testSocketsCloseOnShutdown > --

[jira] [Commented] (KAFKA-3155) Transient Failure in kafka.api.PlaintextProducerSendTest.testFlush

2017-03-04 Thread Armin Braun (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15895775#comment-15895775 ] Armin Braun commented on KAFKA-3155: I can reproduce this easily on my system. And wit

[jira] [Assigned] (KAFKA-3155) Transient Failure in kafka.api.PlaintextProducerSendTest.testFlush

2017-03-04 Thread Armin Braun (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Armin Braun reassigned KAFKA-3155: -- Assignee: Armin Braun > Transient Failure in kafka.api.PlaintextProducerSendTest.testFlush > --

[jira] [Work started] (KAFKA-3155) Transient Failure in kafka.api.PlaintextProducerSendTest.testFlush

2017-03-04 Thread Armin Braun (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-3155 started by Armin Braun. -- > Transient Failure in kafka.api.PlaintextProducerSendTest.testFlush > --

Build failed in Jenkins: kafka-trunk-jdk8 #1322

2017-03-04 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-3182; Fix testSocketsCloseOnShutdown transient failures -- [...truncated 919.32 KB...] org.apache.kafka.connect.runtime.WorkerSinkTaskThreadedT

[GitHub] kafka pull request #2639: KAFKA-3155: Avoid Long Overflow by Setting Linger ...

2017-03-04 Thread original-brownbear
GitHub user original-brownbear opened a pull request: https://github.com/apache/kafka/pull/2639 KAFKA-3155: Avoid Long Overflow by Setting Linger to 1h instead of LONG_MAX This deals with https://issues.apache.org/jira/browse/KAFKA-3155 This is a really trivial one :) The pr

[jira] [Commented] (KAFKA-3155) Transient Failure in kafka.api.PlaintextProducerSendTest.testFlush

2017-03-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15895798#comment-15895798 ] ASF GitHub Bot commented on KAFKA-3155: --- GitHub user original-brownbear opened a pul

Re: [DISCUSS] KIP-126 - Allow KafkaProducer to batch based on uncompressed size

2017-03-04 Thread Becket Qin
Hi Dong, Yes, there is a sensor in the patch about the split occurrence. Currently it is a count instead of rate. In practice, it seems count is easier to use in this case. But I am open to change. Thanks, Jiangjie (Becket) Qin On Fri, Mar 3, 2017 at 7:43 PM, Dong Lin wrote: > Hey Becket, >

Re: [DISCUSS] KIP-126 - Allow KafkaProducer to batch based on uncompressed size

2017-03-04 Thread Becket Qin
Actually second thought on this, rate might be better for two reasons: 1. Most of the metrics in the producer we already have are using rate instead of count. 2. If a service is bounced, the count will be reset to 0, but it does not affect rate. I'll make the change. Thanks, Jiangjie (Becket) Qi

[GitHub] kafka pull request #2619: KAFKA-4820; ConsumerNetworkClient.send() should no...

2017-03-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2619 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-4820) ConsumerNetworkClient.send() should not require global lock

2017-03-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15895838#comment-15895838 ] ASF GitHub Bot commented on KAFKA-4820: --- Github user asfgit closed the pull request

Re: [DISCUSS] KIP-126 - Allow KafkaProducer to batch based on uncompressed size

2017-03-04 Thread Becket Qin
I have updated the KIP based on the latest discussion. Please check and let me know if there is any further concern. Thanks, Jiangjie (Becket) Qin On Sat, Mar 4, 2017 at 10:56 AM, Becket Qin wrote: > Actually second thought on this, rate might be better for two reasons: > 1. Most of the metric

[jira] [Commented] (KAFKA-4802) Support direct ByteBuffer serializers/deserializers in clients

2017-03-04 Thread Armin Braun (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15895852#comment-15895852 ] Armin Braun commented on KAFKA-4802: I think this is a duplicate (or sub-issue rather)

Build failed in Jenkins: kafka-trunk-jdk8 #1323

2017-03-04 Thread Apache Jenkins Server
See Changes: [becket.qin] KAFKA-4820; ConsumerNetworkClient.send() should not require global lock -- [...truncated 100.67 KB...] kafka.api.PlaintextConsumerTest > testEa

Re: [VOTE] KIP-123: Allow per stream/table timestamp extractor

2017-03-04 Thread Guozhang Wang
Jeyhun, Thanks for proposing this KIP! And sorry for getting late in the discussion. I have a general suggestion not directly related to this KIP and a couple of comments for this KIP here: I agree with Mathieu's observation, partly because we are now having lots of overloaded functions both in

[GitHub] kafka pull request #2634: MINOR: Standardised benchmark params for consumer ...

2017-03-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2634 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Updated] (KAFKA-4838) Export buffer cache metrics in JMX

2017-03-04 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-4838: - Labels: needs-kip (was: ) > Export buffer cache metrics in JMX >

[jira] [Updated] (KAFKA-4838) Export buffer cache metrics in JMX

2017-03-04 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-4838: - Fix Version/s: (was: 0.10.2.1) 0.11.0.0 > Export buffer cache metrics in JM

[jira] [Updated] (KAFKA-4639) Kafka Streams metrics are undocumented

2017-03-04 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-4639: - Fix Version/s: 0.10.2.0 > Kafka Streams metrics are undocumented > ---

Build failed in Jenkins: kafka-trunk-jdk8 #1324

2017-03-04 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: Standardised benchmark params for consumer and streams -- [...truncated 156.90 KB...] kafka.security.auth.SimpleAclAuthorizerTest > testLoa

Re: [DISCUSS] KIP 130: Expose states of active tasks to KafkaStreams public API

2017-03-04 Thread Guozhang Wang
Hello Florian, Thanks for the KIP and your detailed explanation of your use case. I think there are two dimensions to discuss on how to improve Streams' debuggability (or more specifically state exposure for visualization). First question is "what information should we expose to the user". From y