[jira] [Updated] (KAFKA-3478) Finer Stream Flow Control

[ https://issues.apache.org/jira/browse/KAFKA-3478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-3478: --- Description: Today we have a event-time based flow control mechanism in order to synchronize

Re: [VOTE] KIP-67: Queryable state for Kafka Streams

My interpretation was that you need an implementation of QueryableStoreType which anyone can do and QueryableStoreTypes is just a place to put the type objects for the types we ship with Kafka. -Jay On Fri, Jul 15, 2016 at 4:04 PM, Sriram Subramanian wrote: > So, it looks like QueryableStoreTyp

Re: [VOTE] KIP-67: Queryable state for Kafka Streams

So, it looks like QueryableStoreTypes would be part of the streams library, right? If a developer needs to support a new store, would they need to change code in streams? On Fri, Jul 15, 2016 at 3:15 PM, Jay Kreps wrote: > Cool, I'm +1 after the updates. > > -Jay > > On Fri, Jul 15, 2016 at 1:50

[jira] [Commented] (KAFKA-3888) Allow consumer to send heartbeats in background thread (KIP-62)

[ https://issues.apache.org/jira/browse/KAFKA-3888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15380270#comment-15380270 ] ASF GitHub Bot commented on KAFKA-3888: --- GitHub user hachikuji opened a pull request

[GitHub] kafka pull request #1627: KAFKA-3888: send consumer heartbeats from a backgr...

GitHub user hachikuji opened a pull request: https://github.com/apache/kafka/pull/1627 KAFKA-3888: send consumer heartbeats from a background thread (KIP-62) You can merge this pull request into a Git repository by running: $ git pull https://github.com/hachikuji/kafka KAFKA-3

Re: [VOTE] KIP-67: Queryable state for Kafka Streams

Cool, I'm +1 after the updates. -Jay On Fri, Jul 15, 2016 at 1:50 PM, Damian Guy wrote: > Hi Guozhang, KIP updated. > > Thanks, > Damian > > On Fri, 15 Jul 2016 at 13:15 Guozhang Wang wrote: > > > Hi Damian, > > > > Since the StateStoreProvider is moved into internal packages, how about > > ju

Re: [VOTE] KIP-67: Queryable state for Kafka Streams

Hi Guozhang, KIP updated. Thanks, Damian On Fri, 15 Jul 2016 at 13:15 Guozhang Wang wrote: > Hi Damian, > > Since the StateStoreProvider is moved into internal packages, how about > just keeping the ReadOnlyXXStores interface for the queryAPI, and > "QueryableStoreType" in the discoverAPI, and

Re: [VOTE] KIP-67: Queryable state for Kafka Streams

Hi Damian, Since the StateStoreProvider is moved into internal packages, how about just keeping the ReadOnlyXXStores interface for the queryAPI, and "QueryableStoreType" in the discoverAPI, and move the StateStoreProvider / QueryableStoreTypeMatcher and different implementations of the matcher lik

Build failed in Jenkins: kafka-trunk-jdk8 #753

See Changes: [wangguoz] KAFKA-3952: Consumer rebalance verifier never succeed due to type -- [...truncated 6736 lines...] kafka.message.ByteBufferMessageSetTest > testValidBytes PASSED kafka.me

Jenkins build is back to normal : kafka_0.9.0_jdk7 #136

See

Re: [DISCUSS] KIP-4 ACL Admin Schema

> My goal in the protocol design was to keep the request simple and be able > to answer what I think are the 3 most common questions/requests > >- What ACLs are on the cluster? >- What access do I/they have? >- Who has access to this resource? Thanks for clarifying. I think this is goo

Re: Using KIP Process in Apache Flink

I'm very curious how the process will work for your community. If you will be able to drop by with feedback in few month, I will greatly appreciate. Processes can always be improved and a fresh set of eyes on the KIP process can be useful Gwen On Fri, Jul 8, 2016 at 1:01 AM, Aljoscha Krettek wr

[jira] [Commented] (KAFKA-3729) Auto-configure non-default SerDes passed alongside the topology builder

[ https://issues.apache.org/jira/browse/KAFKA-3729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379721#comment-15379721 ] Guozhang Wang commented on KAFKA-3729: -- Currently there are two ways to specify serde

[jira] [Updated] (KAFKA-3952) VerifyConsumerRebalance cannot succeed when checking partition owner

[ https://issues.apache.org/jira/browse/KAFKA-3952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3952: - Assignee: Simon Wan Wenli > VerifyConsumerRebalance cannot succeed when checking partition owner >

[jira] [Updated] (KAFKA-3952) VerifyConsumerRebalance cannot succeed when checking partition owner

[ https://issues.apache.org/jira/browse/KAFKA-3952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3952: - Resolution: Fixed Status: Resolved (was: Patch Available) > VerifyConsumerRebalance canno

[jira] [Updated] (KAFKA-3952) VerifyConsumerRebalance cannot succeed when checking partition owner

[ https://issues.apache.org/jira/browse/KAFKA-3952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3952: - Fix Version/s: 0.8.2.2 0.9.0.2 0.10.0.1 > VerifyConsumerReba

[jira] [Commented] (KAFKA-3952) VerifyConsumerRebalance cannot succeed when checking partition owner

[ https://issues.apache.org/jira/browse/KAFKA-3952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379695#comment-15379695 ] ASF GitHub Bot commented on KAFKA-3952: --- Github user asfgit closed the pull request

[GitHub] kafka pull request #1612: KAFKA-3952: Consumer rebalance verifier never succ...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1612 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Re: [VOTE] KIP-67: Queryable state for Kafka Streams

Hi All, I've updated the KIP with changes as discussed in this Thread. Thanks, Damian On Wed, 13 Jul 2016 at 16:51 Ismael Juma wrote: > I think it's important to distinguish the use cases of defining new stores > (somewhat rare) versus using the `store` method (very common). The strategy > emp

[jira] [Commented] (KAFKA-3739) Add no-arg constructor for library provided serdes

[ https://issues.apache.org/jira/browse/KAFKA-3739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379643#comment-15379643 ] Philipe Alves de Oliveira e Silva commented on KAFKA-3739: -- I can

[jira] [Commented] (KAFKA-3968) fsync() is not called on parent directory when new FileMessageSet is flushed to disk

[ https://issues.apache.org/jira/browse/KAFKA-3968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379577#comment-15379577 ] ASF GitHub Bot commented on KAFKA-3968: --- GitHub user nepal opened a pull request:

[GitHub] kafka pull request #1626: [KAFKA-3968] Call fsync for parent directory first...

GitHub user nepal opened a pull request: https://github.com/apache/kafka/pull/1626 [KAFKA-3968] Call fsync for parent directory first time when we flush… … message set You can merge this pull request into a Git repository by running: $ git pull https://github.com/nepal/kafk

[jira] [Created] (KAFKA-3968) fsync() is not called on parent directory when new FileMessageSet is flushed to disk

Andrey Neporada created KAFKA-3968: -- Summary: fsync() is not called on parent directory when new FileMessageSet is flushed to disk Key: KAFKA-3968 URL: https://issues.apache.org/jira/browse/KAFKA-3968

Re: [DISCUSS] KIP-4 ACL Admin Schema

Thank you for the review Gwen, Manikumar, & Ismael. See my responses below: I am a bit confused about specifying resources. > resource_type is something like "TOPIC" and resource_name is a name of > a specific topic? This resource is a protocol representation of the existing Resource

[jira] [Comment Edited] (KAFKA-1194) The kafka broker cannot delete the old log files after the configured time

[ https://issues.apache.org/jira/browse/KAFKA-1194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379380#comment-15379380 ] Harald Kirsch edited comment on KAFKA-1194 at 7/15/16 1:41 PM: -

[jira] [Commented] (KAFKA-1194) The kafka broker cannot delete the old log files after the configured time

[ https://issues.apache.org/jira/browse/KAFKA-1194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379380#comment-15379380 ] Harald Kirsch commented on KAFKA-1194: -- It seems we are one step further but not yet

[jira] [Created] (KAFKA-3967) Excessive Network IO between Kafka brokers

Krishna created KAFKA-3967: -- Summary: Excessive Network IO between Kafka brokers Key: KAFKA-3967 URL: https://issues.apache.org/jira/browse/KAFKA-3967 Project: Kafka Issue Type: Bug Affects Ver

Re: [DISCUSS] KIP-4 ACL Admin Schema

On Fri, Jul 15, 2016 at 6:45 AM, Gwen Shapira wrote: > > >> - I suggest this be addressed in KIP-50 as well, though it has > >> some compatibility concerns. > > Isn't KIP-50 itself one gigantic compatibility concern? I don't see > how your suggestions make it any worse... > Yes,

[GitHub] kafka pull request #1625: MINOR: fix extra broker setup

GitHub user mweirauch opened a pull request: https://github.com/apache/kafka/pull/1625 MINOR: fix extra broker setup Quickstart setup for brokers 1 and 2 need "zookeeper.connect" setting. Otherwise you are greeted with: org.apache.kafka.common.config.ConfigException: Mis

[jira] [Commented] (KAFKA-3102) Kafka server unable to connect to zookeeper

[ https://issues.apache.org/jira/browse/KAFKA-3102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379198#comment-15379198 ] Manikumar Reddy commented on KAFKA-3102: Subscribe to user mailing list. Details

[jira] [Commented] (KAFKA-3102) Kafka server unable to connect to zookeeper

[ https://issues.apache.org/jira/browse/KAFKA-3102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379188#comment-15379188 ] Sam Liu commented on KAFKA-3102: Thanks for replying. How can i post issues on kafka user

[jira] [Assigned] (KAFKA-3915) LogCleaner IO buffers do not account for potential size difference due to message format change

[ https://issues.apache.org/jira/browse/KAFKA-3915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma reassigned KAFKA-3915: -- Assignee: Ismael Juma > LogCleaner IO buffers do not account for potential size difference due

[jira] [Comment Edited] (KAFKA-3090) Zookeeper disconnects with "can't find default realm" message

[ https://issues.apache.org/jira/browse/KAFKA-3090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379152#comment-15379152 ] Sam Liu edited comment on KAFKA-3090 at 7/15/16 10:09 AM: -- Hi Moh

[jira] [Commented] (KAFKA-3090) Zookeeper disconnects with "can't find default realm" message

[ https://issues.apache.org/jira/browse/KAFKA-3090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379152#comment-15379152 ] Sam Liu commented on KAFKA-3090: Hi Mohit, what's the issue with the krb5.conf file?I am

[jira] [Updated] (KAFKA-2213) Log cleaner should write compacted messages using configured compression type

[ https://issues.apache.org/jira/browse/KAFKA-2213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar Reddy updated KAFKA-2213: --- Resolution: Duplicate Status: Resolved (was: Patch Available) This duplicate of KAFKA

[jira] [Issue Comment Deleted] (KAFKA-3090) Zookeeper disconnects with "can't find default realm" message

[ https://issues.apache.org/jira/browse/KAFKA-3090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Liu updated KAFKA-3090: --- Comment: was deleted (was: Hi there could you pls tell me which version get this issue fixed?) > Zookeeper

[jira] [Commented] (KAFKA-3102) Kafka server unable to connect to zookeeper

[ https://issues.apache.org/jira/browse/KAFKA-3102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379135#comment-15379135 ] Manikumar Reddy commented on KAFKA-3102: [~liuxinjian] There is no kafka issue. Th

[jira] [Commented] (KAFKA-3102) Kafka server unable to connect to zookeeper

[ https://issues.apache.org/jira/browse/KAFKA-3102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379120#comment-15379120 ] Sam Liu commented on KAFKA-3102: Hi, could you pls tell me the version get this fixed?

[jira] [Commented] (KAFKA-3090) Zookeeper disconnects with "can't find default realm" message

[ https://issues.apache.org/jira/browse/KAFKA-3090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379044#comment-15379044 ] Sam Liu commented on KAFKA-3090: Hi there could you pls tell me which version get this i

[GitHub] kafka pull request #1606: KAFKA-3947: Add dumping current assignment capabil...

GitHub user kawamuray reopened a pull request: https://github.com/apache/kafka/pull/1606 KAFKA-3947: Add dumping current assignment capability to kafka-reassign-partitions.sh Issue: https://issues.apache.org/jira/browse/KAFKA-3947 You can merge this pull request into a Git reposito

[GitHub] kafka pull request #1607: MINOR: Doc of 'retries' config should mention abou...

Github user kawamuray closed the pull request at: https://github.com/apache/kafka/pull/1607 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is e

[GitHub] kafka pull request #1606: KAFKA-3947: Add dumping current assignment capabil...

Github user kawamuray closed the pull request at: https://github.com/apache/kafka/pull/1606 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is e

[GitHub] kafka pull request #1607: MINOR: Doc of 'retries' config should mention abou...

GitHub user kawamuray reopened a pull request: https://github.com/apache/kafka/pull/1607 MINOR: Doc of 'retries' config should mention about max.in.flight.requests.per.connection to avoid confusion When I first read the doc of producer config `retries`, it was quite confusing becau

[jira] [Commented] (KAFKA-3947) kafka-reassign-partitions.sh should support dumping current assignment

[ https://issues.apache.org/jira/browse/KAFKA-3947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15378966#comment-15378966 ] ASF GitHub Bot commented on KAFKA-3947: --- GitHub user kawamuray reopened a pull reque

[jira] [Commented] (KAFKA-3947) kafka-reassign-partitions.sh should support dumping current assignment

[ https://issues.apache.org/jira/browse/KAFKA-3947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15378965#comment-15378965 ] ASF GitHub Bot commented on KAFKA-3947: --- Github user kawamuray closed the pull reque

[jira] [Resolved] (KAFKA-3102) Kafka server unable to connect to zookeeper

[ https://issues.apache.org/jira/browse/KAFKA-3102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar Reddy resolved KAFKA-3102. Resolution: Duplicate > Kafka server unable to connect to zookeeper > --

[jira] [Commented] (KAFKA-3102) Kafka server unable to connect to zookeeper

[ https://issues.apache.org/jira/browse/KAFKA-3102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15378942#comment-15378942 ] Sam Liu commented on KAFKA-3102: is anyone working on this issue? > Kafka server unable t