Re: [jira] [Commented] (KAFKA-1173) Using Vagrant to get up and running with Apache Kafka

2016-03-21 Thread Gerard Klijs
I had good experiences using the vagrant setup as it is on a mac, but did had to change some things. We are using docker now. I'm not sure about the general preference, but I would like a docker compose over the vagrant setup. Don't know if you really want it Kafka itself, and to give it support th

Jenkins build is back to normal : kafka-trunk-jdk7 #1135

2016-03-21 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-trunk-jdk8 #467

2016-03-21 Thread Apache Jenkins Server
See Changes: [me] KAFKA-3412: multiple asynchronous commits causes send failures -- [...truncated 1585 lines...] kafka.integration.AutoOffsetResetTest > testResetToLatestWhenOffsetTooLow PASSED

[jira] [Commented] (KAFKA-3442) FetchResponse size exceeds max.partition.fetch.bytes

2016-03-21 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15205789#comment-15205789 ] Jiangjie Qin commented on KAFKA-3442: - [~dana.powers] Thanks for reporting the issue.

[jira] [Updated] (KAFKA-3442) FetchResponse size exceeds max.partition.fetch.bytes

2016-03-21 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated KAFKA-3442: Status: Patch Available (was: Open) > FetchResponse size exceeds max.partition.fetch.bytes > --

[jira] [Commented] (KAFKA-3442) FetchResponse size exceeds max.partition.fetch.bytes

2016-03-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15205785#comment-15205785 ] ASF GitHub Bot commented on KAFKA-3442: --- GitHub user becketqin opened a pull request

[GitHub] kafka pull request: KAFKA-3442: Fix FileMessageSet iterator.

2016-03-21 Thread becketqin
GitHub user becketqin opened a pull request: https://github.com/apache/kafka/pull/1112 KAFKA-3442: Fix FileMessageSet iterator. You can merge this pull request into a Git repository by running: $ git pull https://github.com/becketqin/kafka KAFKA-3442 Alternatively you can rev

[jira] [Updated] (KAFKA-3428) Remove metadata sync bottleneck from mirrormaker's producer

2016-03-21 Thread Maysam Yabandeh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maysam Yabandeh updated KAFKA-3428: --- Reviewer: Ismael Juma Fix Version/s: 0.10.0.0 Affects Version/s: 0.9.0.1

[jira] [Commented] (KAFKA-3428) Remove metadata sync bottleneck from mirrormaker's producer

2016-03-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15205730#comment-15205730 ] ASF GitHub Bot commented on KAFKA-3428: --- GitHub user maysamyabandeh opened a pull re

[GitHub] kafka pull request: KAFKA-3428 Remove metadata sync bottleneck fro...

2016-03-21 Thread maysamyabandeh
GitHub user maysamyabandeh opened a pull request: https://github.com/apache/kafka/pull/ KAFKA-3428 Remove metadata sync bottleneck from mirrormaker's producer Repalce topics with a concurrent hashset so it would not require to be modified inside a synchrnoized method. Mak

[jira] [Commented] (KAFKA-3412) Multiple commitAsync() calls causes SendFailedException in commit callback

2016-03-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15205727#comment-15205727 ] ASF GitHub Bot commented on KAFKA-3412: --- Github user asfgit closed the pull request

[GitHub] kafka pull request: KAFKA-3412: multiple asynchronous commits caus...

2016-03-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1108 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Resolved] (KAFKA-3412) Multiple commitAsync() calls causes SendFailedException in commit callback

2016-03-21 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-3412. -- Resolution: Fixed Fix Version/s: 0.10.1.0 Issue resolved by pull request

Metadata and ACLs wire protocol review (KIP-4)

2016-03-21 Thread Grant Henke
I have 2 patches available for KIP-4 that implement some of the new message types. Given that these effect the wire protocol, a vote will be required to make these changes. Before that occurs I would like to get some initial feedback and discussion. If you could review and discuss the protocol chan

[jira] [Created] (KAFKA-3444) Figure out when to bump the version on release-candidate artifacts

2016-03-21 Thread Gwen Shapira (JIRA)
Gwen Shapira created KAFKA-3444: --- Summary: Figure out when to bump the version on release-candidate artifacts Key: KAFKA-3444 URL: https://issues.apache.org/jira/browse/KAFKA-3444 Project: Kafka

[jira] [Commented] (KAFKA-3442) FetchResponse size exceeds max.partition.fetch.bytes

2016-03-21 Thread Dana Powers (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15205655#comment-15205655 ] Dana Powers commented on KAFKA-3442: In all prior broker releases clients check the re

[jira] [Comment Edited] (KAFKA-3442) FetchResponse size exceeds max.partition.fetch.bytes

2016-03-21 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15205640#comment-15205640 ] Jiangjie Qin edited comment on KAFKA-3442 at 3/22/16 2:19 AM: --

[jira] [Commented] (KAFKA-3442) FetchResponse size exceeds max.partition.fetch.bytes

2016-03-21 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15205640#comment-15205640 ] Jiangjie Qin commented on KAFKA-3442: - @junrao Yes, that is the problem. I will submit

[jira] [Assigned] (KAFKA-3442) FetchResponse size exceeds max.partition.fetch.bytes

2016-03-21 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin reassigned KAFKA-3442: --- Assignee: Jiangjie Qin > FetchResponse size exceeds max.partition.fetch.bytes > -

[GitHub] kafka pull request: MINOR: update new version in additional places

2016-03-21 Thread gwenshap
Github user gwenshap closed the pull request at: https://github.com/apache/kafka/pull/1110 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is en

[jira] [Commented] (KAFKA-3442) FetchResponse size exceeds max.partition.fetch.bytes

2016-03-21 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15205631#comment-15205631 ] Jun Rao commented on KAFKA-3442: [~becket_qin], yes, the 0.8.2 consumer is able to consume

[jira] [Commented] (KAFKA-3442) FetchResponse size exceeds max.partition.fetch.bytes

2016-03-21 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15205618#comment-15205618 ] Jiangjie Qin commented on KAFKA-3442: - [~junrao] Are you able to consumer the large me

[jira] [Commented] (KAFKA-3442) FetchResponse size exceeds max.partition.fetch.bytes

2016-03-21 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15205586#comment-15205586 ] Jun Rao commented on KAFKA-3442: [~becket_qin]: It does seem that I can reproduce the issu

[jira] [Updated] (KAFKA-3248) AdminClient Blocks Forever in send Method

2016-03-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3248: --- Fix Version/s: (was: 0.10.1.0) 0.10.0.1 > AdminClient Blocks Forever in send Me

[jira] [Updated] (KAFKA-3173) Error while moving some partitions to OnlinePartition state

2016-03-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3173: --- Fix Version/s: (was: 0.10.1.0) 0.10.0.0 > Error while moving some partitions to

[jira] [Updated] (KAFKA-3123) Follower Broker cannot start if offsets are already out of range

2016-03-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3123: --- Fix Version/s: (was: 0.10.1.0) 0.10.0.1 > Follower Broker cannot start if offse

[jira] [Commented] (KAFKA-3409) Mirror maker hangs indefinitely due to commit

2016-03-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15205536#comment-15205536 ] Ismael Juma commented on KAFKA-3409: [~singhashish], are you planning to submit a PR?

[jira] [Updated] (KAFKA-3409) Mirror maker hangs indefinitely due to commit

2016-03-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3409: --- Priority: Blocker (was: Critical) > Mirror maker hangs indefinitely due to commit >

[jira] [Updated] (KAFKA-3409) Mirror maker hangs indefinitely due to commit

2016-03-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3409: --- Fix Version/s: (was: 0.10.1.0) 0.10.0.0 > Mirror maker hangs indefinitely due t

Jenkins build is back to normal : kafka-trunk-jdk8 #466

2016-03-21 Thread Apache Jenkins Server
See

[jira] [Commented] (KAFKA-3442) FetchResponse size exceeds max.partition.fetch.bytes

2016-03-21 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15205501#comment-15205501 ] Jiangjie Qin commented on KAFKA-3442: - [~dana.powers] Are you expecting a RecordSizeTo

[jira] [Created] (KAFKA-3443) Support regex topics in addSource() and stream()

2016-03-21 Thread Guozhang Wang (JIRA)
Guozhang Wang created KAFKA-3443: Summary: Support regex topics in addSource() and stream() Key: KAFKA-3443 URL: https://issues.apache.org/jira/browse/KAFKA-3443 Project: Kafka Issue Type: Su

[jira] [Updated] (KAFKA-3419) New consumer javadoc unclear on topic subscription vs partition assignment

2016-03-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3419: --- Fix Version/s: (was: 0.10.1.0) 0.10.0.0 > New consumer javadoc unclear on topic

[jira] [Updated] (KAFKA-3418) Add section on detecting consumer failures in new consumer javadoc

2016-03-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3418: --- Fix Version/s: (was: 0.10.1.0) 0.10.0.0 > Add section on detecting consumer fai

[jira] [Updated] (KAFKA-3434) Add old ConsumerRecord constructor for compatibility

2016-03-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3434: --- Fix Version/s: (was: 0.10.1.0) 0.10.0.0 > Add old ConsumerRecord constructor fo

[jira] [Updated] (KAFKA-3431) Move `BrokerEndPoint` from `o.a.k.common` to `o.a.k.common.internals`

2016-03-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3431: --- Fix Version/s: (was: 0.10.1.0) 0.10.0.0 > Move `BrokerEndPoint` from `o.a.k.com

[jira] [Comment Edited] (KAFKA-3442) FetchResponse size exceeds max.partition.fetch.bytes

2016-03-21 Thread Dana Powers (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15205411#comment-15205411 ] Dana Powers edited comment on KAFKA-3442 at 3/22/16 12:13 AM: --

[jira] [Commented] (KAFKA-3442) FetchResponse size exceeds max.partition.fetch.bytes

2016-03-21 Thread Dana Powers (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15205411#comment-15205411 ] Dana Powers commented on KAFKA-3442: # clone kafka-python repo git clone https://githu

[jira] [Assigned] (KAFKA-3432) Cluster.update() thread-safety

2016-03-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma reassigned KAFKA-3432: -- Assignee: Ismael Juma > Cluster.update() thread-safety > -- > >

[jira] [Updated] (KAFKA-3432) Cluster.update() thread-safety

2016-03-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3432: --- Fix Version/s: (was: 0.10.1.0) 0.10.0.0 > Cluster.update() thread-safety >

Re: Build failed in Jenkins: kafka-trunk-jdk7 #1134

2016-03-21 Thread Ismael Juma
In case you were wondering, these failures were due to the fact that the Gradle build configs in Apache Jenkins got messed up somehow: https://issues.apache.org/jira/browse/INFRA-11514 Andrew Bayer has fixed the issue. Ismael On Mon, Mar 21, 2016 at 8:45 PM, Apache Jenkins Server < jenk...@buil

[jira] [Updated] (KAFKA-3442) FetchResponse size exceeds max.partition.fetch.bytes

2016-03-21 Thread Dana Powers (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dana Powers updated KAFKA-3442: --- Priority: Blocker (was: Major) > FetchResponse size exceeds max.partition.fetch.bytes > -

[jira] [Commented] (KAFKA-3442) FetchResponse size exceeds max.partition.fetch.bytes

2016-03-21 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15205396#comment-15205396 ] Jun Rao commented on KAFKA-3442: [~dana.powers], could you share you test? Thanks, > Fetc

Build failed in Jenkins: kafka-trunk-jdk8 #465

2016-03-21 Thread Apache Jenkins Server
See -- Started by user gwenshap [EnvInject] - Loading node environment variables. Building remotely on ubuntu-us1 (Ubuntu ubuntu ubuntu-us golang-ppa) in workspace

Re: [VOTE] 0.10.0.0 RC0

2016-03-21 Thread Gwen Shapira
Thank you! The affected version should be 0.10.0.0 fixVersion will be 0.10.0.0 if you think its a show-stopper for the release (in this case, make it a blocker too). If its not a blocker, fixVersion can be either left empty or set to 0.10.1.0 Gwen On Mon, Mar 21, 2016 at 4:47 PM, Dana Powers wr

[jira] [Commented] (KAFKA-3442) FetchResponse size exceeds max.partition.fetch.bytes

2016-03-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15205387#comment-15205387 ] Ismael Juma commented on KAFKA-3442: [~junrao], do you think this is a result of KIP-3

[jira] [Updated] (KAFKA-3442) FetchResponse size exceeds max.partition.fetch.bytes

2016-03-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3442: --- Fix Version/s: 0.10.0.0 > FetchResponse size exceeds max.partition.fetch.bytes > -

Re: [VOTE] 0.10.0.0 RC0

2016-03-21 Thread Dana Powers
I filed a bug re max.partition.fetch.bytes here: https://issues.apache.org/jira/browse/KAFKA-3442 Would it be useful to create a 0.10.0.0-rc0 version for JIRA tickets? Or should issues just get filed against 0.10.0.0 ? -Dana On Mon, Mar 21, 2016 at 1:53 PM, Gwen Shapira wrote: > Hello Kafka u

[jira] [Created] (KAFKA-3442) FetchResponse size exceeds max.partition.fetch.bytes

2016-03-21 Thread Dana Powers (JIRA)
Dana Powers created KAFKA-3442: -- Summary: FetchResponse size exceeds max.partition.fetch.bytes Key: KAFKA-3442 URL: https://issues.apache.org/jira/browse/KAFKA-3442 Project: Kafka Issue Type: Bu

Re: KStreams Partition Assignment

2016-03-21 Thread Guozhang Wang
Hi Mike, Kafka Streams is suitable for distributed environment. You can read this section of the web docs for more details: http://docs.confluent.io/2.1.0-alpha1/streams/architecture.html#parallelism-model As for the Kafka Streams' customized partition assignor under the Kafka group management p

Re: kafka-streams: Using custom partitioner with higher level DSL constructs?

2016-03-21 Thread Guozhang Wang
Also, have you looked at Kafka Connect released in 0.9? It has a MySQL binlog connector implementation in progress, just thinking maybe you would be interested to check it out and see if there are any feedbacks that you want to give. https://github.com/wushujames/kafka-mysql-connector Guozhang O

Re: kafka-streams: Using custom partitioner with higher level DSL constructs?

2016-03-21 Thread Guozhang Wang
Hello Ben, 1. Currently Kafka Streams high-level DSL does not take the StreamPartitioner yet, please feel free to file a JIRA so that we can keep track and discuss of whether / how to incorporate it into Kafka Streams DSL. 2. As for now, you can do two work arounds: 1) use `process()` function t

Build failed in Jenkins: kafka-trunk-jdk8 #464

2016-03-21 Thread Apache Jenkins Server
See Changes: [me] MINOR: fix documentation version [me] MINOR: update new version in additional places -- [...truncated 1610 lines...] jdk1.8.0_45/lib/visualvm/platform/modules/locale/org-openid

[jira] [Commented] (KAFKA-3441) 0.10.0 documentation still says "0.9.0"

2016-03-21 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15205119#comment-15205119 ] Gwen Shapira commented on KAFKA-3441: - The most obvious part was fixed here: https://g

[VOTE] 0.10.0.0 RC0

2016-03-21 Thread Gwen Shapira
Hello Kafka users, developers and client-developers, This is the first candidate for release of Apache Kafka 0.10.0.0. This is a major release that includes: (1) New message format including timestamps (2) client interceptor API (3) Kafka Streams. Since this is a major release, we will give people

Build failed in Jenkins: kafka-trunk-jdk7 #1134

2016-03-21 Thread Apache Jenkins Server
See Changes: [me] MINOR: fix documentation version [me] MINOR: update new version in additional places -- Started by an SCM change [EnvInject] - Loading node environment variables. Building rem

[GitHub] kafka pull request: MINOR: update new version in additional places

2016-03-21 Thread gwenshap
GitHub user gwenshap opened a pull request: https://github.com/apache/kafka/pull/1110 MINOR: update new version in additional places matching set of version fixes. @ewencp @junrao You can merge this pull request into a Git repository by running: $ git pull https://github.com/g

[jira] [Commented] (KAFKA-1173) Using Vagrant to get up and running with Apache Kafka

2016-03-21 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15205083#comment-15205083 ] Ewen Cheslack-Postava commented on KAFKA-1173: -- [~gwenshap] Maybe? I had been

[GitHub] kafka pull request: MINOR: update new version in additional places

2016-03-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1109 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] kafka pull request: MINOR: update new version in additional places

2016-03-21 Thread gwenshap
GitHub user gwenshap opened a pull request: https://github.com/apache/kafka/pull/1109 MINOR: update new version in additional places Note: This goes only to trunk. 0.10.0 branch will need a separate PR with different versions. You can merge this pull request into a Git repository b

[jira] [Updated] (KAFKA-3283) Consider marking the new consumer as production-ready

2016-03-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3283: --- Description: Ideally, we would: * Remove the beta label * Filling any critical gaps in functionality

[jira] [Commented] (KAFKA-3412) Multiple commitAsync() calls causes SendFailedException in commit callback

2016-03-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15205039#comment-15205039 ] ASF GitHub Bot commented on KAFKA-3412: --- GitHub user hachikuji opened a pull request

[GitHub] kafka pull request: KAFKA-3412: multiple asynchronous commits caus...

2016-03-21 Thread hachikuji
GitHub user hachikuji opened a pull request: https://github.com/apache/kafka/pull/1108 KAFKA-3412: multiple asynchronous commits causes send failures You can merge this pull request into a Git repository by running: $ git pull https://github.com/hachikuji/kafka KAFKA-3412 Alt

[GitHub] kafka pull request: MINOR: fix documentation version

2016-03-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1107 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] kafka pull request: MINOR: fix documentation version

2016-03-21 Thread gwenshap
GitHub user gwenshap opened a pull request: https://github.com/apache/kafka/pull/1107 MINOR: fix documentation version This will need to be double-committed. You can merge this pull request into a Git repository by running: $ git pull https://github.com/gwenshap/kafka fix-doc-v

[jira] [Updated] (KAFKA-3441) 0.10.0 documentation still says "0.9.0"

2016-03-21 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3441: Description: See here: https://github.com/apache/kafka/blob/trunk/docs/documentation.html And here

[jira] [Created] (KAFKA-3441) 0.10.0 documentation still says "0.9.0"

2016-03-21 Thread Gwen Shapira (JIRA)
Gwen Shapira created KAFKA-3441: --- Summary: 0.10.0 documentation still says "0.9.0" Key: KAFKA-3441 URL: https://issues.apache.org/jira/browse/KAFKA-3441 Project: Kafka Issue Type: Bug

Build failed in Jenkins: kafka-trunk-jdk7 #1133

2016-03-21 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: Add InterfaceStability.Unstable annotations to some Kafka Streams -- [...truncated 1711 lines...] jdk1.7.0_51/jre/lib/zi/Asia/Yakutsk jdk1.7.0_51/jre/lib/zi/Asia/

Build failed in Jenkins: kafka-trunk-jdk8 #463

2016-03-21 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: Add InterfaceStability.Unstable annotations to some Kafka Streams -- [...truncated 1610 lines...] jdk1.8.0_45/lib/visualvm/platform/modules/locale/org-openide-io_j

[GitHub] kafka pull request: MINOR: Add InterfaceStability.Unstable annotat...

2016-03-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1097 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Created] (KAFKA-3440) Add Javadoc for KTable (changelog stream) and KStream (record stream)

2016-03-21 Thread Guozhang Wang (JIRA)
Guozhang Wang created KAFKA-3440: Summary: Add Javadoc for KTable (changelog stream) and KStream (record stream) Key: KAFKA-3440 URL: https://issues.apache.org/jira/browse/KAFKA-3440 Project: Kafka

[jira] [Created] (KAFKA-3439) Document possible exception thrown in public APIs

2016-03-21 Thread Guozhang Wang (JIRA)
Guozhang Wang created KAFKA-3439: Summary: Document possible exception thrown in public APIs Key: KAFKA-3439 URL: https://issues.apache.org/jira/browse/KAFKA-3439 Project: Kafka Issue Type: S

[jira] [Commented] (KAFKA-3437) We don't need sitedocs package for every scala version

2016-03-21 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15204906#comment-15204906 ] Gwen Shapira commented on KAFKA-3437: - also, it looks like "releaseTarGzAll" generates

[jira] [Updated] (KAFKA-3388) Producer should only timeout a batch in the accumulator when metadata is missing.

2016-03-21 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated KAFKA-3388: Priority: Critical (was: Blocker) > Producer should only timeout a batch in the accumulator when me

[jira] [Created] (KAFKA-3438) Rack Aware Replica Reassignment should warn of overloaded brokers

2016-03-21 Thread Ben Stopford (JIRA)
Ben Stopford created KAFKA-3438: --- Summary: Rack Aware Replica Reassignment should warn of overloaded brokers Key: KAFKA-3438 URL: https://issues.apache.org/jira/browse/KAFKA-3438 Project: Kafka

[jira] [Work started] (KAFKA-3412) Multiple commitAsync() calls causes SendFailedException in commit callback

2016-03-21 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-3412 started by Jason Gustafson. -- > Multiple commitAsync() calls causes SendFailedException in commit callback

[jira] [Created] (KAFKA-3437) We don't need sitedocs package for every scala version

2016-03-21 Thread Gwen Shapira (JIRA)
Gwen Shapira created KAFKA-3437: --- Summary: We don't need sitedocs package for every scala version Key: KAFKA-3437 URL: https://issues.apache.org/jira/browse/KAFKA-3437 Project: Kafka Issue Type

[jira] [Commented] (KAFKA-3319) Improve session timeout broker and client configuration documentation

2016-03-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15204833#comment-15204833 ] ASF GitHub Bot commented on KAFKA-3319: --- GitHub user hachikuji opened a pull request

[GitHub] kafka pull request: KAFKA-3319: improve session timeout broker/cli...

2016-03-21 Thread hachikuji
GitHub user hachikuji opened a pull request: https://github.com/apache/kafka/pull/1106 KAFKA-3319: improve session timeout broker/client config documentation You can merge this pull request into a Git repository by running: $ git pull https://github.com/hachikuji/kafka KAFKA-3

[jira] [Updated] (KAFKA-3319) Improve session timeout broker and client configuration documentation

2016-03-21 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-3319: --- Description: The current descriptions of the consumer's session timeout and the broker's group

[jira] [Updated] (KAFKA-3319) Improve session timeout broker and client configuration documentation

2016-03-21 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-3319: --- Summary: Improve session timeout broker and client configuration documentation (was: Improve

[jira] [Updated] (KAFKA-3436) Speed up controlled shutdown.

2016-03-21 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated KAFKA-3436: Description: Currently rolling bounce a Kafka cluster with tens of thousands of partitions can take

[jira] [Created] (KAFKA-3436) Speed up controlled shutdown.

2016-03-21 Thread Jiangjie Qin (JIRA)
Jiangjie Qin created KAFKA-3436: --- Summary: Speed up controlled shutdown. Key: KAFKA-3436 URL: https://issues.apache.org/jira/browse/KAFKA-3436 Project: Kafka Issue Type: Improvement Affects

Build failed in Jenkins: kafka-trunk-jdk7 #1132

2016-03-21 Thread Apache Jenkins Server
See Changes: [cshapi] Changing version to 0.10.1.0-SNAPSHOT -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H11 (docker Ubuntu ubuntu yahoo-not

[jira] [Created] (KAFKA-3435) Remove `Unstable` annotation from new Java Consumer

2016-03-21 Thread Ismael Juma (JIRA)
Ismael Juma created KAFKA-3435: -- Summary: Remove `Unstable` annotation from new Java Consumer Key: KAFKA-3435 URL: https://issues.apache.org/jira/browse/KAFKA-3435 Project: Kafka Issue Type: Tas

Build failed in Jenkins: kafka-trunk-jdk8 #462

2016-03-21 Thread Apache Jenkins Server
See Changes: [cshapi] Changing version to 0.10.1.0-SNAPSHOT -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H11 (docker Ubuntu ubuntu yahoo-not-

[GitHub] kafka pull request: MINOR: add back old constructor of ConsumerRec...

2016-03-21 Thread hachikuji
Github user hachikuji closed the pull request at: https://github.com/apache/kafka/pull/1027 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is e

[jira] [Commented] (KAFKA-2670) add sampling rate to MirrorMaker

2016-03-21 Thread Dustin Cote (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15204620#comment-15204620 ] Dustin Cote commented on KAFKA-2670: I agree with Joel, it's probably better to keep t

[jira] [Updated] (KAFKA-3434) Add old ConsumerRecord constructor for compatibility

2016-03-21 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-3434: --- Fix Version/s: 0.10.0.0 > Add old ConsumerRecord constructor for compatibility > -

[jira] [Created] (KAFKA-3434) Add old ConsumerRecord constructor for compatibility

2016-03-21 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-3434: -- Summary: Add old ConsumerRecord constructor for compatibility Key: KAFKA-3434 URL: https://issues.apache.org/jira/browse/KAFKA-3434 Project: Kafka Issue

New release branch 0.10.0

2016-03-21 Thread Gwen Shapira
Hello Kafka developers and friends, As promised, we now have a release branch for 0.10.0 release (with 0.10.0.0 as the version). Trunk has been bumped to 0.10.1.0-SNAPSHOT. I'll be going over the JIRAs to move every non-blocker from this release to the next release. >From this point, most change

[jira] [Updated] (KAFKA-1342) Slow controlled shutdowns can result in stale shutdown requests

2016-03-21 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated KAFKA-1342: Assignee: Joel Koshy (was: Jiangjie Qin) > Slow controlled shutdowns can result in stale shutdown r

[jira] [Commented] (KAFKA-3400) Topic stop working / can't describe topic

2016-03-21 Thread Tobias (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15204540#comment-15204540 ] Tobias commented on KAFKA-3400: --- I think the issue I've hit is http://search-hadoop.com/m/uy

[jira] [Commented] (KAFKA-1313) Support adding replicas to existing topic partitions

2016-03-21 Thread Bingkun Guo (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15204488#comment-15204488 ] Bingkun Guo commented on KAFKA-1313: +1 on supporting "replication-factor" option in "

[jira] [Commented] (KAFKA-3409) Mirror maker hangs indefinitely due to commit

2016-03-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15204370#comment-15204370 ] Ismael Juma commented on KAFKA-3409: I am bumping the priority and setting the fix ver

[jira] [Updated] (KAFKA-3409) Mirror maker hangs indefinitely due to commit

2016-03-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3409: --- Priority: Critical (was: Major) > Mirror maker hangs indefinitely due to commit > --

[jira] [Updated] (KAFKA-3409) Mirror maker hangs indefinitely due to commit

2016-03-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3409: --- Fix Version/s: 0.10.0.0 > Mirror maker hangs indefinitely due to commit > ---

[jira] [Created] (KAFKA-3433) Document stability annotations

2016-03-21 Thread Grant Henke (JIRA)
Grant Henke created KAFKA-3433: -- Summary: Document stability annotations Key: KAFKA-3433 URL: https://issues.apache.org/jira/browse/KAFKA-3433 Project: Kafka Issue Type: Improvement Affects

request for edit access to Kafka wiki

2016-03-21 Thread Ganesh Nikam
Hi All, I want to publish C++ Kafka client. I have my git repository ready. Now I want add entry on Kafka “Clients” page (Confluence wiki page) for this new client. I did create my login for the Confluence and login with that. But I am not able to edit the page. Do I require to do some other st

[jira] [Updated] (KAFKA-3203) Add UnknownCodecException and UnknownMagicByteException to error mapping

2016-03-21 Thread Grant Henke (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke updated KAFKA-3203: --- Fix Version/s: (was: 0.10.0.0) > Add UnknownCodecException and UnknownMagicByteException to error

  1   2   >