[jira] [Commented] (KAFKA-3919) Broker faills to start after ungraceful shutdown due to non-monotonically incrementing offsets in logs

2016-06-30 Thread Andy Coates (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15356679#comment-15356679 ] Andy Coates commented on KAFKA-3919: [~ijuma] - duplicate submission not intentional,

Re: [DISCUSS] KIP-60 - Make Java client class loading more flexible

2016-06-30 Thread Rajini Sivaram
Since this is a small change, I will start vote on this tomorrow if there are no objections. The code has been tested with OSGi, so it does work and the approach is flexible enough to work in other environments too. On Mon, May 9, 2016 at 1:37 PM, Rajini Sivaram wrote: > I have just created KIP-

[GitHub] kafka pull request #1576: KAFKA-3914: Global discovery of state stores

2016-06-30 Thread dguy
GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/1576 KAFKA-3914: Global discovery of state stores @guozhangwang @enothereska @mjsax @miguno please take a look. A few things that need to be clarified 1. I've added StreamsConfig.USER_ENDPOINT_CON

[jira] [Commented] (KAFKA-3914) Global discovery of state stores

2016-06-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15356795#comment-15356795 ] ASF GitHub Bot commented on KAFKA-3914: --- GitHub user dguy opened a pull request:

[GitHub] kafka pull request #1570: KAFKA-3914: Global discovery of state stores

2016-06-30 Thread dguy
Github user dguy closed the pull request at: https://github.com/apache/kafka/pull/1570 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enable

[jira] [Commented] (KAFKA-3914) Global discovery of state stores

2016-06-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15356798#comment-15356798 ] ASF GitHub Bot commented on KAFKA-3914: --- Github user dguy closed the pull request at

[jira] [Resolved] (KAFKA-3761) Controller has RunningAsBroker instead of RunningAsController state

2016-06-30 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-3761. Resolution: Fixed > Controller has RunningAsBroker instead of RunningAsController state > --

[jira] [Updated] (KAFKA-3761) Controller has RunningAsBroker instead of RunningAsController state

2016-06-30 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3761: --- Fix Version/s: 0.10.1.0 > Controller has RunningAsBroker instead of RunningAsController state > --

Re: Use Kafka 0.9.0.1 or 0.10.0.0 with Zookeeper 3.5

2016-06-30 Thread Luciano Afranllie
Thanks Flavio Your last statement is the key here. What we really need is to secure connections between Kafka and zk and between zk nodes. Our understanding so far is that zk 3.5 will allow us to do that so we want to understand what we need to do in Kafka side in order to use TLS connections to Z

[jira] [Commented] (KAFKA-3360) Add a protocol page/section to the official Kafka documentation

2016-06-30 Thread Petr Novotnik (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15356947#comment-15356947 ] Petr Novotnik commented on KAFKA-3360: -- I'm sorry, but I also cannot find a better pl

Re: KTable.filter usage, memory consumption and materialized view semantics

2016-06-30 Thread Philippe Derome
Guozhang, my latest commit would propose that semantics of your JIRA case 2 be changed a little to suppress nulls when not sendingOldValues and not materializing. When a table T2 is created first from another table T1 and the filter does not match for the key k from T1, the invalid key k does not

[jira] [Commented] (KAFKA-1981) Make log compaction point configurable

2016-06-30 Thread Eric Wasserman (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15357222#comment-15357222 ] Eric Wasserman commented on KAFKA-1981: --- [~junrao] could you please take a look at t

Re: Issue? With java Producer (v9)

2016-06-30 Thread Fumo, Vincent
Hi, just curious if I'm reporting this potential bug to the wrong list.. should I post it somewhere else? > On Jun 28, 2016, at 3:00 PM, Fumo, Vincent wrote: > > Hello. I've posted a similar email to the users group but haven't had much > luck determining if what I'm seeing is a bug or simply

[jira] [Updated] (KAFKA-3663) Proposal for a kafka broker command - kafka-brokers.sh

2016-06-30 Thread Jayesh Thakrar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jayesh Thakrar updated KAFKA-3663: -- Status: Patch Available (was: Open) Pull request - https://github.com/apache/kafka/pull/1539 >

[jira] [Commented] (KAFKA-3877) Gradle compiler daemon exits with non-zero exit code while running LogOffsetTest

2016-06-30 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15357533#comment-15357533 ] Guozhang Wang commented on KAFKA-3877: -- I saw a slightly different failure on the sam

[jira] [Commented] (KAFKA-3103) Transient Failure in kafka.integration.PlaintextTopicMetadataTest.testIsrAfterBrokerShutDownAndJoinsBack

2016-06-30 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15357538#comment-15357538 ] Guozhang Wang commented on KAFKA-3103: -- And another case of this case as well: https

[jira] [Comment Edited] (KAFKA-3103) Transient Failure in kafka.integration.PlaintextTopicMetadataTest.testIsrAfterBrokerShutDownAndJoinsBack

2016-06-30 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15357538#comment-15357538 ] Guozhang Wang edited comment on KAFKA-3103 at 6/30/16 5:47 PM: -

[jira] [Comment Edited] (KAFKA-3103) Transient Failure in kafka.integration.PlaintextTopicMetadataTest.testIsrAfterBrokerShutDownAndJoinsBack

2016-06-30 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15357538#comment-15357538 ] Guozhang Wang edited comment on KAFKA-3103 at 6/30/16 5:47 PM: -

[GitHub] kafka pull request #1575: hotfix: check join window boundaries

2016-06-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1575 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Created] (KAFKA-3921) Periodic refresh of metadata causes spurious log messages

2016-06-30 Thread Steven Schlansker (JIRA)
Steven Schlansker created KAFKA-3921: Summary: Periodic refresh of metadata causes spurious log messages Key: KAFKA-3921 URL: https://issues.apache.org/jira/browse/KAFKA-3921 Project: Kafka

[GitHub] kafka pull request #1573: hotfix: check join window boundaries

2016-06-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1573 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] kafka pull request #1553: KAFKA-3740: Add configs for RocksDBStore

2016-06-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1553 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-3740) Add configs for RocksDBStores

2016-06-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15357598#comment-15357598 ] ASF GitHub Bot commented on KAFKA-3740: --- Github user asfgit closed the pull request

[GitHub] kafka pull request #1555: MINOR: Fix ambiguous log message in RecordCollecto...

2016-06-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1555 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Created] (KAFKA-3922) Add a copy-constructor to AbstractStream

2016-06-30 Thread Florian Hussonnois (JIRA)
Florian Hussonnois created KAFKA-3922: - Summary: Add a copy-constructor to AbstractStream Key: KAFKA-3922 URL: https://issues.apache.org/jira/browse/KAFKA-3922 Project: Kafka Issue Type:

Re: KTable.filter usage, memory consumption and materialized view semantics

2016-06-30 Thread Guozhang Wang
Hmm, I'm not sure if we can optimize this case as well. Following your example: KTable T1 = builder.table("source-topic"); KTable T2 = table.filter(value > 2); And suppose the "source-topic" is piping the messages to T1 as: {a: 3}, {b: 5}, {a: 1}... When {a: 3} is passed from T1 to T2, the filt

[jira] [Commented] (KAFKA-3705) Support non-key joining in KTable

2016-06-30 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15357696#comment-15357696 ] Guozhang Wang commented on KAFKA-3705: -- Yeah this clarifies a lot. I see that you are

Jenkins build is back to normal : kafka-trunk-jdk7 #1395

2016-06-30 Thread Apache Jenkins Server
See

Can I get a code review on my PR for KAFKA-3809? "Auto-generate documentation for topic-level configuration"

2016-06-30 Thread James Cheng
Hi Kafka devs, Can I get a code review on my pull request for https://issues.apache.org/jira/browse/KAFKA-3809? The code has been waiting for review for about a week. I think I clicked everything correctly in JIRA/Github to mark it ready for review, but it’s possible I missed something. Than

[jira] [Comment Edited] (KAFKA-3360) Add a protocol page/section to the official Kafka documentation

2016-06-30 Thread Petr Novotnik (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15356947#comment-15356947 ] Petr Novotnik edited comment on KAFKA-3360 at 6/30/16 8:56 PM: -

[GitHub] kafka pull request #1537: KAFKA-3846: KIP-65: include timestamp in Connect r...

2016-06-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1537 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-3846) Connect record types should include timestamps

2016-06-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15357843#comment-15357843 ] ASF GitHub Bot commented on KAFKA-3846: --- Github user asfgit closed the pull request

[jira] [Resolved] (KAFKA-3846) Connect record types should include timestamps

2016-06-30 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-3846. -- Resolution: Fixed Issue resolved by pull request 1537 [https://github.com/apache

[jira] [Assigned] (KAFKA-3887) StreamBounceTest.test_bounce and StreamSmokeTest.test_streams failing

2016-06-30 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang reassigned KAFKA-3887: Assignee: Guozhang Wang (was: Eno Thereska) > StreamBounceTest.test_bounce and StreamSmoke

Re: [DISCUSS] KIP-48 Support for delegation tokens as an authentication mechanism

2016-06-30 Thread Jun Rao
Parth, Thanks for the reply. It makes sense to only allow the renewal by users that authenticated using *non* delegation token mechanism. Then, should we make the renewal a list? For example, in the case of rest proxy, it will be useful for every instance of rest proxy to be able to renew the tok

Re: [VOTE] KIP-55: Secure quotas for authenticated users

2016-06-30 Thread Jun Rao
Rajini, The latest wiki looks good to me. Perhaps you want to ask other people to also take a look and then we can start the voting. Thanks, Jun On Tue, Jun 28, 2016 at 6:27 AM, Rajini Sivaram < rajinisiva...@googlemail.com> wrote: > Jun, > > Thank you for the review. I have changed all defaul

Build failed in Jenkins: kafka-trunk-jdk8 #726

2016-06-30 Thread Apache Jenkins Server
See Changes: [me] KAFKA-3846: KIP-65: include timestamp in Connect record types -- [...truncated 4557 lines...] kafka.server.LogRecoveryTest > testHWCheckpointNoFailuresMultipleLogSegments PASS

[jira] [Commented] (KAFKA-3915) LogCleaner IO buffers do not account for potential size difference due to message format change

2016-06-30 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15357996#comment-15357996 ] Jun Rao commented on KAFKA-3915: Yes, we could choose to only keep the old message format

[jira] [Commented] (KAFKA-2857) ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created

2016-06-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15358011#comment-15358011 ] ASF GitHub Bot commented on KAFKA-2857: --- Github user imandhan closed the pull reques

[GitHub] kafka pull request #1548: KAFKA-2857 ConsumerGroupCommand throws GroupCoordi...

2016-06-30 Thread imandhan
GitHub user imandhan reopened a pull request: https://github.com/apache/kafka/pull/1548 KAFKA-2857 ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created Added a check to make sure different cases wh

[GitHub] kafka pull request #1548: KAFKA-2857 ConsumerGroupCommand throws GroupCoordi...

2016-06-30 Thread imandhan
Github user imandhan closed the pull request at: https://github.com/apache/kafka/pull/1548 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is en

[jira] [Commented] (KAFKA-2857) ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created

2016-06-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15358012#comment-15358012 ] ASF GitHub Bot commented on KAFKA-2857: --- GitHub user imandhan reopened a pull reques

Build failed in Jenkins: kafka-trunk-jdk7 #1396

2016-06-30 Thread Apache Jenkins Server
See Changes: [me] KAFKA-3846: KIP-65: include timestamp in Connect record types -- [...truncated 6647 lines...] kafka.message.ByteBufferMessageSetTest > testValidBytes PASSED kafka.message.Byt

[GitHub] kafka pull request #1563: KAFKA-3904: File descriptor leaking (Too many open...

2016-06-30 Thread HenryCaiHaiying
Github user HenryCaiHaiying closed the pull request at: https://github.com/apache/kafka/pull/1563 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the featur

[jira] [Commented] (KAFKA-3904) File descriptor leaking (Too many open files) for long running stream process

2016-06-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15358036#comment-15358036 ] ASF GitHub Bot commented on KAFKA-3904: --- Github user HenryCaiHaiying closed the pull

[jira] [Commented] (KAFKA-3904) File descriptor leaking (Too many open files) for long running stream process

2016-06-30 Thread Henry Cai (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15358038#comment-15358038 ] Henry Cai commented on KAFKA-3904: -- This is a dup of KAFKA-3619 > File descriptor leakin

[jira] [Resolved] (KAFKA-3904) File descriptor leaking (Too many open files) for long running stream process

2016-06-30 Thread Henry Cai (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Cai resolved KAFKA-3904. -- Resolution: Duplicate Dup of KAFKA-3619 > File descriptor leaking (Too many open files) for long runnin

[GitHub] kafka pull request #1577: KAFKA-3794: added stream / table names as prefix t...

2016-06-30 Thread bbejeck
GitHub user bbejeck opened a pull request: https://github.com/apache/kafka/pull/1577 KAFKA-3794: added stream / table names as prefix to functions that pr… …int to the console. You can merge this pull request into a Git repository by running: $ git pull https://github.com/b

[jira] [Commented] (KAFKA-3794) Add Stream / Table prefix in print functions

2016-06-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15358238#comment-15358238 ] ASF GitHub Bot commented on KAFKA-3794: --- GitHub user bbejeck opened a pull request:

[GitHub] kafka pull request #1566: MINOR: bug fixes to ducktape services

2016-06-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1566 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] kafka pull request #1572: KAFKA-3854: Fix issues with new consumer's subsequ...

2016-06-30 Thread vahidhashemian
Github user vahidhashemian closed the pull request at: https://github.com/apache/kafka/pull/1572 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] kafka pull request #1572: KAFKA-3854: Fix issues with new consumer's subsequ...

2016-06-30 Thread vahidhashemian
GitHub user vahidhashemian reopened a pull request: https://github.com/apache/kafka/pull/1572 KAFKA-3854: Fix issues with new consumer's subsequent regex (pattern) subscriptions This patch fixes two issues: 1. Subsequent regex subscriptions fail with the new consumer. 2. Sub

[jira] [Commented] (KAFKA-3854) Subsequent regex subscription calls fail

2016-06-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15358377#comment-15358377 ] ASF GitHub Bot commented on KAFKA-3854: --- Github user vahidhashemian closed the pull

[jira] [Commented] (KAFKA-3854) Subsequent regex subscription calls fail

2016-06-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15358378#comment-15358378 ] ASF GitHub Bot commented on KAFKA-3854: --- GitHub user vahidhashemian reopened a pull

[GitHub] kafka pull request #1578: MINOR: remove "auto.commit.interval.ms" from "Manu...

2016-06-30 Thread xuwei-k
GitHub user xuwei-k opened a pull request: https://github.com/apache/kafka/pull/1578 MINOR: remove "auto.commit.interval.ms" from "Manual Offset Control" example You can merge this pull request into a Git repository by running: $ git pull https://github.com/xuwei-k/kafka Manua