[jira] [Updated] (KAFKA-4450) Add missing 0.10.1.x upgrade tests and ensure ongoing compatibility checks

2017-01-26 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-4450: - Priority: Blocker (was: Critical) > Add missing 0.10.1.x upgrade tests and ensure

[GitHub] kafka pull request #2437: MINOR: Streams API JavaDoc improvements

2017-01-26 Thread mjsax
GitHub user mjsax opened a pull request: https://github.com/apache/kafka/pull/2437 MINOR: Streams API JavaDoc improvements You can merge this pull request into a Git repository by running: $ git pull https://github.com/mjsax/kafka javaDocImprovements7 Alternatively you can re

[GitHub] kafka pull request #2438: MINOR: update KTable JavaDoc

2017-01-26 Thread mjsax
GitHub user mjsax opened a pull request: https://github.com/apache/kafka/pull/2438 MINOR: update KTable JavaDoc You can merge this pull request into a Git repository by running: $ git pull https://github.com/mjsax/kafka ktableJavaDocs Alternatively you can review and apply th

Re: [VOTE] KIP-115: Enforce offsets.topic.replication.factor

2017-01-26 Thread Ben Stopford
+1 Ben Stopford Confluent, http://www.confluent.io > On 26 Jan 2017, at 07:45, James Cheng wrote: > > +1 > >> On Jan 25, 2017, at 9:48 PM, Ewen Cheslack-Postava wrote: >> >> +1 >> >> On Wed, Jan 25, 2017 at 9:23 PM, Joel Koshy wrote: >> >>> +1 >>> >>> >>> On

[GitHub] kafka pull request #2351: MINOR: add Eclipse generated files to toplevel .gi...

2017-01-26 Thread edoardocomar
Github user edoardocomar closed the pull request at: https://github.com/apache/kafka/pull/2351 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature i

[jira] [Work started] (KAFKA-4699) Transient Failure PlaintextConsumerTest.testInterceptros

2017-01-26 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-4699 started by Ismael Juma. -- > Transient Failure PlaintextConsumerTest.testInterceptros >

[GitHub] kafka pull request #2439: KAFKA-2700: Delete topic should remove the corresp...

2017-01-26 Thread omkreddy
GitHub user omkreddy opened a pull request: https://github.com/apache/kafka/pull/2439 KAFKA-2700: Delete topic should remove the corresponding ACLs You can merge this pull request into a Git repository by running: $ git pull https://github.com/omkreddy/kafka KAFKA-2700-DELETE-

[jira] [Commented] (KAFKA-2700) delete topic should remove the corresponding ACL and configs

2017-01-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839435#comment-15839435 ] ASF GitHub Bot commented on KAFKA-2700: --- GitHub user omkreddy opened a pull request:

[GitHub] kafka pull request #2440: KAFKA-4699: Invoke producer callbacks before compl...

2017-01-26 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/2440 KAFKA-4699: Invoke producer callbacks before completing the future This behaviour was changed in 8b3c6c0, but it caused interceptor test failures (which rely on callbacks) and since we’re so clos

[jira] [Commented] (KAFKA-4699) Transient Failure PlaintextConsumerTest.testInterceptros

2017-01-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839447#comment-15839447 ] ASF GitHub Bot commented on KAFKA-4699: --- GitHub user ijuma opened a pull request:

Re: [VOTE] KIP-115: Enforce offsets.topic.replication.factor

2017-01-26 Thread Mickael Maison
+1 Thanks for the KIP ! On Thu, Jan 26, 2017 at 8:39 AM, Ben Stopford wrote: > +1 > Ben Stopford > Confluent, http://www.confluent.io > > > >> On 26 Jan 2017, at 07:45, James Cheng wrote: >> >> +1 >> >>> On Jan 25, 2017, at 9:48 PM, Ewen Cheslack-Postava >>> wrote: >

Re: [VOTE] KIP-115: Enforce offsets.topic.replication.factor

2017-01-26 Thread Rajini Sivaram
+1 On Thu, Jan 26, 2017 at 10:01 AM, Mickael Maison wrote: > +1 Thanks for the KIP ! > > On Thu, Jan 26, 2017 at 8:39 AM, Ben Stopford wrote: > > +1 > > Ben Stopford > > Confluent, http://www.confluent.io > > > > > > > >> On 26 Jan 2017, at 07:45, James Cheng wrote:

[jira] [Assigned] (KAFKA-4557) ConcurrentModificationException in KafkaProducer event loop

2017-01-26 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram reassigned KAFKA-4557: - Assignee: Rajini Sivaram > ConcurrentModificationException in KafkaProducer event loop >

[GitHub] kafka pull request #2390: KAFKA-4630: Implement RecordTooLargeException when...

2017-01-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2390 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Updated] (KAFKA-4630) Implement RecordTooLargeException when communicating with pre-KIP-74 brokers

2017-01-26 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4630: --- Resolution: Fixed Status: Resolved (was: Patch Available) Issue resolved by pull request 2390

[jira] [Commented] (KAFKA-4630) Implement RecordTooLargeException when communicating with pre-KIP-74 brokers

2017-01-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839583#comment-15839583 ] ASF GitHub Bot commented on KAFKA-4630: --- Github user asfgit closed the pull request

[jira] [Commented] (KAFKA-4557) ConcurrentModificationException in KafkaProducer event loop

2017-01-26 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839587#comment-15839587 ] Rajini Sivaram commented on KAFKA-4557: --- [~salaev] Does the producer application sen

[jira] [Commented] (KAFKA-4557) ConcurrentModificationException in KafkaProducer event loop

2017-01-26 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839589#comment-15839589 ] Ismael Juma commented on KAFKA-4557: [~rsivaram], oh so you mean the issue is that we

[jira] [Created] (KAFKA-4700) StreamsKafkaClient drops security configs

2017-01-26 Thread Ismael Juma (JIRA)
Ismael Juma created KAFKA-4700: -- Summary: StreamsKafkaClient drops security configs Key: KAFKA-4700 URL: https://issues.apache.org/jira/browse/KAFKA-4700 Project: Kafka Issue Type: Bug

[jira] [Assigned] (KAFKA-4642) Improve test coverage of ProcessorStateManager

2017-01-26 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy reassigned KAFKA-4642: - Assignee: Damian Guy > Improve test coverage of ProcessorStateManager > -

[jira] [Commented] (KAFKA-4557) ConcurrentModificationException in KafkaProducer event loop

2017-01-26 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839608#comment-15839608 ] Rajini Sivaram commented on KAFKA-4557: --- [~ijuma] Yes, if a message is sent to the s

[GitHub] kafka pull request #2441: KAFKA-4700: Don't drop security configs in `Stream...

2017-01-26 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/2441 KAFKA-4700: Don't drop security configs in `StreamsKafkaClient` You can merge this pull request into a Git repository by running: $ git pull https://github.com/ijuma/kafka streams-kafka-client-

[jira] [Commented] (KAFKA-4700) StreamsKafkaClient drops security configs

2017-01-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839625#comment-15839625 ] ASF GitHub Bot commented on KAFKA-4700: --- GitHub user ijuma opened a pull request:

[jira] [Commented] (KAFKA-4557) ConcurrentModificationException in KafkaProducer event loop

2017-01-26 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839627#comment-15839627 ] Ismael Juma commented on KAFKA-4557: Yes, that makes sense. Thanks for figuring it out

Build failed in Jenkins: kafka-trunk-jdk7 #1881

2017-01-26 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-4630; Implement RecordTooLargeException when communicating with -- [...truncated 4066 lines...] kafka.log.LogTest > testReadWithTooSmallMaxLength STARTED kafka.log.

Re: [DISCUSS] KIP-115: Enforce offsets.topic.replication.factor

2017-01-26 Thread Stevo Slavić
If I understood well, this KIP is trying to solve for the problem of offsets.topic.replication.factor not being enforced, particularly in context of "when you have clients or tooling running as the cluster is getting setup". Assuming that this problem was observed in production, so in non-testing

[jira] [Updated] (KAFKA-4700) StreamsKafkaClient drops security configs

2017-01-26 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4700: --- Status: Patch Available (was: Open) > StreamsKafkaClient drops security configs > ---

[jira] [Updated] (KAFKA-4700) StreamsKafkaClient drops security configs

2017-01-26 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4700: --- Description: `StreamsKafkaClient` takes a `StreamsConfig` and calls `values` on it to create a `Chann

[jira] [Commented] (KAFKA-4557) ConcurrentModificationException in KafkaProducer event loop

2017-01-26 Thread Sergey Alaev (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839637#comment-15839637 ] Sergey Alaev commented on KAFKA-4557: - [~rsivaram] Yep, that's seems to be the case. A

[jira] [Comment Edited] (KAFKA-4557) ConcurrentModificationException in KafkaProducer event loop

2017-01-26 Thread Sergey Alaev (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839637#comment-15839637 ] Sergey Alaev edited comment on KAFKA-4557 at 1/26/17 12:31 PM: -

[jira] [Work started] (KAFKA-4642) Improve test coverage of ProcessorStateManager

2017-01-26 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-4642 started by Damian Guy. - > Improve test coverage of ProcessorStateManager >

[GitHub] kafka pull request #2442: KAFKA-4642: Improve test coverage of ProcessorStat...

2017-01-26 Thread dguy
GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/2442 KAFKA-4642: Improve test coverage of ProcessorStateManager Most of the exception paths weren't covered. Now they are. You can merge this pull request into a Git repository by running: $ git pull h

[jira] [Commented] (KAFKA-4642) Improve test coverage of ProcessorStateManager

2017-01-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839639#comment-15839639 ] ASF GitHub Bot commented on KAFKA-4642: --- GitHub user dguy opened a pull request:

[jira] [Updated] (KAFKA-4642) Improve test coverage of ProcessorStateManager

2017-01-26 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated KAFKA-4642: -- Status: Patch Available (was: In Progress) > Improve test coverage of ProcessorStateManager > -

[jira] [Assigned] (KAFKA-4645) Improve test coverage of ProcessorTopology

2017-01-26 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy reassigned KAFKA-4645: - Assignee: Damian Guy > Improve test coverage of ProcessorTopology > -

Build failed in Jenkins: kafka-trunk-jdk8 #1220

2017-01-26 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-4630; Implement RecordTooLargeException when communicating with -- [...truncated 4063 lines...] kafka.integration.SaslPlaintextTopicMetadataTest > testIsrAfterBroke

Build failed in Jenkins: kafka-0.10.2-jdk7 #39

2017-01-26 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-4630; Implement RecordTooLargeException when communicating with -- [...truncated 8304 lines...] kafka.network.SocketServerTest > tooBigRequestIsRejected STARTED kafk

[GitHub] kafka pull request #2443: MINOR: Close create topics policy during shutdown ...

2017-01-26 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/2443 MINOR: Close create topics policy during shutdown and more tests You can merge this pull request into a Git repository by running: $ git pull https://github.com/ijuma/kafka close-create-topics-

[jira] [Assigned] (KAFKA-4646) Improve test coverage AbstractProcessorContext

2017-01-26 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy reassigned KAFKA-4646: - Assignee: Damian Guy > Improve test coverage AbstractProcessorContext > -

[GitHub] kafka pull request #2444: KAFKA-4645: Improve test coverage of ProcessorTopo...

2017-01-26 Thread dguy
GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/2444 KAFKA-4645: Improve test coverage of ProcessorTopology the toString method prints the topology, but had no tests making sure it works and/or doesn't cause exceptions You can merge this pull request in

[jira] [Updated] (KAFKA-4645) Improve test coverage of ProcessorTopology

2017-01-26 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated KAFKA-4645: -- Status: Patch Available (was: Open) > Improve test coverage of ProcessorTopology >

[jira] [Commented] (KAFKA-4645) Improve test coverage of ProcessorTopology

2017-01-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839756#comment-15839756 ] ASF GitHub Bot commented on KAFKA-4645: --- GitHub user dguy opened a pull request:

[jira] [Created] (KAFKA-4701) Allow kafka brokers to dynamically reload truststore without restarting.

2017-01-26 Thread Allen Xiang (JIRA)
Allen Xiang created KAFKA-4701: -- Summary: Allow kafka brokers to dynamically reload truststore without restarting. Key: KAFKA-4701 URL: https://issues.apache.org/jira/browse/KAFKA-4701 Project: Kafka

[jira] [Updated] (KAFKA-4578) Upgrade notes for 0.10.2.0

2017-01-26 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4578: --- Status: Patch Available (was: Open) > Upgrade notes for 0.10.2.0 > -- > >

[jira] [Commented] (KAFKA-4578) Upgrade notes for 0.10.2.0

2017-01-26 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839783#comment-15839783 ] Ismael Juma commented on KAFKA-4578: PR: https://github.com/apache/kafka/pull/2445 >

[GitHub] kafka pull request #2446: KAFKA-4701: Add dynamic truststore manager.

2017-01-26 Thread allenxiang
GitHub user allenxiang opened a pull request: https://github.com/apache/kafka/pull/2446 KAFKA-4701: Add dynamic truststore manager. Allow kafka brokers to dynamically reload truststore without restarting. You can merge this pull request into a Git repository by running: $ git p

[jira] [Commented] (KAFKA-4701) Allow kafka brokers to dynamically reload truststore without restarting.

2017-01-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839787#comment-15839787 ] ASF GitHub Bot commented on KAFKA-4701: --- GitHub user allenxiang opened a pull reques

[jira] [Commented] (KAFKA-4578) Upgrade notes for 0.10.2.0

2017-01-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839786#comment-15839786 ] ASF GitHub Bot commented on KAFKA-4578: --- GitHub user ijuma opened a pull request:

[GitHub] kafka pull request #2445: KAFKA-4578: Upgrade notes for 0.10.2.0

2017-01-26 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/2445 KAFKA-4578: Upgrade notes for 0.10.2.0 You can merge this pull request into a Git repository by running: $ git pull https://github.com/ijuma/kafka kafka-4578-upgrade-notes-0.10.2 Alternatively

[GitHub] kafka pull request #2447: KAFKA-4646: Improve test coverage AbstractProcesso...

2017-01-26 Thread dguy
GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/2447 KAFKA-4646: Improve test coverage AbstractProcessorContext Exception paths in `register()`, `topic()`, `partition()`, `offset()`, and `timestamp()`, were not covered by any existing tests You can merg

[jira] [Updated] (KAFKA-4646) Improve test coverage AbstractProcessorContext

2017-01-26 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated KAFKA-4646: -- Status: Patch Available (was: Reopened) > Improve test coverage AbstractProcessorContext >

[jira] [Commented] (KAFKA-4646) Improve test coverage AbstractProcessorContext

2017-01-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839831#comment-15839831 ] ASF GitHub Bot commented on KAFKA-4646: --- GitHub user dguy opened a pull request:

[jira] [Assigned] (KAFKA-4644) Improve test coverage of StreamsPartitionAssignor

2017-01-26 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy reassigned KAFKA-4644: - Assignee: Damian Guy > Improve test coverage of StreamsPartitionAssignor > --

[jira] [Assigned] (KAFKA-1368) Upgrade log4j

2017-01-26 Thread Mickael Maison (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison reassigned KAFKA-1368: - Assignee: Mickael Maison > Upgrade log4j > - > > Key: KAFKA-1

[jira] [Updated] (KAFKA-4701) Allow kafka brokers to dynamically reload truststore without restarting.

2017-01-26 Thread Allen Xiang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Xiang updated KAFKA-4701: --- Description: Right now in order to add SSL clients(update broker truststores), a rolling restart of al

[jira] [Commented] (KAFKA-3779) Add the LRU cache for KTable.to() operator

2017-01-26 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839939#comment-15839939 ] Ismael Juma commented on KAFKA-3779: Should we move this to a future release version (

[jira] [Commented] (KAFKA-3429) Remove Serdes needed for repartitioning in KTable stateful operations

2017-01-26 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839941#comment-15839941 ] Ismael Juma commented on KAFKA-3429: Should we move this to a future release version (

[jira] [Updated] (KAFKA-3779) Add the LRU cache for KTable.to() operator

2017-01-26 Thread Eno Thereska (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eno Thereska updated KAFKA-3779: Fix Version/s: (was: 0.10.2.0) 0.10.3.0 > Add the LRU cache for KTable.to() o

[jira] [Commented] (KAFKA-3779) Add the LRU cache for KTable.to() operator

2017-01-26 Thread Eno Thereska (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839942#comment-15839942 ] Eno Thereska commented on KAFKA-3779: - [~ijuma] Done, thanks. > Add the LRU cache for

[jira] [Updated] (KAFKA-2334) Prevent HW from going back during leader failover

2017-01-26 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-2334: --- Fix Version/s: (was: 0.10.2.0) 0.10.3.0 > Prevent HW from going back during lea

[jira] [Updated] (KAFKA-4637) Update system test(s) to use multiple listeners for the same security protocol

2017-01-26 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4637: --- Fix Version/s: (was: 0.10.2.0) 0.10.3.0 > Update system test(s) to use multiple

[jira] [Updated] (KAFKA-2334) Prevent HW from going back during leader failover

2017-01-26 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-2334: --- Labels: reliability (was: ) > Prevent HW from going back during leader failover > --

[jira] [Updated] (KAFKA-4569) Transient failure in org.apache.kafka.clients.consumer.KafkaConsumerTest.testWakeupWithFetchDataAvailable

2017-01-26 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4569: --- Fix Version/s: (was: 0.10.2.0) 0.10.3.0 > Transient failure in > org.apache.ka

[jira] [Commented] (KAFKA-4569) Transient failure in org.apache.kafka.clients.consumer.KafkaConsumerTest.testWakeupWithFetchDataAvailable

2017-01-26 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839945#comment-15839945 ] Ismael Juma commented on KAFKA-4569: [~umesh9...@gmail.com], have you tried running th

[jira] [Updated] (KAFKA-4644) Improve test coverage of StreamsPartitionAssignor

2017-01-26 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated KAFKA-4644: -- Status: Patch Available (was: Open) > Improve test coverage of StreamsPartitionAssignor > -

[GitHub] kafka pull request #2448: KAFKA-4644: Improve test coverage of StreamsPartit...

2017-01-26 Thread dguy
GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/2448 KAFKA-4644: Improve test coverage of StreamsPartitionAssignor Some exception paths not previously covered. Extracted `ensureCopartitioning` into a static class. You can merge this pull request into a

[jira] [Resolved] (KAFKA-4694) Streams smoke tests fails when there is only 1 broker

2017-01-26 Thread Eno Thereska (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eno Thereska resolved KAFKA-4694. - Resolution: Fixed > Streams smoke tests fails when there is only 1 broker > --

[jira] [Commented] (KAFKA-4644) Improve test coverage of StreamsPartitionAssignor

2017-01-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839991#comment-15839991 ] ASF GitHub Bot commented on KAFKA-4644: --- GitHub user dguy opened a pull request:

[GitHub] kafka pull request #2449: KAFKA-4557: Handle Producer.send correctly in expi...

2017-01-26 Thread rajinisivaram
GitHub user rajinisivaram opened a pull request: https://github.com/apache/kafka/pull/2449 KAFKA-4557: Handle Producer.send correctly in expiry callbacks When iterating deque for expiring record batches, delay the actual completion of the batch until iteration is complete since call

[jira] [Commented] (KAFKA-4557) ConcurrentModificationException in KafkaProducer event loop

2017-01-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839994#comment-15839994 ] ASF GitHub Bot commented on KAFKA-4557: --- GitHub user rajinisivaram opened a pull req

[jira] [Created] (KAFKA-4702) Parametrize streams benchmarks to run at scale

2017-01-26 Thread Eno Thereska (JIRA)
Eno Thereska created KAFKA-4702: --- Summary: Parametrize streams benchmarks to run at scale Key: KAFKA-4702 URL: https://issues.apache.org/jira/browse/KAFKA-4702 Project: Kafka Issue Type: Improv

[jira] [Work started] (KAFKA-4702) Parametrize streams benchmarks to run at scale

2017-01-26 Thread Eno Thereska (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-4702 started by Eno Thereska. --- > Parametrize streams benchmarks to run at scale >

[jira] [Assigned] (KAFKA-4647) Improve test coverage of GlobalStreamThread

2017-01-26 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy reassigned KAFKA-4647: - Assignee: Damian Guy > Improve test coverage of GlobalStreamThread >

[jira] [Commented] (KAFKA-4676) Kafka consumers gets stuck for some partitions

2017-01-26 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15840024#comment-15840024 ] Ismael Juma commented on KAFKA-4676: [~hachikuji], is this something that we need to f

[GitHub] kafka pull request #2450: KAFKA-4647: Improve test coverage of GlobalStreamT...

2017-01-26 Thread dguy
GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/2450 KAFKA-4647: Improve test coverage of GlobalStreamThread Add a test to ensure a `StreamsException` is thrown when an exception other than `StreamsException` is caught You can merge this pull request in

[jira] [Updated] (KAFKA-4647) Improve test coverage of GlobalStreamThread

2017-01-26 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated KAFKA-4647: -- Status: Patch Available (was: Open) > Improve test coverage of GlobalStreamThread > ---

[jira] [Commented] (KAFKA-4647) Improve test coverage of GlobalStreamThread

2017-01-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15840055#comment-15840055 ] ASF GitHub Bot commented on KAFKA-4647: --- GitHub user dguy opened a pull request:

Re: [DISCUSS] KIP-115: Enforce offsets.topic.replication.factor

2017-01-26 Thread Colin McCabe
Hi all, +1 (non-binding) for KIP-115. On Thu, Jan 26, 2017, at 04:26, Stevo Slavić wrote: > If I understood well, this KIP is trying to solve for the problem of > offsets.topic.replication.factor not being enforced, particularly in > context of "when you have clients or tooling running as the cl

Re: [VOTE] KIP-115: Enforce offsets.topic.replication.factor

2017-01-26 Thread Colin McCabe
+1 (non-binding) On Wed, Jan 25, 2017, at 16:34, Onur Karaman wrote: > I'd like to start the vote for KIP-115: Enforce > offsets.topic.replication.factor > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-115%3A+Enforce+offsets.topic.replication.factor > > - Onur

[jira] [Assigned] (KAFKA-4648) Improve test coverage StreamTask

2017-01-26 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy reassigned KAFKA-4648: - Assignee: Damian Guy > Improve test coverage StreamTask > > >

[jira] [Resolved] (KAFKA-4699) Transient Failure PlaintextConsumerTest.testInterceptros

2017-01-26 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-4699. Resolution: Fixed Issue resolved by pull request 2440 [https://github.com/apache/kafka/pull/

[GitHub] kafka pull request #2440: KAFKA-4699: Invoke producer callbacks before compl...

2017-01-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2440 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-4699) Transient Failure PlaintextConsumerTest.testInterceptros

2017-01-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15840141#comment-15840141 ] ASF GitHub Bot commented on KAFKA-4699: --- Github user asfgit closed the pull request

[GitHub] kafka pull request #2451: KAFKA-4640: Improve test coverage StreamTask

2017-01-26 Thread dguy
GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/2451 KAFKA-4640: Improve test coverage StreamTask Provide test coverage for exception paths in: `schedule()`, `closeTopology()`, and `punctuate()` You can merge this pull request into a Git repository by r

[jira] [Commented] (KAFKA-4640) Improve Streams unit test coverage

2017-01-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15840143#comment-15840143 ] ASF GitHub Bot commented on KAFKA-4640: --- GitHub user dguy opened a pull request:

[jira] [Updated] (KAFKA-4648) Improve test coverage StreamTask

2017-01-26 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated KAFKA-4648: -- Status: Patch Available (was: Open) > Improve test coverage StreamTask > --

Re: [DISCUSS] KIP-112: Handle disk failure for JBOD

2017-01-26 Thread Colin McCabe
On Wed, Jan 25, 2017, at 13:50, Dong Lin wrote: > Hey Colin, > > Good point! Yeah we have actually considered and tested this solution, > which we call one-broker-per-disk. It would work and should require no > major change in Kafka as compared to this JBOD KIP. So it would be a good > short term

[jira] [Assigned] (KAFKA-4649) Improve test coverage GlobalStateManagerImpl

2017-01-26 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy reassigned KAFKA-4649: - Assignee: Damian Guy > Improve test coverage GlobalStateManagerImpl > ---

[GitHub] kafka pull request #2452: KAFKA-4649: Improve test coverage GlobalStateManag...

2017-01-26 Thread dguy
GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/2452 KAFKA-4649: Improve test coverage GlobalStateManagerImpl Add coverage for exception paths in `initialize()` You can merge this pull request into a Git repository by running: $ git pull https://git

[jira] [Commented] (KAFKA-4649) Improve test coverage GlobalStateManagerImpl

2017-01-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15840168#comment-15840168 ] ASF GitHub Bot commented on KAFKA-4649: --- GitHub user dguy opened a pull request:

[jira] [Updated] (KAFKA-4649) Improve test coverage GlobalStateManagerImpl

2017-01-26 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated KAFKA-4649: -- Status: Patch Available (was: Open) > Improve test coverage GlobalStateManagerImpl > --

[jira] [Updated] (KAFKA-3429) Remove Serdes needed for repartitioning in KTable stateful operations

2017-01-26 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-3429: --- Fix Version/s: (was: 0.10.2.0) > Remove Serdes needed for repartitioning in KTable statefu

Re: [DISCUSS] KIP-112: Handle disk failure for JBOD

2017-01-26 Thread Dong Lin
Hey Colin, Thanks much for the comment. Please see me comment inline. On Thu, Jan 26, 2017 at 10:15 AM, Colin McCabe wrote: > On Wed, Jan 25, 2017, at 13:50, Dong Lin wrote: > > Hey Colin, > > > > Good point! Yeah we have actually considered and tested this solution, > > which we call one-broke

Re: Trying to understand design decision about producer ack and min.insync.replicas

2017-01-26 Thread Ewen Cheslack-Postava
The acks setting for the producer doesn't affect the final durability guarantees. These are still enforced by the replication and min ISR settings. Instead, the ack setting just lets the producer control how durable the write is before *that producer* can consider the write "complete", i.e. before

Build failed in Jenkins: kafka-trunk-jdk7 #1882

2017-01-26 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-4699; Invoke producer callbacks before completing the future -- [...truncated 4064 lines...] kafka.producer.AsyncProducerTest > testInvalidPartition STARTED kafka.pr

[jira] [Updated] (KAFKA-4667) Connect should create internal topics

2017-01-26 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-4667: - Summary: Connect should create internal topics (was: Connect (and Stream?) should

[jira] [Commented] (KAFKA-4517) Remove kafka-consumer-offset-checker.sh script since already deprecated in Kafka 9

2017-01-26 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15840259#comment-15840259 ] Ewen Cheslack-Postava commented on KAFKA-4517: -- oh, I missed the PR, but yeah

Build failed in Jenkins: kafka-0.10.2-jdk7 #40

2017-01-26 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-4699; Invoke producer callbacks before completing the future -- [...truncated 4065 lines...] kafka.integration.SslTopicMetadataTest > testAliveBrokersListWithNoTopics

[jira] [Work started] (KAFKA-4665) Inconsistent handling of non-existing topics in offset fetch handling

2017-01-26 Thread Vahid Hashemian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-4665 started by Vahid Hashemian. -- > Inconsistent handling of non-existing topics in offset fetch handling > ---

[jira] [Commented] (KAFKA-4665) Inconsistent handling of non-existing topics in offset fetch handling

2017-01-26 Thread Vahid Hashemian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15840346#comment-15840346 ] Vahid Hashemian commented on KAFKA-4665: {quote} Note also that currently the cons

  1   2   >