[jira] [Comment Edited] (KAFKA-5351) Broker clean bounce test puts the broker into a 'CONCURRENT_TRANSACTIONS' state permanently

2017-05-31 Thread Apurva Mehta (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16030729#comment-16030729 ] Apurva Mehta edited comment on KAFKA-5351 at 5/31/17 6:59 AM: --

[jira] [Commented] (KAFKA-4668) Mirrormaker should default to auto.offset.reset=earliest

2017-05-31 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16030735#comment-16030735 ] Ismael Juma commented on KAFKA-4668: This probably needs a simple KIP. Also cc [~becke

[jira] [Updated] (KAFKA-4668) Mirrormaker should default to auto.offset.reset=earliest

2017-05-31 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4668: --- Fix Version/s: (was: 0.11.0.0) 0.11.1.0 > Mirrormaker should default to auto.of

[jira] [Updated] (KAFKA-3689) Exception when attempting to decrease connection count for address with no connections

2017-05-31 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3689: --- Fix Version/s: (was: 0.11.0.0) 0.11.0.1 > Exception when attempting to decrease

[jira] [Updated] (KAFKA-4637) Update system test(s) to use multiple listeners for the same security protocol

2017-05-31 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4637: --- Labels: newbie (was: ) > Update system test(s) to use multiple listeners for the same security protoc

[jira] [Updated] (KAFKA-4637) Update system test(s) to use multiple listeners for the same security protocol

2017-05-31 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4637: --- Fix Version/s: (was: 0.11.0.0) > Update system test(s) to use multiple listeners for the same secu

[jira] [Commented] (KAFKA-4665) Inconsistent handling of non-existing topics in offset fetch handling

2017-05-31 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16030736#comment-16030736 ] Ismael Juma commented on KAFKA-4665: [~hachikuji], is this still planned for 0.11.0.0?

[jira] [Updated] (KAFKA-3986) completedReceives can contain closed channels

2017-05-31 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3986: --- Fix Version/s: (was: 0.11.0.0) 0.11.1.0 > completedReceives can contain closed

[jira] [Updated] (KAFKA-3866) KerberosLogin refresh time bug and other improvements

2017-05-31 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3866: --- Fix Version/s: (was: 0.11.0.0) 0.11.0.1 > KerberosLogin refresh time bug and ot

[jira] [Updated] (KAFKA-5349) KafkaConsumer occasionally hits IllegalStateException

2017-05-31 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-5349: --- Priority: Blocker (was: Major) > KafkaConsumer occasionally hits IllegalStateException >

[jira] [Comment Edited] (KAFKA-5351) Broker clean bounce test puts the broker into a 'CONCURRENT_TRANSACTIONS' state permanently

2017-05-31 Thread Apurva Mehta (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16030729#comment-16030729 ] Apurva Mehta edited comment on KAFKA-5351 at 5/31/17 7:03 AM: --

[jira] [Updated] (KAFKA-5349) KafkaConsumer occasionally hits IllegalStateException

2017-05-31 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-5349: --- Fix Version/s: 0.11.0.0 > KafkaConsumer occasionally hits IllegalStateException >

[jira] [Assigned] (KAFKA-5349) KafkaConsumer occasionally hits IllegalStateException

2017-05-31 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson reassigned KAFKA-5349: -- Assignee: Jason Gustafson > KafkaConsumer occasionally hits IllegalStateException > ---

Build failed in Jenkins: kafka-0.11.0-jdk7 #54

2017-05-31 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-5211; Do not skip a corrupted record in consumer -- [...truncated 905.01 KB...] kafka.controller.ControllerEventManagerTest > testSuccessfulEven

[jira] [Commented] (KAFKA-5349) KafkaConsumer occasionally hits IllegalStateException

2017-05-31 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16030742#comment-16030742 ] ASF GitHub Bot commented on KAFKA-5349: --- GitHub user hachikuji opened a pull request

[GitHub] kafka pull request #3175: KAFKA-5349: Fix illegal state error in consumer's ...

2017-05-31 Thread hachikuji
GitHub user hachikuji opened a pull request: https://github.com/apache/kafka/pull/3175 KAFKA-5349: Fix illegal state error in consumer's ListOffset handler You can merge this pull request into a Git repository by running: $ git pull https://github.com/hachikuji/kafka KAFKA-534

Build failed in Jenkins: kafka-trunk-jdk8 #1616

2017-05-31 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-5211; Do not skip a corrupted record in consumer -- [...truncated 3.54 MB...] org.apache.kafka.common.security.scram.ScramMessagesTest > validS

[jira] [Updated] (KAFKA-2947) AlterTopic - protocol and server side implementation

2017-05-31 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-2947: --- Fix Version/s: (was: 0.11.0.0) > AlterTopic - protocol and server side implementation > --

[jira] [Updated] (KAFKA-2939) Make AbstractConfig.logUnused() tunable for clients

2017-05-31 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-2939: --- Fix Version/s: (was: 0.11.0.0) > Make AbstractConfig.logUnused() tunable for clients > ---

[jira] [Updated] (KAFKA-2651) Remove deprecated config alteration from TopicCommand in 0.9.1.0

2017-05-31 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-2651: --- Fix Version/s: (was: 0.11.0.0) 0.12.0.0 > Remove deprecated config alteration f

[jira] [Commented] (KAFKA-2651) Remove deprecated config alteration from TopicCommand in 0.9.1.0

2017-05-31 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16030768#comment-16030768 ] Ismael Juma commented on KAFKA-2651: [~omkreddy], yes, I'm aware that it has been depr

[jira] [Updated] (KAFKA-2334) Prevent HW from going back during leader failover

2017-05-31 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-2334: --- Fix Version/s: (was: 0.11.0.0) 0.11.1.0 > Prevent HW from going back during lea

[jira] [Updated] (KAFKA-2435) More optimally balanced partition assignment strategy

2017-05-31 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-2435: --- Fix Version/s: (was: 0.11.0.0) 0.11.1.0 > More optimally balanced partition ass

[jira] [Commented] (KAFKA-2334) Prevent HW from going back during leader failover

2017-05-31 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16030772#comment-16030772 ] Ismael Juma commented on KAFKA-2334: Is this still an issue? > Prevent HW from going

[jira] [Updated] (KAFKA-1923) Negative offsets in replication-offset-checkpoint file

2017-05-31 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-1923: --- Fix Version/s: (was: 0.11.0.0) 0.11.0.1 > Negative offsets in replication-offse

[jira] [Updated] (KAFKA-2200) kafkaProducer.send() should not call callback.onCompletion()

2017-05-31 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-2200: --- Fix Version/s: (was: 0.11.0.0) 0.11.1.0 > kafkaProducer.send() should not call

[jira] [Updated] (KAFKA-3252) compression type for a topic should be used during log compaction

2017-05-31 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3252: --- Fix Version/s: (was: 0.11.0.0) 0.11.1.0 > compression type for a topic should b

[jira] [Updated] (KAFKA-3203) Add UnknownCodecException and UnknownMagicByteException to error mapping

2017-05-31 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3203: --- Fix Version/s: (was: 0.11.0.0) > Add UnknownCodecException and UnknownMagicByteException to error

[jira] [Updated] (KAFKA-3356) Remove ConsumerOffsetChecker, deprecated in 0.9, in 0.11

2017-05-31 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3356: --- Fix Version/s: (was: 0.11.0.0) 0.12.0.0 > Remove ConsumerOffsetChecker, depreca

[jira] [Commented] (KAFKA-3356) Remove ConsumerOffsetChecker, deprecated in 0.9, in 0.11

2017-05-31 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16030792#comment-16030792 ] Ismael Juma commented on KAFKA-3356: Given the code freeze today and everything else t

[GitHub] kafka pull request #3102: Follow-up improvements for consumer offset reset t...

2017-05-31 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3102 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Resolved] (KAFKA-5266) Follow-up improvements for consumer offset reset tool (KIP-122)

2017-05-31 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-5266. Resolution: Fixed Issue resolved by pull request 3102 [https://github.com/apache/kafka/pull/

[GitHub] kafka pull request #3176: MINOR: Improve assert in `ControllerFailoverTest`

2017-05-31 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/3176 MINOR: Improve assert in `ControllerFailoverTest` It sometimes fails like: ```text java.lang.AssertionError: IllegalStateException was not thrown at org.junit.Assert.fail(Assert.ja

[jira] [Commented] (KAFKA-3356) Remove ConsumerOffsetChecker, deprecated in 0.9, in 0.11

2017-05-31 Thread Jeff Widman (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16030804#comment-16030804 ] Jeff Widman commented on KAFKA-3356: Is there anyway to get this to land today? This

Build failed in Jenkins: kafka-trunk-jdk8 #1617

2017-05-31 Thread Apache Jenkins Server
See Changes: [wangguoz] KAKFA-5334: Allow rocksdb.config.setter to be specified as a String or [wangguoz] KAFKA-5308; TC should handle UNSUPPORTED_FOR_MESSAGE_FORMAT in

Build failed in Jenkins: kafka-0.11.0-jdk7 #55

2017-05-31 Thread Apache Jenkins Server
See Changes: [wangguoz] KAKFA-5334: Allow rocksdb.config.setter to be specified as a String or [wangguoz] KAFKA-5308; TC should handle UNSUPPORTED_FOR_MESSAGE_FORMAT in -

Jenkins build is back to normal : kafka-trunk-jdk7 #2295

2017-05-31 Thread Apache Jenkins Server
See

Jenkins build is back to normal : kafka-0.11.0-jdk7 #56

2017-05-31 Thread Apache Jenkins Server
See

[GitHub] kafka pull request #3176: MINOR: Improve assert in `ControllerFailoverTest`

2017-05-31 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3176 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] kafka pull request #3175: KAFKA-5349: Fix illegal state error in consumer's ...

2017-05-31 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3175 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-5349) KafkaConsumer occasionally hits IllegalStateException

2017-05-31 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16030892#comment-16030892 ] ASF GitHub Bot commented on KAFKA-5349: --- Github user asfgit closed the pull request

[jira] [Resolved] (KAFKA-5349) KafkaConsumer occasionally hits IllegalStateException

2017-05-31 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-5349. Resolution: Fixed > KafkaConsumer occasionally hits IllegalStateException >

Build failed in Jenkins: kafka-trunk-jdk7 #2296

2017-05-31 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-5266; Follow-up improvements for consumer offset reset tool -- [...truncated 906.76 KB...] kafka.admin.ConfigCommandTest > shouldNotUpdateBrok

[jira] [Commented] (KAFKA-3733) Avoid long command lines by setting CLASSPATH in environment

2017-05-31 Thread JIRA
[ https://issues.apache.org/jira/browse/KAFKA-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16030932#comment-16030932 ] Christopher Mårtensson commented on KAFKA-3733: --- I can add that the long com

Jenkins build is back to normal : kafka-trunk-jdk8 #1618

2017-05-31 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-4270) ClassCast for Agregation

2017-05-31 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-4270. --- Resolution: Cannot Reproduce Closing this as haven't been able to reproduce and no further information

[jira] [Resolved] (KAFKA-4953) Global Store: cast exception when initialising with in-memory logged state store

2017-05-31 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-4953. --- Resolution: Fixed fixed by KAFKA-5045 > Global Store: cast exception when initialising with in-memory

Build failed in Jenkins: kafka-trunk-jdk7 #2297

2017-05-31 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Improve assert in ControllerFailoverTest [ismael] KAFKA-5349; Fix illegal state error in consumer's ListOffset handler -- [...truncated 906.0

[jira] [Created] (KAFKA-5352) Support automatic restart of failed tasks

2017-05-31 Thread Jiri Pechanec (JIRA)
Jiri Pechanec created KAFKA-5352: Summary: Support automatic restart of failed tasks Key: KAFKA-5352 URL: https://issues.apache.org/jira/browse/KAFKA-5352 Project: Kafka Issue Type: New Featu

[GitHub] kafka pull request #3177: MINOR: Set baseSequence correctly if log append ti...

2017-05-31 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/3177 MINOR: Set baseSequence correctly if log append time and no broker recompression This makes it consistent with the case where there is recompression. Thanks to @edenhill who found the issue while

[GitHub] kafka pull request #3178: MINOR: Use new consumer in ProducerCompressionTest

2017-05-31 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/3178 MINOR: Use new consumer in ProducerCompressionTest Hopefully this will be less flaky. If not, it should be easier to fix debug than the old SimpleConsumer. For the record, the error in Jenkins

Re: KIP-162: Enable topic deletion by default

2017-05-31 Thread Jim Jagielski
+1 > On May 27, 2017, at 9:27 PM, Vahid S Hashemian > wrote: > > Sure, that sounds good. > > I suggested that to keep command line behavior consistent. > Plus, removal of ACL access is something that can be easily undone, but > topic deletion is not reversible. > So, perhaps a new follow-up JI

Can you give me permission to add a KIP

2017-05-31 Thread Ma Tianchi
Hi, I want to add a KIP as KAFKA-5319 ( https://issues.apache.org/jira/browse/KAFKA-5319 ),please give me permission to add a KIP.My username is marktcma . Thanks, Ma Tianchi

[jira] [Created] (KAFKA-5353) Set baseSequence correctly if log append time and no broker recompression

2017-05-31 Thread Ismael Juma (JIRA)
Ismael Juma created KAFKA-5353: -- Summary: Set baseSequence correctly if log append time and no broker recompression Key: KAFKA-5353 URL: https://issues.apache.org/jira/browse/KAFKA-5353 Project: Kafka

[jira] [Updated] (KAFKA-5353) Set baseTimestamp correctly if log append time and no broker recompression

2017-05-31 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-5353: --- Description: We currently don't update baseTimestamp in this case (just maxTimestamp), which is incons

[jira] [Updated] (KAFKA-5353) Set baseTimestamp correctly if log append time and no broker recompression

2017-05-31 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-5353: --- Summary: Set baseTimestamp correctly if log append time and no broker recompression (was: Set baseSe

[jira] [Updated] (KAFKA-5226) NullPointerException (NPE) in SourceNodeRecordDeserializer.deserialize

2017-05-31 Thread Bill Bejeck (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck updated KAFKA-5226: --- Fix Version/s: (was: 0.11.0.0) 0.11.0.1 > NullPointerException (NPE) in SourceN

[GitHub] kafka pull request #3179: MINOR: update stream docs for kip-134

2017-05-31 Thread dguy
GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/3179 MINOR: update stream docs for kip-134 Add a section in the streams docs about the broker config introduced in KIP-134 You can merge this pull request into a Git repository by running: $ git pull

[GitHub] kafka pull request #3178: MINOR: Use new consumer in ProducerCompressionTest

2017-05-31 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3178 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Build failed in Jenkins: kafka-trunk-jdk8 #1620

2017-05-31 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Use new consumer in ProducerCompressionTest -- [...truncated 903.56 KB...] kafka.integration.PrimitiveApiTest > testMultiProduce PASSED kafka

[jira] [Updated] (KAFKA-5339) Transactions system test with hard broker bounces fails sporadically

2017-05-31 Thread Apurva Mehta (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apurva Mehta updated KAFKA-5339: Priority: Major (was: Blocker) > Transactions system test with hard broker bounces fails sporadical

Jenkins build is back to normal : kafka-trunk-jdk7 #2298

2017-05-31 Thread Apache Jenkins Server
See

[jira] [Commented] (KAFKA-5352) Support automatic restart of failed tasks

2017-05-31 Thread Randall Hauch (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16031472#comment-16031472 ] Randall Hauch commented on KAFKA-5352: -- Potentially related to KAFKA-3819, and it's p

[GitHub] kafka pull request #3120: Kafka 5265

2017-05-31 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3120 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Resolved] (KAFKA-5265) Move ACLs, Config, NodeVersions classes into org.apache.kafka.common

2017-05-31 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-5265. Resolution: Fixed Issue resolved by pull request 3120 [https://github.com/apache/kafka/pull/3120] >

[GitHub] kafka pull request #3180: MINOR: reuse decompression buffers in log cleaner

2017-05-31 Thread xvrl
GitHub user xvrl opened a pull request: https://github.com/apache/kafka/pull/3180 MINOR: reuse decompression buffers in log cleaner follow-up to KAFKA-5150, reuse decompression buffers in the log cleaner thread. @ijuma @hachikuji You can merge this pull request into a Git

[jira] [Commented] (KAFKA-5150) LZ4 decompression is 4-5x slower than Snappy on small batches / messages

2017-05-31 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16031486#comment-16031486 ] ASF GitHub Bot commented on KAFKA-5150: --- GitHub user xvrl opened a pull request:

Re: Request a permission to KIP

2017-05-31 Thread Guozhang Wang
Tianchi, You should be able to create new wiki pages now. Guozhang On Tue, May 30, 2017 at 8:31 PM, Ma Tianchi wrote: > Hi, > I want to get a permission to add a KIP.My wiki username is marktcma. > Tahnks. -- -- Guozhang

[GitHub] kafka pull request #3181: KAFKA-5154: Consumer fetches from revoked partitio...

2017-05-31 Thread dguy
GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/3181 KAFKA-5154: Consumer fetches from revoked partitions when SyncGroup fails with disconnection [WIP] Scenario is as follows: 1. Consumer subscribes to topic t1 and begins consuming 2. heartbeat f

[jira] [Commented] (KAFKA-5154) Kafka Streams throws NPE during rebalance

2017-05-31 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16031499#comment-16031499 ] ASF GitHub Bot commented on KAFKA-5154: --- GitHub user dguy opened a pull request:

[jira] [Assigned] (KAFKA-5319) Add a tool to make cluster replica and leader balance

2017-05-31 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang reassigned KAFKA-5319: Assignee: Ma Tianchi > Add a tool to make cluster replica and leader balance >

Build failed in Jenkins: kafka-trunk-jdk8 #1621

2017-05-31 Thread Apache Jenkins Server
See -- [...truncated 904.32 KB...] kafka.integration.PrimitiveApiTest > testMultiProduce PASSED kafka.integration.PrimitiveApiTest > testDefaultEncoderProducerAndFetch STARTED kafka.int

[jira] [Updated] (KAFKA-4064) Add support for infinite endpoints for range queries in Kafka Streams KV stores

2017-05-31 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-4064: - Fix Version/s: (was: 0.11.0.0) 0.11.1.0 > Add support for infinite endpoint

[jira] [Commented] (KAFKA-4064) Add support for infinite endpoints for range queries in Kafka Streams KV stores

2017-05-31 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16031598#comment-16031598 ] Guozhang Wang commented on KAFKA-4064: -- [~ijuma] I will update the fix version. > Ad

[jira] [Created] (KAFKA-5354) MirrorMaker not preserving headers

2017-05-31 Thread Jun Rao (JIRA)
Jun Rao created KAFKA-5354: -- Summary: MirrorMaker not preserving headers Key: KAFKA-5354 URL: https://issues.apache.org/jira/browse/KAFKA-5354 Project: Kafka Issue Type: Bug Affects Versions: 0.

[jira] [Commented] (KAFKA-5354) MirrorMaker not preserving headers

2017-05-31 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16031603#comment-16031603 ] Jun Rao commented on KAFKA-5354: [~michael.andre.pearce], could you confirm if this is ind

[jira] [Commented] (KAFKA-4064) Add support for infinite endpoints for range queries in Kafka Streams KV stores

2017-05-31 Thread JIRA
[ https://issues.apache.org/jira/browse/KAFKA-4064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16031608#comment-16031608 ] Xavier Léauté commented on KAFKA-4064: -- [~ijuma] [~guozhang] we haven't done the KIP

[jira] [Resolved] (KAFKA-5159) Update Kafka documentation to mention AdminClient

2017-05-31 Thread Colin P. McCabe (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin P. McCabe resolved KAFKA-5159. Resolution: Duplicate > Update Kafka documentation to mention AdminClient >

Re: Kafka Connect Parquet Support?

2017-05-31 Thread Colin McCabe
Hi Clayton, It seems like an interesting improvement. Given that Parquet is columnar, you would expect some space savings. I guess the big question is, would each batch of records become a single parquet file? And how does this integrate with the existing logic, which might assume that each rec

[GitHub] kafka pull request #3182: MINOR: Use `waitUntil` to fix transient failures o...

2017-05-31 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/3182 MINOR: Use `waitUntil` to fix transient failures of ControllerFailoverTest Without it, it's possible that the assertion is checked before the exception is thrown in the callback. You can merge thi

[jira] [Assigned] (KAFKA-3623) Make KStreamTestDriver extending from ExternalResource

2017-05-31 Thread Mariam John (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mariam John reassigned KAFKA-3623: -- Assignee: Mariam John > Make KStreamTestDriver extending from ExternalResource > --

Jenkins build is back to normal : kafka-trunk-jdk8 #1622

2017-05-31 Thread Apache Jenkins Server
See

[jira] [Updated] (KAFKA-5340) Add additional test cases for batch splitting to ensure idempotent/transactional metadata is preserved

2017-05-31 Thread Apurva Mehta (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apurva Mehta updated KAFKA-5340: Labels: exactly-once (was: ) Priority: Blocker (was: Major) > Add additional test cases for

[jira] [Assigned] (KAFKA-5283) Update clients and server code to make sure that epoch and sequence numbers wrap around

2017-05-31 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson reassigned KAFKA-5283: -- Assignee: Jason Gustafson > Update clients and server code to make sure that epoch and

Re: [DISCUSS] KIP-150 - Kafka-Streams Cogroup

2017-05-31 Thread Kyle Winkelman
Hello all, I have spent some more time on this and the best alternative I have come up with is: KGroupedStream has a single cogroup call that takes an initializer and an aggregator. CogroupedKStream has a cogroup call that takes additional groupedStream aggregator pairs. CogroupedKStream has multi

[jira] [Updated] (KAFKA-5351) Broker clean bounce test puts the broker into a 'CONCURRENT_TRANSACTIONS' state permanently

2017-05-31 Thread Apurva Mehta (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apurva Mehta updated KAFKA-5351: Attachment: kafka-5351.logs.tar.gz > Broker clean bounce test puts the broker into a 'CONCURRENT_TRA

[jira] [Commented] (KAFKA-5351) Broker clean bounce test puts the broker into a 'CONCURRENT_TRANSACTIONS' state permanently

2017-05-31 Thread Apurva Mehta (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16031764#comment-16031764 ] Apurva Mehta commented on KAFKA-5351: - [~guozhang] here are all the logs from a pertin

[jira] [Updated] (KAFKA-5112) Trunk compatibility tests should test against 0.10.2

2017-05-31 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-5112: --- Priority: Blocker (was: Major) > Trunk compatibility tests should test against 0.10.2 > -

[jira] [Updated] (KAFKA-5112) Trunk compatibility tests should test against 0.10.2

2017-05-31 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-5112: --- Fix Version/s: 0.11.0.0 > Trunk compatibility tests should test against 0.10.2 > -

[jira] [Updated] (KAFKA-5112) Trunk compatibility tests should test against 0.10.2

2017-05-31 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-5112: --- Status: Patch Available (was: Open) > Trunk compatibility tests should test against 0.10.2 >

[jira] [Commented] (KAFKA-5351) Broker clean bounce test puts the broker into a 'CONCURRENT_TRANSACTIONS' state permanently

2017-05-31 Thread Apurva Mehta (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16031807#comment-16031807 ] Apurva Mehta commented on KAFKA-5351: - I found the bug. The problem is that the coordi

[jira] [Commented] (KAFKA-2526) Console Producer / Consumer's serde config is not working

2017-05-31 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16031849#comment-16031849 ] Guozhang Wang commented on KAFKA-2526: -- [~huxi_2b] are you picking this up? > Consol

[GitHub] kafka pull request #3183: KAFKA-5283: Handle producer epoch/sequence overflo...

2017-05-31 Thread hachikuji
GitHub user hachikuji opened a pull request: https://github.com/apache/kafka/pull/3183 KAFKA-5283: Handle producer epoch/sequence overflow by wrapping around You can merge this pull request into a Git repository by running: $ git pull https://github.com/hachikuji/kafka KAFKA-5

[jira] [Updated] (KAFKA-5283) Update clients and server code to make sure that epoch and sequence numbers wrap around

2017-05-31 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-5283: --- Status: Patch Available (was: Open) > Update clients and server code to make sure that epoch

[jira] [Commented] (KAFKA-5283) Update clients and server code to make sure that epoch and sequence numbers wrap around

2017-05-31 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16031875#comment-16031875 ] ASF GitHub Bot commented on KAFKA-5283: --- GitHub user hachikuji opened a pull request

[jira] [Updated] (KAFKA-5093) Load only batch header when rebuilding producer ID map

2017-05-31 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-5093: --- Resolution: Fixed Status: Resolved (was: Patch Available) Issue resolved by pull requ

[GitHub] kafka pull request #3160: KAFKA-5093: Avoid loading full batch data when pos...

2017-05-31 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3160 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-5093) Load only batch header when rebuilding producer ID map

2017-05-31 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16031975#comment-16031975 ] ASF GitHub Bot commented on KAFKA-5093: --- Github user asfgit closed the pull request

[jira] [Updated] (KAFKA-5355) Broker returns messages beyond "latest stable offset" to transactional consumer

2017-05-31 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-5355: --- Fix Version/s: 0.11.0.0 > Broker returns messages beyond "latest stable offset" to transaction

[jira] [Created] (KAFKA-5355) Broker returns messages beyond "latest stable offset" to transactional consumer

2017-05-31 Thread Matthias J. Sax (JIRA)
Matthias J. Sax created KAFKA-5355: -- Summary: Broker returns messages beyond "latest stable offset" to transactional consumer Key: KAFKA-5355 URL: https://issues.apache.org/jira/browse/KAFKA-5355 Pro

  1   2   >