[GitHub] kafka pull request #3046: MINOR: Consolidate Topic classes

2017-05-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3046 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Updated] (KAFKA-5154) Kafka Streams throws NPE during rebalance

2017-05-15 Thread Lukas Gemela (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Gemela updated KAFKA-5154: Attachment: clio_reduced.gz > Kafka Streams throws NPE during rebalance > --

[GitHub] kafka pull request #3050: (trunk) KAFKA-5232 Fix Log.parseTopicPartitionName...

2017-05-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3050 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-5154) Kafka Streams throws NPE during rebalance

2017-05-15 Thread Lukas Gemela (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16010143#comment-16010143 ] Lukas Gemela commented on KAFKA-5154: - [~mjsax] logs attached (clio_reduced) It's jus

[jira] [Commented] (KAFKA-5232) Kafka broker fails to start if a topic containing dot in its name is marked for delete but hasn't been deleted during previous uptime

2017-05-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16010146#comment-16010146 ] ASF GitHub Bot commented on KAFKA-5232: --- Github user asfgit closed the pull request

[jira] [Updated] (KAFKA-5118) Improve message for Kafka failed startup with non-Kafka data in data.dirs

2017-05-15 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-5118: --- Fix Version/s: 0.10.2.2 > Improve message for Kafka failed startup with non-Kafka data in data.dirs >

Build failed in Jenkins: kafka-trunk-jdk7 #2193

2017-05-15 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Consolidate Topic classes -- [...truncated 859.32 KB...] kafka.log.ProducerStateManagerTest > testFirstUnstableOffsetAfterTruncation PASSED

Build failed in Jenkins: kafka-trunk-jdk8 #1524

2017-05-15 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Consolidate Topic classes -- [...truncated 863.93 KB...] kafka.utils.CommandLineUtilsTest > testParseEmptyArg PASSED kafka.utils.CommandLineU

Re: [DISCUSS]: KIP-149: Enabling key access in ValueTransformer, ValueMapper, and ValueJoiner

2017-05-15 Thread Damian Guy
Thanks for the KIP. I'm not convinced on the `RichFunction` approach. Do we really want to give every DSL method access to the `ProcessorContext` ? It has a bunch of methods on it that seem in-appropriate for some of the DSL methods, i.e, `register`, `getStateStore`, `forward`, `schedule` etc. It

[jira] [Commented] (KAFKA-5025) FetchRequestTest should use batches with more than one message

2017-05-15 Thread Umesh Chaudhary (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16010242#comment-16010242 ] Umesh Chaudhary commented on KAFKA-5025: Hi [~ijuma], I executed the above test an

Build failed in Jenkins: kafka-trunk-jdk7 #2194

2017-05-15 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-5232; Fix Log.parseTopicPartitionName to handle deleted topics -- [...truncated 857.39 KB...] kafka.log.ProducerStateManagerTest > testFirstUns

[GitHub] kafka pull request #3032: KAFKA-4965: set internal.leave.group.on.close to f...

2017-05-15 Thread dguy
Github user dguy closed the pull request at: https://github.com/apache/kafka/pull/3032 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enable

[jira] [Commented] (KAFKA-4965) set internal.leave.group.on.close to false in KafkaStreams

2017-05-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16010260#comment-16010260 ] ASF GitHub Bot commented on KAFKA-4965: --- Github user dguy closed the pull request at

Build failed in Jenkins: kafka-trunk-jdk8 #1525

2017-05-15 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-5232; Fix Log.parseTopicPartitionName to handle deleted topics -- [...truncated 860.83 KB...] kafka.utils.CommandLineUtilsTest > testParseEmpty

[jira] [Updated] (KAFKA-4965) set internal.leave.group.on.close to false in KafkaStreams

2017-05-15 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4965: --- Fix Version/s: 0.10.2.2 > set internal.leave.group.on.close to false in KafkaStreams > ---

[jira] [Created] (KAFKA-5240) Make persistent checkpointedOffsets optionable

2017-05-15 Thread Lukas Gemela (JIRA)
Lukas Gemela created KAFKA-5240: --- Summary: Make persistent checkpointedOffsets optionable Key: KAFKA-5240 URL: https://issues.apache.org/jira/browse/KAFKA-5240 Project: Kafka Issue Type: Improv

[jira] [Commented] (KAFKA-5241) GlobalKTable does not checkpoint offsets after restoring state

2017-05-15 Thread Tommy Becker (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16010389#comment-16010389 ] Tommy Becker commented on KAFKA-5241: - I have a patch for this and will take the issue

[jira] [Created] (KAFKA-5241) GlobalKTable does not checkpoint offsets after restoring state

2017-05-15 Thread Tommy Becker (JIRA)
Tommy Becker created KAFKA-5241: --- Summary: GlobalKTable does not checkpoint offsets after restoring state Key: KAFKA-5241 URL: https://issues.apache.org/jira/browse/KAFKA-5241 Project: Kafka I

[jira] [Updated] (KAFKA-5232) Kafka broker fails to start if a topic containing dot in its name is marked for delete but hasn't been deleted during previous uptime

2017-05-15 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-5232: --- Resolution: Fixed Status: Resolved (was: Patch Available) Issue resolved by pull request 3043

Re: [DISCUSS] KIP-150 - Kafka-Streams Cogroup

2017-05-15 Thread Kyle Winkelman
Damian Guy, could you let me know if you plan to review this further? There is no rush, but if you dont have any additional comments I could start the voting and finish my WIP PR. Thanks, Kyle On May 9, 2017 11:07 AM, "Kyle Winkelman" wrote: > Eno, is there anyone else that is an expert in the

[GitHub] kafka pull request #3054: KAFKA-5241: GlobalKTable does not checkpoint offse...

2017-05-15 Thread twbecker
GitHub user twbecker opened a pull request: https://github.com/apache/kafka/pull/3054 KAFKA-5241: GlobalKTable does not checkpoint offsets after restoring state Ensure checkpointable offsets for GlobalKTables are always written on close. You can merge this pull request into a Git re

[jira] [Commented] (KAFKA-5241) GlobalKTable does not checkpoint offsets after restoring state

2017-05-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16010417#comment-16010417 ] ASF GitHub Bot commented on KAFKA-5241: --- GitHub user twbecker opened a pull request:

[jira] [Commented] (KAFKA-3984) Broker doesn't retry reconnecting to an expired Zookeeper connection

2017-05-15 Thread Dan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16010436#comment-16010436 ] Dan commented on KAFKA-3984: We encountered the same problem in 0.10.1.1. Is there any plan t

[GitHub] kafka pull request #3042: MINOR: Fix one flaky test in MetricsTest and impro...

2017-05-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3042 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-5238) BrokerTopicMetrics can be recreated after topic is deleted

2017-05-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16010472#comment-16010472 ] ASF GitHub Bot commented on KAFKA-5238: --- Github user asfgit closed the pull request

[jira] [Updated] (KAFKA-5226) NullPointerException (NPE) in SourceNodeRecordDeserializer.deserialize

2017-05-15 Thread Ian Springer (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ian Springer updated KAFKA-5226: Attachment: kafka.log Here's the full log file. > NullPointerException (NPE) in SourceNodeRecordDes

[jira] [Commented] (KAFKA-3455) Connect custom processors with the streams DSL

2017-05-15 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16010530#comment-16010530 ] Michal Borowiecki commented on KAFKA-3455: -- Hi [~bobbycalderwood], Can you pleas

Permission to edit Kafka wiki page

2017-05-15 Thread Arseniy Tashoyan
Hello Kafka developers, Could you give me permission to update Kafka System Tools page? https://cwiki.apache.org/confluence/display/KAFKA/System+Tools I am going to update this page in scope of https://github.com/apache/kafka/pull/3051 Arseniy

[jira] [Commented] (KAFKA-5200) Deleting topic when one broker is down will prevent topic to be re-creatable

2017-05-15 Thread Edoardo Comar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16010601#comment-16010601 ] Edoardo Comar commented on KAFKA-5200: -- Thanks [~huxi_2b] unfortunately such steps wo

[jira] [Commented] (KAFKA-5200) Deleting topic when one broker is down will prevent topic to be re-creatable

2017-05-15 Thread Edoardo Comar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16010608#comment-16010608 ] Edoardo Comar commented on KAFKA-5200: -- I am actually hoping for someone familiar wit

[jira] [Comment Edited] (KAFKA-5200) Deleting topic when one broker is down will prevent topic to be re-creatable

2017-05-15 Thread Edoardo Comar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16010608#comment-16010608 ] Edoardo Comar edited comment on KAFKA-5200 at 5/15/17 2:29 PM: -

Jenkins build is back to normal : kafka-trunk-jdk7 #2195

2017-05-15 Thread Apache Jenkins Server
See

[GitHub] kafka pull request #3055: Kip 138

2017-05-15 Thread mihbor
GitHub user mihbor opened a pull request: https://github.com/apache/kafka/pull/3055 Kip 138 Test coverage is not satisfactory but I'd like to start getting feedback already. You can merge this pull request into a Git repository by running: $ git pull https://github.com/mihbor/

[jira] [Updated] (KAFKA-5200) If a replicated topic is deleted with one broker down, it can't be recreated

2017-05-15 Thread Edoardo Comar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edoardo Comar updated KAFKA-5200: - Summary: If a replicated topic is deleted with one broker down, it can't be recreated (was: Delet

[GitHub] kafka pull request #3056: HOTFIX: AddOffsetsToTxnResponse using incorrect sc...

2017-05-15 Thread dguy
GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/3056 HOTFIX: AddOffsetsToTxnResponse using incorrect schema in parse The parse method was incorrectly referring to `ApiKeys.ADD_PARTITIONS_TO_TXN` You can merge this pull request into a Git repository by r

[jira] [Created] (KAFKA-5242) state task directory locked forever

2017-05-15 Thread Lukas Gemela (JIRA)
Lukas Gemela created KAFKA-5242: --- Summary: state task directory locked forever Key: KAFKA-5242 URL: https://issues.apache.org/jira/browse/KAFKA-5242 Project: Kafka Issue Type: Bug Com

[jira] [Updated] (KAFKA-5240) Make persistent checkpointedOffsets optionable

2017-05-15 Thread Lukas Gemela (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Gemela updated KAFKA-5240: Description: By looking at the ProcessorStateManager class kafka streams library tries to persist c

[jira] [Updated] (KAFKA-5242) state task directory locked forever

2017-05-15 Thread Lukas Gemela (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Gemela updated KAFKA-5242: Description: >From time to time, during relabance we are getting a lot of exceptions saying {code}

Build failed in Jenkins: kafka-trunk-jdk8 #1526

2017-05-15 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Fix one flaky test in MetricsTest and improve checks for another -- [...truncated 2.76 MB...] kafka.server.KafkaConfigTest > testLogRollTimeMs

[jira] [Reopened] (KAFKA-5182) Transient failure: RequestQuotaTest.testResponseThrottleTime

2017-05-15 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma reopened KAFKA-5182: This is still happening: {code} java.util.concurrent.ExecutionException: java.lang.AssertionError: Resp

[jira] [Comment Edited] (KAFKA-5182) Transient failure: RequestQuotaTest.testResponseThrottleTime

2017-05-15 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16010645#comment-16010645 ] Ismael Juma edited comment on KAFKA-5182 at 5/15/17 2:57 PM: -

[jira] [Work started] (KAFKA-5233) Changes to punctuate semantics (KIP-138)

2017-05-15 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-5233 started by Michal Borowiecki. > Changes to punctuate semantics (KIP-138) >

[jira] [Updated] (KAFKA-5233) Changes to punctuate semantics (KIP-138)

2017-05-15 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michal Borowiecki updated KAFKA-5233: - Status: Patch Available (was: In Progress) Pull request here: https://github.com/apache/k

[jira] [Created] (KAFKA-5243) Request to add row limit in ReadOnlyKeyValueStore range function

2017-05-15 Thread Joe Wood (JIRA)
Joe Wood created KAFKA-5243: --- Summary: Request to add row limit in ReadOnlyKeyValueStore range function Key: KAFKA-5243 URL: https://issues.apache.org/jira/browse/KAFKA-5243 Project: Kafka Issue T

Build failed in Jenkins: kafka-0.10.2-jdk7 #162

2017-05-15 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-5232; Fix Log.parseTopicPartitionName to handle deleted topics -- [...truncated 815.11 KB...] org.apache.kafka.streams.kstream.TimeWindowsTest

[jira] [Updated] (KAFKA-5242) state task directory locked forever

2017-05-15 Thread Lukas Gemela (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Gemela updated KAFKA-5242: Issue Type: Improvement (was: Bug) > state task directory locked forever >

[jira] [Updated] (KAFKA-5242) add max_number _of_retries to exponential backoff strategy

2017-05-15 Thread Lukas Gemela (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Gemela updated KAFKA-5242: Summary: add max_number _of_retries to exponential backoff strategy (was: state task directory lock

[jira] [Updated] (KAFKA-5242) add max_number _of_retries to exponential backoff strategy

2017-05-15 Thread Lukas Gemela (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Gemela updated KAFKA-5242: Attachment: (was: clio_170511.log) > add max_number _of_retries to exponential backoff strategy

[jira] [Updated] (KAFKA-5242) add max_number _of_retries to exponential backoff strategy

2017-05-15 Thread Lukas Gemela (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Gemela updated KAFKA-5242: Description: >From time to time, during relabance we are getting a lot of exceptions saying {code}

[jira] [Updated] (KAFKA-5240) Make persistent checkpointedOffsets optionable

2017-05-15 Thread Lukas Gemela (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Gemela updated KAFKA-5240: Description: By looking at the ProcessorStateManager class kafka streams library tries to persist c

[jira] [Updated] (KAFKA-5242) add max_number _of_retries to exponential backoff strategy

2017-05-15 Thread Lukas Gemela (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Gemela updated KAFKA-5242: Priority: Minor (was: Major) > add max_number _of_retries to exponential backoff strategy > ---

[jira] [Updated] (KAFKA-5240) Make persistent checkpointedOffsets optionable

2017-05-15 Thread Lukas Gemela (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Gemela updated KAFKA-5240: Priority: Minor (was: Major) > Make persistent checkpointedOffsets optionable > ---

[jira] [Created] (KAFKA-5244) Tests which delete singleton metrics break subsequent metrics tests

2017-05-15 Thread Rajini Sivaram (JIRA)
Rajini Sivaram created KAFKA-5244: - Summary: Tests which delete singleton metrics break subsequent metrics tests Key: KAFKA-5244 URL: https://issues.apache.org/jira/browse/KAFKA-5244 Project: Kafka

[jira] [Commented] (KAFKA-3356) Remove ConsumerOffsetChecker, deprecated in 0.9, in 0.11

2017-05-15 Thread Jeff Widman (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16010801#comment-16010801 ] Jeff Widman commented on KAFKA-3356: Personally, I don't think we need feature parity

[jira] [Commented] (KAFKA-3514) Stream timestamp computation needs some further thoughts

2017-05-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16010813#comment-16010813 ] Guozhang Wang commented on KAFKA-3514: -- Thanks [~mihbor] > Stream timestamp computat

[jira] [Commented] (KAFKA-5244) Tests which delete singleton metrics break subsequent metrics tests

2017-05-15 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16010820#comment-16010820 ] Ismael Juma commented on KAFKA-5244: Good find [~rsivaram]. Note that in https://githu

[jira] [Commented] (KAFKA-5244) Tests which delete singleton metrics break subsequent metrics tests

2017-05-15 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16010821#comment-16010821 ] Ismael Juma commented on KAFKA-5244: If you think the change makes sense, I could crea

[jira] [Commented] (KAFKA-3356) Remove ConsumerOffsetChecker, deprecated in 0.9, in 0.11

2017-05-15 Thread Onur Karaman (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16010823#comment-16010823 ] Onur Karaman commented on KAFKA-3356: - I agree with [~jeffwidman]. > Remove ConsumerO

[jira] [Commented] (KAFKA-5244) Tests which delete singleton metrics break subsequent metrics tests

2017-05-15 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16010892#comment-16010892 ] Rajini Sivaram commented on KAFKA-5244: --- [~ijuma] Yes, that makes sense. Thank you.

Jenkins build is back to normal : kafka-0.10.2-jdk7 #163

2017-05-15 Thread Apache Jenkins Server
See

Re: [DISCUSS]: KIP-149: Enabling key access in ValueTransformer, ValueMapper, and ValueJoiner

2017-05-15 Thread Matthias J. Sax
I agree that that `ProcessorContext` interface is too broad in general -- this is even true for transform/process, and it's also reflected in the API improvement list we want to do. https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Streams+Discussions So I am wondering, if you question the

Re: [DISCUSS]: KIP-149: Enabling key access in ValueTransformer, ValueMapper, and ValueJoiner

2017-05-15 Thread Damian Guy
I'd rather not see the use of `ProcessorContext` spread any further than it currently is. So maybe we need another KIP that is done before this? Otherwise i think the scope of this KIP is becoming too large. On Mon, 15 May 2017 at 18:06 Matthias J. Sax wrote: > I agree that that `ProcessorCont

[jira] [Updated] (KAFKA-4850) RocksDb cannot use Bloom Filters

2017-05-15 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated KAFKA-4850: -- Status: Patch Available (was: In Progress) > RocksDb cannot use Bloom Filters > ---

[jira] [Created] (KAFKA-5245) KStream builder should capture serdes

2017-05-15 Thread Yeva Byzek (JIRA)
Yeva Byzek created KAFKA-5245: - Summary: KStream builder should capture serdes Key: KAFKA-5245 URL: https://issues.apache.org/jira/browse/KAFKA-5245 Project: Kafka Issue Type: Improvement

[jira] [Commented] (KAFKA-5242) add max_number _of_retries to exponential backoff strategy

2017-05-15 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16010936#comment-16010936 ] Matthias J. Sax commented on KAFKA-5242: We fixed a couple of state directory lock

[jira] [Created] (KAFKA-5246) Remove backdoor that allows any client to produce to internal topics

2017-05-15 Thread Andy Coates (JIRA)
Andy Coates created KAFKA-5246: -- Summary: Remove backdoor that allows any client to produce to internal topics Key: KAFKA-5246 URL: https://issues.apache.org/jira/browse/KAFKA-5246 Project: Kafka

[jira] [Commented] (KAFKA-5246) Remove backdoor that allows any client to produce to internal topics

2017-05-15 Thread Andy Coates (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16010948#comment-16010948 ] Andy Coates commented on KAFKA-5246: I've got a patch waiting for this is someone can

[GitHub] kafka pull request #3057: KAFKA-5182: Reduce session timeout in request quot...

2017-05-15 Thread rajinisivaram
GitHub user rajinisivaram opened a pull request: https://github.com/apache/kafka/pull/3057 KAFKA-5182: Reduce session timeout in request quota test Reduce session timeouts for join requests to trigger throttling in the request quota test. You can merge this pull request into a Git

[jira] [Commented] (KAFKA-5182) Transient failure: RequestQuotaTest.testResponseThrottleTime

2017-05-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16010950#comment-16010950 ] ASF GitHub Bot commented on KAFKA-5182: --- GitHub user rajinisivaram opened a pull req

[jira] [Created] (KAFKA-5247) Consumer GroupCoordinator should continue to materialize committed offsets in offset order even for transactional offset commits

2017-05-15 Thread Apurva Mehta (JIRA)
Apurva Mehta created KAFKA-5247: --- Summary: Consumer GroupCoordinator should continue to materialize committed offsets in offset order even for transactional offset commits Key: KAFKA-5247 URL: https://issues.apache.

[jira] [Commented] (KAFKA-5247) Consumer GroupCoordinator should continue to materialize committed offsets in offset order even for transactional offset commits

2017-05-15 Thread Apurva Mehta (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16010959#comment-16010959 ] Apurva Mehta commented on KAFKA-5247: - Note that this is only an issue when we mix off

[jira] [Commented] (KAFKA-5242) add max_number _of_retries to exponential backoff strategy

2017-05-15 Thread Lukas Gemela (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16010974#comment-16010974 ] Lukas Gemela commented on KAFKA-5242: - [~mjsax] by multiple instances you mean multipl

[jira] [Updated] (KAFKA-5242) add max_number _of_retries to exponential backoff strategy

2017-05-15 Thread Lukas Gemela (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Gemela updated KAFKA-5242: Attachment: clio_170511.log > add max_number _of_retries to exponential backoff strategy > -

[jira] [Comment Edited] (KAFKA-5242) add max_number _of_retries to exponential backoff strategy

2017-05-15 Thread Lukas Gemela (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16010974#comment-16010974 ] Lukas Gemela edited comment on KAFKA-5242 at 5/15/17 5:48 PM: --

[jira] [Comment Edited] (KAFKA-5242) add max_number _of_retries to exponential backoff strategy

2017-05-15 Thread Lukas Gemela (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16010974#comment-16010974 ] Lukas Gemela edited comment on KAFKA-5242 at 5/15/17 5:50 PM: --

[jira] [Comment Edited] (KAFKA-5242) add max_number _of_retries to exponential backoff strategy

2017-05-15 Thread Lukas Gemela (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16010974#comment-16010974 ] Lukas Gemela edited comment on KAFKA-5242 at 5/15/17 5:50 PM: --

Can someone assign, or give me permission to assign myself to a Jira please?

2017-05-15 Thread Andrew Coates
Hi, I have a patch for KAFKA-5246 , but don’t yet have permissions to assign the Jira to myself. Would someone mind either assigning it, or giving me permissions to assign it to myself? Thanks, Andy

Re: [DISCUSS] KIP-148: Add a connect timeout for client

2017-05-15 Thread Guozhang Wang
Hi David, I may be a bit confused before, just clarifying a few things: 1. As you mentioned, a client will always try to first establish the connection with a broker node before it tries to send any request to it. And after connection is established, it will either continuously send many requests

[jira] [Resolved] (KAFKA-5203) Percentilles are calculated incorrectly

2017-05-15 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-5203. Resolution: Fixed Fix Version/s: 0.11.0.0 Issue resolved by pull request 3002 [https://github.com/apa

[GitHub] kafka pull request #3002: KAFKA-5203: Metrics: fix resetting of histogram sa...

2017-05-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3002 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-5203) Percentilles are calculated incorrectly

2017-05-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16010987#comment-16010987 ] ASF GitHub Bot commented on KAFKA-5203: --- Github user asfgit closed the pull request

[jira] [Commented] (KAFKA-5246) Remove backdoor that allows any client to produce to internal topics

2017-05-15 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16010990#comment-16010990 ] Jun Rao commented on KAFKA-5246: [~BigAndy], thanks for your interest. Just added you to K

Re: KafkaStreams reports RUNNING even though all StreamThreads has crashed

2017-05-15 Thread Guozhang Wang
Hi Andreas, This is not an intended behavior. Could you file a JIRA and describe your Kafka broker version / Streams API version, the logs / stack traces you saw in that ticket? I'd like to help investigate and walk you through the process to contribute a fix if you are interested and have time.

[jira] [Assigned] (KAFKA-5154) Kafka Streams throws NPE during rebalance

2017-05-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang reassigned KAFKA-5154: Assignee: Matthias J. Sax > Kafka Streams throws NPE during rebalance > ---

Re: [DISCUSS]: KIP-149: Enabling key access in ValueTransformer, ValueMapper, and ValueJoiner

2017-05-15 Thread Jeyhun Karimov
Hi, Sorry for super late response. Thanks for your comments. I am not an expert on Lambdas. Can you elaborate a little bit? I cannot > follow the explanation in the KIP to see what the problem is. - From [1] says "A functional interface is an interface that has just one abstract method, and thu

[jira] [Created] (KAFKA-5248) Remove retention time from TxnOffsetCommit RPC

2017-05-15 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-5248: -- Summary: Remove retention time from TxnOffsetCommit RPC Key: KAFKA-5248 URL: https://issues.apache.org/jira/browse/KAFKA-5248 Project: Kafka Issue Type:

[jira] [Commented] (KAFKA-5242) add max_number _of_retries to exponential backoff strategy

2017-05-15 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16011025#comment-16011025 ] Matthias J. Sax commented on KAFKA-5242: Both should work. From a Streams perspect

[GitHub] kafka pull request #3058: KAFKA-5248: Remove unused/unneeded retention time ...

2017-05-15 Thread hachikuji
GitHub user hachikuji opened a pull request: https://github.com/apache/kafka/pull/3058 KAFKA-5248: Remove unused/unneeded retention time in TxnOffsetCommitRequest You can merge this pull request into a Git repository by running: $ git pull https://github.com/hachikuji/kafka KA

[jira] [Commented] (KAFKA-5248) Remove retention time from TxnOffsetCommit RPC

2017-05-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16011027#comment-16011027 ] ASF GitHub Bot commented on KAFKA-5248: --- GitHub user hachikuji opened a pull request

[GitHub] kafka pull request #3056: HOTFIX: AddOffsetsToTxnResponse using incorrect sc...

2017-05-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3056 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] kafka pull request #2971: Kafka-5206: Remove use of aggSerde in RocksDBSessi...

2017-05-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2971 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Resolved] (KAFKA-5206) RocksDBSessionStore doesn't use default aggSerde.

2017-05-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-5206. -- Resolution: Fixed Fix Version/s: 0.10.2.2 0.11.0.0 Issue resolved by p

[GitHub] kafka pull request #3059: KAFKA-5244: Refactor BrokerTopicStats and Controll...

2017-05-15 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/3059 KAFKA-5244: Refactor BrokerTopicStats and ControllerStats so that they are classes This removes the need to force object initialisation via hacks to register the relevant metrics during start-up.

[jira] [Commented] (KAFKA-5244) Tests which delete singleton metrics break subsequent metrics tests

2017-05-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16011053#comment-16011053 ] ASF GitHub Bot commented on KAFKA-5244: --- GitHub user ijuma opened a pull request:

[GitHub] kafka pull request #3041: MINOR: Eliminate PID terminology from non test cod...

2017-05-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3041 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Build failed in Jenkins: kafka-trunk-jdk8 #1527

2017-05-15 Thread Apache Jenkins Server
See Changes: [junrao] KAFKA-5203; Metrics: fix resetting of histogram sample -- [...truncated 860.42 KB...] kafka.server.KafkaConfigTest > testLogRollTimeMsProvided PASSED

Re: Can someone assign, or give me permission to assign myself to a Jira please?

2017-05-15 Thread Guozhang Wang
Andy, I can see you now in the contributor list. Please feel free to assign JIRAs to yourself now. Guozhang On Mon, May 15, 2017 at 10:49 AM, Andrew Coates wrote: > Hi, > > I have a patch for KAFKA-5246 jira/browse/KAFKA-5246>, but don’t yet have permissions to a

[jira] [Assigned] (KAFKA-5246) Remove backdoor that allows any client to produce to internal topics

2017-05-15 Thread Andy Coates (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Coates reassigned KAFKA-5246: -- Assignee: Andy Coates > Remove backdoor that allows any client to produce to internal topics >

[GitHub] kafka pull request #2963: Kafka-5205: Removed use of keySerde in CachingSess...

2017-05-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2963 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Resolved] (KAFKA-5205) CachingSessionStore doesn't use the default keySerde.

2017-05-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-5205. -- Resolution: Fixed Fix Version/s: 0.10.2.2 0.11.0.0 > CachingSessionSto

  1   2   >