[jira] [Created] (KAFKA-5439) Add checks in integration tests to verify that threads have been shutdown

2017-06-13 Thread Rajini Sivaram (JIRA)
Rajini Sivaram created KAFKA-5439: - Summary: Add checks in integration tests to verify that threads have been shutdown Key: KAFKA-5439 URL: https://issues.apache.org/jira/browse/KAFKA-5439 Project: K

[GitHub] kafka pull request #3314: KAFKA-5439: Verify that no unexpected threads are ...

2017-06-13 Thread rajinisivaram
GitHub user rajinisivaram opened a pull request: https://github.com/apache/kafka/pull/3314 KAFKA-5439: Verify that no unexpected threads are left behind in tests You can merge this pull request into a Git repository by running: $ git pull https://github.com/rajinisivaram/kafka

[jira] [Commented] (KAFKA-5439) Add checks in integration tests to verify that threads have been shutdown

2017-06-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16047555#comment-16047555 ] ASF GitHub Bot commented on KAFKA-5439: --- GitHub user rajinisivaram opened a pull req

[jira] [Commented] (KAFKA-5007) Kafka Replica Fetcher Thread- Resource Leak

2017-06-13 Thread huxihx (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16047561#comment-16047561 ] huxihx commented on KAFKA-5007: --- [~junrao] is it possible that it 's caused by the code snip

[jira] [Updated] (KAFKA-5432) producer and consumer SocketTimeoutException

2017-06-13 Thread huxihx (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huxihx updated KAFKA-5432: -- Component/s: (was: KafkaConnect) > producer and consumer SocketTimeoutException > -

Re: [DISCUSS] KIP-163: Lower the Minimum Required ACL Permission of OffsetFetch

2017-06-13 Thread Michal Borowiecki
Hi Vahid, +1 wrt OffsetFetch. The "Additional Food for Thought" mentions Heartbeat as a non-mutating action. I don't think that's true as the GroupCoordinator updates the latestHeartbeat field for the member and adds a new object to the heartbeatPurgatory, see completeAndScheduleNextHeartbeat

[jira] [Commented] (KAFKA-5432) producer and consumer SocketTimeoutException

2017-06-13 Thread huxihx (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16047569#comment-16047569 ] huxihx commented on KAFKA-5432: --- Seems it is a duplicate of [KAFKA-5007|https://issues.apac

[jira] [Commented] (KAFKA-5432) producer and consumer SocketTimeoutException

2017-06-13 Thread Jian Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16047582#comment-16047582 ] Jian Lin commented on KAFKA-5432: - One thing I can be sure of is that the error occurred a

[jira] [Commented] (KAFKA-5245) KStream builder should capture serdes

2017-06-13 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16047608#comment-16047608 ] Michal Borowiecki commented on KAFKA-5245: -- Just wanted to say it's great to see

[jira] [Updated] (KAFKA-5432) producer and consumer SocketTimeoutException

2017-06-13 Thread Jian Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian Lin updated KAFKA-5432: Environment: os:Red Hat 4.4.7-17 java: java version "1.8.0_131" Java(TM) SE Runtime Environment (build 1.8.0

[jira] [Commented] (KAFKA-5431) LogCleaner stopped due to org.apache.kafka.common.errors.CorruptRecordException

2017-06-13 Thread huxihx (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16047637#comment-16047637 ] huxihx commented on KAFKA-5431: --- Could you run command below to see whether there exists a c

[jira] [Comment Edited] (KAFKA-5431) LogCleaner stopped due to org.apache.kafka.common.errors.CorruptRecordException

2017-06-13 Thread huxihx (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16047637#comment-16047637 ] huxihx edited comment on KAFKA-5431 at 6/13/17 9:25 AM: Could you

[jira] [Commented] (KAFKA-5123) Refactor ZkUtils readData* methods

2017-06-13 Thread Balint Molnar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16047649#comment-16047649 ] Balint Molnar commented on KAFKA-5123: -- [~ijuma] what do you think about this? > Ref

[jira] [Updated] (KAFKA-5432) producer and consumer SocketTimeoutException

2017-06-13 Thread Jian Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian Lin updated KAFKA-5432: Description: Hey all, I met a strange problem, hope someone can help me. The program ran normally for a week

Re: [DISCUSS] KIP-150 - Kafka-Streams Cogroup

2017-06-13 Thread Kyle Winkelman
First, I would prefer not calling it aggregate because there are already plenty of aggregate methods. Second, I dont think this would really work because after each aggregate you now have a unique KTable (someone may want a table with 4 streams and reuse those 4 in another table but with one more

[GitHub] kafka pull request #3280: MINOR: Avoid calling interceptors.onSendError() wi...

2017-06-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3280 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Resolved] (KAFKA-1019) kafka-preferred-replica-election.sh will fail without clear error message if /brokers/topics/[topic]/partitions does not exist

2017-06-13 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-1019. Resolution: Duplicate The underlying reason could be the same as KAFKA-5418. Closing as a duplicate.

[jira] [Assigned] (KAFKA-5418) ZkUtils.getAllPartitions() may fail if a topic is marked for deletion

2017-06-13 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma reassigned KAFKA-5418: -- Assignee: Mickael Maison (was: Edoardo Comar) > ZkUtils.getAllPartitions() may fail if a topic

[GitHub] kafka pull request #3295: KAFKA-5418: ZkUtils.getAllPartitions() may fail if...

2017-06-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3295 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Resolved] (KAFKA-5418) ZkUtils.getAllPartitions() may fail if a topic is marked for deletion

2017-06-13 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-5418. Resolution: Fixed Fix Version/s: 0.11.0.0 Issue resolved by pull request 3295 [https://github

[jira] [Commented] (KAFKA-5418) ZkUtils.getAllPartitions() may fail if a topic is marked for deletion

2017-06-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16047807#comment-16047807 ] ASF GitHub Bot commented on KAFKA-5418: --- Github user asfgit closed the pull request

[jira] [Resolved] (KAFKA-5439) Add checks in integration tests to verify that threads have been shutdown

2017-06-13 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-5439. --- Resolution: Fixed Fix Version/s: 0.11.1.0 Issue resolved by pull request 3314 [https://

[GitHub] kafka pull request #3314: KAFKA-5439: Verify that no unexpected threads are ...

2017-06-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3314 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-5439) Add checks in integration tests to verify that threads have been shutdown

2017-06-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16047835#comment-16047835 ] ASF GitHub Bot commented on KAFKA-5439: --- Github user asfgit closed the pull request

[jira] [Work started] (KAFKA-5274) Review and improve AdminClient Javadoc for the first release (KIP-117)

2017-06-13 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-5274 started by Ismael Juma. -- > Review and improve AdminClient Javadoc for the first release (KIP-117) > --

[jira] [Updated] (KAFKA-5327) Console Consumer should only poll for up to max messages

2017-06-13 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-5327: --- Fix Version/s: (was: 0.11.0.0) 0.11.0.1 > Console Consumer should only poll for

[jira] [Updated] (KAFKA-5383) Additional Test Cases for ReplicaManager

2017-06-13 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-5383: --- Fix Version/s: (was: 0.11.0.0) 0.11.0.1 > Additional Test Cases for ReplicaMana

[jira] [Updated] (KAFKA-5021) Update Message Delivery Semantics section to take into account KIP-98

2017-06-13 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-5021: --- Status: Patch Available (was: Open) > Update Message Delivery Semantics section to take into account

[jira] [Commented] (KAFKA-5431) LogCleaner stopped due to org.apache.kafka.common.errors.CorruptRecordException

2017-06-13 Thread Carsten Rietz (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16047871#comment-16047871 ] Carsten Rietz commented on KAFKA-5431: -- Thanks for the fast reponse. We did some more

Build failed in Jenkins: kafka-trunk-jdk8 #1695

2017-06-13 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Avoid calling interceptors.onSendError() with null TopicPartition -- [...truncated 2.57 MB...] org.apache.kafka.connect.runtime.distributed.D

Build failed in Jenkins: kafka-trunk-jdk7 #2387

2017-06-13 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Avoid calling interceptors.onSendError() with null TopicPartition -- [...truncated 2.56 MB...] org.apache.kafka.connect.runtime.WorkerConnect

[jira] [Commented] (KAFKA-3476) -Xloggc is not recognised by IBM java

2017-06-13 Thread Miguel Tablado (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16047894#comment-16047894 ] Miguel Tablado commented on KAFKA-3476: --- Hi there, With latest apache kafka 0.10.2.

[GitHub] kafka pull request #3315: MINOR: Generate deprecated warning for static defa...

2017-06-13 Thread rajinisivaram
GitHub user rajinisivaram opened a pull request: https://github.com/apache/kafka/pull/3315 MINOR: Generate deprecated warning for static default quota config The default client-id bandwidth quota config properties have been marked deprecated in the doc, but a warning may be useful b

[jira] [Commented] (KAFKA-5165) Kafka Logs Cleanup Not happening, Huge File Growth - Windows

2017-06-13 Thread Manikandan P (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16047917#comment-16047917 ] Manikandan P commented on KAFKA-5165: - This issue is happening in 0.10.0.0 version als

[jira] [Commented] (KAFKA-5245) KStream builder should capture serdes

2017-06-13 Thread Evgeny Veretennikov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16047933#comment-16047933 ] Evgeny Veretennikov commented on KAFKA-5245: Matthias, thanks for explanation!

[jira] [Updated] (KAFKA-4868) Optimize RocksDb config for fast recovery/bulk load

2017-06-13 Thread Bill Bejeck (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck updated KAFKA-4868: --- Issue Type: Sub-task (was: Improvement) Parent: KAFKA-5363 > Optimize RocksDb config for fast

[GitHub] kafka pull request #3316: [WIP] KAFKA-5274: AdminClient Javadoc improvements

2017-06-13 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/3316 [WIP] KAFKA-5274: AdminClient Javadoc improvements Also improve the Javadoc for ExtendedSerializer, ExtendedDeserializer and InterfaceStability. Publish Javadoc for common.annotation packa

Build failed in Jenkins: kafka-trunk-jdk7 #2388

2017-06-13 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-5418; ZkUtils.getAllPartitions() may fail if a topic is marked for [rajinisivaram] KAFKA-5439; Verify that no unexpected threads are left behind in tests --

[jira] [Commented] (KAFKA-5274) Review and improve AdminClient Javadoc for the first release (KIP-117)

2017-06-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16047966#comment-16047966 ] ASF GitHub Bot commented on KAFKA-5274: --- GitHub user ijuma opened a pull request:

[GitHub] kafka pull request #3315: MINOR: Generate deprecated warning for static defa...

2017-06-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3315 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Re: [DISCUSS] KIP-150 - Kafka-Streams Cogroup

2017-06-13 Thread Michal Borowiecki
You're right, I haven't thought of that. Cheers, Michał On 13/06/17 13:00, Kyle Winkelman wrote: First, I would prefer not calling it aggregate because there are already plenty of aggregate methods. Second, I dont think this would really work because after each aggregate you now have a uniqu

[jira] [Commented] (KAFKA-5434) Console consumer hangs if not existing partition is specified

2017-06-13 Thread Vahid Hashemian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16048030#comment-16048030 ] Vahid Hashemian commented on KAFKA-5434: [~ppatierno] Sure. Feel free to assign th

Jenkins build is back to normal : kafka-trunk-jdk8 #1696

2017-06-13 Thread Apache Jenkins Server
See

[jira] [Commented] (KAFKA-5434) Console consumer hangs if not existing partition is specified

2017-06-13 Thread Paolo Patierno (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16048035#comment-16048035 ] Paolo Patierno commented on KAFKA-5434: --- [~vahid] I can't do that now :( I asked for

[jira] [Commented] (KAFKA-5434) Console consumer hangs if not existing partition is specified

2017-06-13 Thread Vahid Hashemian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16048048#comment-16048048 ] Vahid Hashemian commented on KAFKA-5434: Yeah, I couldn't assign it to you either.

[jira] [Commented] (KAFKA-5434) Console consumer hangs if not existing partition is specified

2017-06-13 Thread Paolo Patierno (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16048054#comment-16048054 ] Paolo Patierno commented on KAFKA-5434: --- Thank you very much. I'll push a PR for tha

Build failed in Jenkins: kafka-trunk-jdk7 #2389

2017-06-13 Thread Apache Jenkins Server
See Changes: [rajinisivaram] MINOR: Generate deprecated warning for static default quota config -- [...truncated 956.71 KB...] kafka.admin.ReassignPartitionsCommandArgsT

[jira] [Commented] (KAFKA-5354) MirrorMaker not preserving headers

2017-06-13 Thread Michael Andre Pearce (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16048106#comment-16048106 ] Michael Andre Pearce commented on KAFKA-5354: - @Jun Rao - sorry only just seen

[jira] [Comment Edited] (KAFKA-5354) MirrorMaker not preserving headers

2017-06-13 Thread Michael Andre Pearce (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16048106#comment-16048106 ] Michael Andre Pearce edited comment on KAFKA-5354 at 6/13/17 4:54 PM: --

[GitHub] kafka pull request #3317: MINOR: Clean up in DeleteConsumerGroupTest even if...

2017-06-13 Thread rajinisivaram
GitHub user rajinisivaram opened a pull request: https://github.com/apache/kafka/pull/3317 MINOR: Clean up in DeleteConsumerGroupTest even if test fails You can merge this pull request into a Git repository by running: $ git pull https://github.com/rajinisivaram/kafka MINOR-d

[jira] [Commented] (KAFKA-5245) KStream builder should capture serdes

2017-06-13 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16048119#comment-16048119 ] Matthias J. Sax commented on KAFKA-5245: [~guozhang] Can you add [~evis] to the co

Jenkins build is back to normal : kafka-trunk-jdk7 #2390

2017-06-13 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-5440) Kafka Streams report state RUNNING even if all threads are dead

2017-06-13 Thread Matthias J. Sax (JIRA)
Matthias J. Sax created KAFKA-5440: -- Summary: Kafka Streams report state RUNNING even if all threads are dead Key: KAFKA-5440 URL: https://issues.apache.org/jira/browse/KAFKA-5440 Project: Kafka

[GitHub] kafka pull request #3318: HOTFIX: Fix invalid long format conversion in requ...

2017-06-13 Thread hachikuji
GitHub user hachikuji opened a pull request: https://github.com/apache/kafka/pull/3318 HOTFIX: Fix invalid long format conversion in request logger message You can merge this pull request into a Git repository by running: $ git pull https://github.com/hachikuji/kafka hotfix-re

Re: [DISCUSS]: KIP-149: Enabling key access in ValueTransformer, ValueMapper, and ValueJoiner

2017-06-13 Thread Matthias J. Sax
I agree with Guozhang's second point. This change does not seem backward compatible. As we don't have to support lambdas, it might be the easiest thing to just extend the current interface: > public interface ValueTransformerWithKey extends > ValueTransformer When plugging the topology togethe

[GitHub] kafka pull request #3318: HOTFIX: Fix invalid long format conversion in requ...

2017-06-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3318 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Re: [DISCUSS]: KIP-159: Introducing Rich functions to Streams

2017-06-13 Thread Matthias J. Sax
Hi, I would like to push this discussion further. It seems we got nice alternatives (thanks for the summary Jeyhun!). With respect to RichFunctions and allowing them to be stateful, I have my doubt as expressed already. From my understanding, the idea was to give access to record metadata informa

Re: [DISCUSS] KIP-150 - Kafka-Streams Cogroup

2017-06-13 Thread Matthias J. Sax
Hi, I am just catching up on this thread. (1) as most people agree, we should not add anything to KStreamBuilder (btw: we actually plan to move #merge() to KStream and deprecate it on KStreamBuilder as it's a quite unnatural API atm). About specifying Serdes: there is still the idea to improve to

[jira] [Updated] (KAFKA-5382) Log recovery can fail if topic names contain one of the index suffixes

2017-06-13 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-5382: - Fix Version/s: (was: 0.11.0.0.) 0.11.0.0 > Log recovery can

[GitHub] kafka pull request #3317: MINOR: Clean up in DeleteConsumerGroupTest even if...

2017-06-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3317 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Updated] (KAFKA-4655) Improve test coverage of CompositeReadOnlySessionStore

2017-06-13 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-4655: --- Status: Patch Available (was: Open) > Improve test coverage of CompositeReadOnlySessionStore

[jira] [Updated] (KAFKA-4659) Improve test coverage of CachingKeyValueStore

2017-06-13 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-4659: --- Status: Patch Available (was: Open) > Improve test coverage of CachingKeyValueStore > ---

[jira] [Updated] (KAFKA-4656) Improve test coverage of CompositeReadOnlyKeyValueStore

2017-06-13 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-4656: --- Status: Patch Available (was: Open) > Improve test coverage of CompositeReadOnlyKeyValueStore

[GitHub] kafka pull request #3319: MINOR: Verify mocks in all WorkerTest tests and do...

2017-06-13 Thread ewencp
GitHub user ewencp opened a pull request: https://github.com/apache/kafka/pull/3319 MINOR: Verify mocks in all WorkerTest tests and don't unnecessarily mockStatic the Plugins class. You can merge this pull request into a Git repository by running: $ git pull https://github.co

[jira] [Updated] (KAFKA-4658) Improve test coverage InMemoryKeyValueLoggedStore

2017-06-13 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-4658: --- Description: {{putAll}} not covered (was: {{putAll} not covered) > Improve test coverage InMe

[jira] [Updated] (KAFKA-4658) Improve test coverage InMemoryKeyValueLoggedStore

2017-06-13 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-4658: --- Status: Patch Available (was: Open) > Improve test coverage InMemoryKeyValueLoggedStore > ---

[jira] [Updated] (KAFKA-4653) Improve test coverage of RocksDBStore

2017-06-13 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-4653: --- Status: Patch Available (was: Open) > Improve test coverage of RocksDBStore > ---

[jira] [Updated] (KAFKA-4653) Improve test coverage of RocksDBStore

2017-06-13 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-4653: --- Description: {{putAll}} - not covered {{putInternal}} - exceptions was: {{putAll}} - not

[GitHub] kafka pull request #3320: KAFKA-5370 (WIP): Replace uses of the old consumer...

2017-06-13 Thread vahidhashemian
GitHub user vahidhashemian opened a pull request: https://github.com/apache/kafka/pull/3320 KAFKA-5370 (WIP): Replace uses of the old consumer with the new consumer when possible Also, methods in `ClientUtils` that are called by server or tools code should be introduced in `AdminUt

[jira] [Commented] (KAFKA-5370) Replace uses of old consumer with the new consumer

2017-06-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16048236#comment-16048236 ] ASF GitHub Bot commented on KAFKA-5370: --- GitHub user vahidhashemian opened a pull re

[GitHub] kafka pull request #3321: HOTFIX: Handle Connector version returning 'null' ...

2017-06-13 Thread kkonstantine
GitHub user kkonstantine opened a pull request: https://github.com/apache/kafka/pull/3321 HOTFIX: Handle Connector version returning 'null' during plugin loading. You can merge this pull request into a Git repository by running: $ git pull https://github.com/kkonstantine/kafka

[GitHub] kafka pull request #3322: KAFKA-5354: MirrorMaker not preserving headers

2017-06-13 Thread michaelandrepearce
GitHub user michaelandrepearce opened a pull request: https://github.com/apache/kafka/pull/3322 KAFKA-5354: MirrorMaker not preserving headers Add test case to ensure fix and avoid regression Update mirror maker for new consumer to preserve headers You can merge this pull reques

[jira] [Commented] (KAFKA-5354) MirrorMaker not preserving headers

2017-06-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16048298#comment-16048298 ] ASF GitHub Bot commented on KAFKA-5354: --- GitHub user michaelandrepearce opened a pul

[GitHub] kafka pull request #3323: KAFKA-5354: MirrorMaker not preserving headers

2017-06-13 Thread michaelandrepearce
GitHub user michaelandrepearce opened a pull request: https://github.com/apache/kafka/pull/3323 KAFKA-5354: MirrorMaker not preserving headers Add test case to ensure fix and avoid regression Update mirror maker for new consumer to preserve headers You can merge this pull reques

[jira] [Commented] (KAFKA-5354) MirrorMaker not preserving headers

2017-06-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16048318#comment-16048318 ] ASF GitHub Bot commented on KAFKA-5354: --- GitHub user michaelandrepearce opened a pul

[jira] [Commented] (KAFKA-5354) MirrorMaker not preserving headers

2017-06-13 Thread Michael Andre Pearce (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16048320#comment-16048320 ] Michael Andre Pearce commented on KAFKA-5354: - [~junrao] yes it was a bug, I'v

[jira] [Comment Edited] (KAFKA-5354) MirrorMaker not preserving headers

2017-06-13 Thread Michael Andre Pearce (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16048320#comment-16048320 ] Michael Andre Pearce edited comment on KAFKA-5354 at 6/13/17 7:57 PM: --

[jira] [Comment Edited] (KAFKA-5354) MirrorMaker not preserving headers

2017-06-13 Thread Michael Andre Pearce (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16048320#comment-16048320 ] Michael Andre Pearce edited comment on KAFKA-5354 at 6/13/17 7:58 PM: --

[jira] [Comment Edited] (KAFKA-5354) MirrorMaker not preserving headers

2017-06-13 Thread Michael Andre Pearce (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16048320#comment-16048320 ] Michael Andre Pearce edited comment on KAFKA-5354 at 6/13/17 7:58 PM: --

[jira] [Work started] (KAFKA-5363) Add ability to batch restore and receive restoration stats.

2017-06-13 Thread Bill Bejeck (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-5363 started by Bill Bejeck. -- > Add ability to batch restore and receive restoration stats. > -

[jira] [Work started] (KAFKA-4868) Optimize RocksDb config for fast recovery/bulk load

2017-06-13 Thread Bill Bejeck (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-4868 started by Bill Bejeck. -- > Optimize RocksDb config for fast recovery/bulk load > -

[jira] [Updated] (KAFKA-5354) MirrorMaker not preserving headers

2017-06-13 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-5354: --- Priority: Blocker (was: Major) > MirrorMaker not preserving headers > ---

[jira] [Updated] (KAFKA-5354) MirrorMaker not preserving headers

2017-06-13 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-5354: --- Fix Version/s: 0.11.0.0 > MirrorMaker not preserving headers > -- > >

[jira] [Updated] (KAFKA-5354) MirrorMaker not preserving headers

2017-06-13 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-5354: --- Status: Patch Available (was: Open) > MirrorMaker not preserving headers > --

Re: [DISCUSS] KIP-132: Augment KStream.print to allow extra parameters in the printed string

2017-06-13 Thread Matthias J. Sax
As there was no response from Marc, and we got KIP-160 as duplicate, I am "closing" this KIP without a vote. If there are any objections please let me know. -Matthias On 6/7/17 5:24 PM, Matthias J. Sax wrote: > Hi, > > as it turns out, we got two KIPs for the same Jira. KIP-160 duplicates > KIP

Re: [VOTE] KIP-117: Add a public AdminClient API for Kafka admin operations

2017-06-13 Thread Colin McCabe
Hi all, We're getting close to the final 0.11 release and we still haven't gotten the version retrieval API for AdminClient in, as described by KAFKA-5214. Let's put this off until the next release so that we have some time to let it soak before shipping. This will just mean that we will remove

[GitHub] kafka pull request #3324: Temporarily remove the apiVersions API for 0.11

2017-06-13 Thread cmccabe
GitHub user cmccabe opened a pull request: https://github.com/apache/kafka/pull/3324 Temporarily remove the apiVersions API for 0.11 You can merge this pull request into a Git repository by running: $ git pull https://github.com/cmccabe/kafka removeApiVersions Alternatively y

[GitHub] kafka pull request #3325: KAFKA-5363 [WIP] : Initial cut at implementing bul...

2017-06-13 Thread bbejeck
GitHub user bbejeck opened a pull request: https://github.com/apache/kafka/pull/3325 KAFKA-5363 [WIP] : Initial cut at implementing bulk load for persistent stat… …e stores You can merge this pull request into a Git repository by running: $ git pull https://github.com/bbej

[jira] [Commented] (KAFKA-5363) Add ability to batch restore and receive restoration stats.

2017-06-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16048378#comment-16048378 ] ASF GitHub Bot commented on KAFKA-5363: --- GitHub user bbejeck opened a pull request:

[jira] [Commented] (KAFKA-5413) Log cleaner fails due to large offset in segment file

2017-06-13 Thread Nicholas Ngorok (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16048394#comment-16048394 ] Nicholas Ngorok commented on KAFKA-5413: This happened again today on another clus

Re: [DISCUSS]: KIP-159: Introducing Rich functions to Streams

2017-06-13 Thread Jeyhun Karimov
Thanks for the comment Matthias. After all the discussion (thanks to all participants), I think this (single method that passes in a RecordContext object) is the best alternative. Just a side note: I think KAFKA-3907 [1] can also be integrated into the KIP by adding related method inside RecordCont

[DISCUSS] KIP-167: Add interface for the state store restoration process

2017-06-13 Thread Bill Bejeck
The KIP has been updated to incorporate support for users to receive notification of state store restore progress for either pre-existing or custom state stores. A PR has been submitted concurrently https://github.com/apache/kafka/pull/3325 Thanks, Bill

[jira] [Commented] (KAFKA-5413) Log cleaner fails due to large offset in segment file

2017-06-13 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16048429#comment-16048429 ] Jun Rao commented on KAFKA-5413: [~Kelvinrutt], yes, that seems to be the issue. segs.head

Re: [DISCUSS] KIP-150 - Kafka-Streams Cogroup

2017-06-13 Thread Bill Bejeck
+1 on deferring discussion on Serdes until API improvements are ironed out. On Tue, Jun 13, 2017 at 2:06 PM, Matthias J. Sax wrote: > Hi, > > I am just catching up on this thread. (1) as most people agree, we > should not add anything to KStreamBuilder (btw: we actually plan to move > #merge() t

Re: [DISCUSS] KIP-163: Lower the Minimum Required ACL Permission of OffsetFetch

2017-06-13 Thread Vahid S Hashemian
Hi Michal, Thanks a lot for your feedback. Your statement about Heartbeat is fair and makes sense. I'll update the KIP accordingly. --Vahid From: Michal Borowiecki To: us...@kafka.apache.org, Vahid S Hashemian , dev@kafka.apache.org Date: 06/13/2017 01:35 AM Subject:Re: [D

[GitHub] kafka pull request #3321: HOTFIX: Handle Connector version returning 'null' ...

2017-06-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3321 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Assigned] (KAFKA-5212) Consumer ListOffsets request can starve group heartbeats

2017-06-13 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson reassigned KAFKA-5212: -- Assignee: (was: Jason Gustafson) > Consumer ListOffsets request can starve group he

[jira] [Updated] (KAFKA-4585) Offset fetch and commit requests use the same permissions

2017-06-13 Thread Vahid Hashemian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vahid Hashemian updated KAFKA-4585: --- Labels: kip (was: needs-kip) > Offset fetch and commit requests use the same permissions > --

[jira] [Work started] (KAFKA-5370) Replace uses of old consumer with the new consumer

2017-06-13 Thread Vahid Hashemian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-5370 started by Vahid Hashemian. -- > Replace uses of old consumer with the new consumer > -

[jira] [Created] (KAFKA-5441) Fix transaction marker grouping by producerId in TC

2017-06-13 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-5441: -- Summary: Fix transaction marker grouping by producerId in TC Key: KAFKA-5441 URL: https://issues.apache.org/jira/browse/KAFKA-5441 Project: Kafka Issue T

  1   2   >