[jira] [Resolved] (KAFKA-6054) ERROR "SubscriptionInfo - unable to decode subscription data: version=2" when upgrading from 0.10.0.0 to 0.10.2.1

2018-05-30 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-6054. Resolution: Fixed > ERROR "SubscriptionInfo - unable to decode subscription data: version=2

[jira] [Created] (KAFKA-6973) setting invalid timestamp causes Kafka broker restart to fail

2018-05-30 Thread Paul Brebner (JIRA)
Paul Brebner created KAFKA-6973: --- Summary: setting invalid timestamp causes Kafka broker restart to fail Key: KAFKA-6973 URL: https://issues.apache.org/jira/browse/KAFKA-6973 Project: Kafka Is

Jenkins build is back to normal : kafka-trunk-jdk10 #153

2018-05-30 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-trunk-jdk8 #2686

2018-05-30 Thread Apache Jenkins Server
See Changes: [github] MINOR: Follow-up improvements for KIP-266 (#5084) -- [...truncated 445.49 KB...] kafka.coordinator.transaction.TransactionCoordinatorTest > shouldRe

[jira] [Created] (KAFKA-6972) Kafka ACL does not work expected with wildcard

2018-05-30 Thread Soyee Deng (JIRA)
Soyee Deng created KAFKA-6972: - Summary: Kafka ACL does not work expected with wildcard Key: KAFKA-6972 URL: https://issues.apache.org/jira/browse/KAFKA-6972 Project: Kafka Issue Type: Bug

Re: [VOTE] KIP-266: Add TimeoutException for KafkaConsumer#position

2018-05-30 Thread Guozhang Wang
Thanks Jason. I'm in favor of option 1 as well. On Wed, May 30, 2018 at 1:37 PM, Bill Bejeck wrote: > For what it's worth I'm +1 on Option 1 and the default value for the > timeout. > > In addition to reasons outlined above by Jason, I think it will help to > reason about consumer behavior (with

Build failed in Jenkins: kafka-trunk-jdk10 #152

2018-05-30 Thread Apache Jenkins Server
See Changes: [me] KAFKA-6886: Externalize secrets from Connect configs (KIP-297) -- [...truncated 1.08 MB...] org.apache.kafka.common.config.ConfigDefTest > testNames STAR

Jenkins build is back to normal : kafka-trunk-jdk8 #2684

2018-05-30 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-6971) Add help flag to kafka-console-producer

2018-05-30 Thread Yeva Byzek (JIRA)
Yeva Byzek created KAFKA-6971: - Summary: Add help flag to kafka-console-producer Key: KAFKA-6971 URL: https://issues.apache.org/jira/browse/KAFKA-6971 Project: Kafka Issue Type: Improvement

[jira] [Created] (KAFKA-6970) Kafka streams lets the user call init() and close() on a state store, when inside Processors

2018-05-30 Thread James Cheng (JIRA)
James Cheng created KAFKA-6970: -- Summary: Kafka streams lets the user call init() and close() on a state store, when inside Processors Key: KAFKA-6970 URL: https://issues.apache.org/jira/browse/KAFKA-6970

Re: [VOTE] KIP-266: Add TimeoutException for KafkaConsumer#position

2018-05-30 Thread Bill Bejeck
For what it's worth I'm +1 on Option 1 and the default value for the timeout. In addition to reasons outlined above by Jason, I think it will help to reason about consumer behavior (with respect to blocking) having the configuration and default value aligned with the producer. -Bill On Wed, May

Jenkins build is back to normal : kafka-trunk-jdk10 #151

2018-05-30 Thread Apache Jenkins Server
See

Re: [VOTE] KIP-266: Add TimeoutException for KafkaConsumer#position

2018-05-30 Thread Ismael Juma
Sounds good to me, On Wed, May 30, 2018 at 12:40 PM Jason Gustafson wrote: > Perhaps one minute? That is the default used by the producer. > > -Jason > > On Wed, May 30, 2018 at 9:50 AM, Ismael Juma wrote: > > > Option 1 sounds good to me provided that we can come up with a good > > default. Wh

Re: [VOTE] KIP-266: Add TimeoutException for KafkaConsumer#position

2018-05-30 Thread Jason Gustafson
Perhaps one minute? That is the default used by the producer. -Jason On Wed, May 30, 2018 at 9:50 AM, Ismael Juma wrote: > Option 1 sounds good to me provided that we can come up with a good > default. What would you suggest? > > Ismael > > On Wed, May 30, 2018 at 9:41 AM Jason Gustafson > wro

Build failed in Jenkins: kafka-trunk-jdk10 #150

2018-05-30 Thread Apache Jenkins Server
See Changes: [lindong28] KAFKA-6028: Improve the quota throttle communication (KIP-219) [wangguoz] Update doc of curried joins and aggregates (#5053) -- [...truncated 1.5

I'd like someone to review KAFKA-6900

2018-05-30 Thread Richard Tjerngren
Hi, if someone could review my PR that would be great: https://issues.apache.org/jira/browse/KAFKA-6900 https://github.com/apache/kafka/pull/5080 the build for JDK8 failed but I'm very sure it's because something is flaky Thanks

[jira] [Resolved] (KAFKA-4936) Allow dynamic routing of output records

2018-05-30 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-4936. Resolution: Fixed > Allow dynamic routing of output records > -

Re: [DISCUSS] KIP-307: Allow to define custom processor names with KStreams DSL

2018-05-30 Thread Guozhang Wang
Hello Florian, Thanks for the KIP. I have some meta feedbacks on the proposal: 1. You mentioned that this `Processed` object will be added to a new overloaded variant of all the stateless operators, what about the stateful operators? Would like to hear your opinions if you have thought about that

[jira] [Resolved] (KAFKA-6957) Add getter to AbstractStream class to make internalTopologyBuilder accessible outside of package

2018-05-30 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-6957. -- Resolution: Fixed Fix Version/s: 2.0.0 > Add getter to AbstractStream class to make inte

Build failed in Jenkins: kafka-trunk-jdk8 #2683

2018-05-30 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-6608; Add timeout parameter to blocking consumer calls [KIP-266] -- [...truncated 447.53 KB...] kafka.admin.ResetConsumerGroupOffsetTest > test

Re: [VOTE] KIP-266: Add TimeoutException for KafkaConsumer#position

2018-05-30 Thread Ismael Juma
Option 1 sounds good to me provided that we can come up with a good default. What would you suggest? Ismael On Wed, May 30, 2018 at 9:41 AM Jason Gustafson wrote: > Hi Everyone, > > There remains some inconsistency in the timeout behavior of the consumer > APIs which do not accept a timeout. So

Re: [VOTE] KIP-266: Add TimeoutException for KafkaConsumer#position

2018-05-30 Thread Jason Gustafson
Hi Everyone, There remains some inconsistency in the timeout behavior of the consumer APIs which do not accept a timeout. Some of them block forever (e.g. position()) and some of them use request.timeout.ms (e.g. parititonsFor()). I think we'd probably all agree that blocking forever is not useful

[jira] [Resolved] (KAFKA-3834) Consumer should not block in poll on coordinator discovery

2018-05-30 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-3834. Resolution: Fixed Fix Version/s: 2.0.0 Fixed by KIP-266 > Consumer should not block

[jira] [Resolved] (KAFKA-5065) AbstractCoordinator.ensureCoordinatorReady() stuck in loop if absent any bootstrap servers

2018-05-30 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-5065. Resolution: Fixed Fixed by KIP-266 > AbstractCoordinator.ensureCoordinatorReady() stuck in

[jira] [Resolved] (KAFKA-1894) Avoid long or infinite blocking in the consumer

2018-05-30 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-1894. Resolution: Fixed Fixed by KIP-266 (and many subsequent changes which gradually introduced

[jira] [Resolved] (KAFKA-2391) Blocking call such as position(), partitionsFor(), committed() and listTopics() should have a timeout

2018-05-30 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-2391. Resolution: Fixed Fix Version/s: 2.0.0 Fixed by KIP-266 > Blocking call such as pos

[jira] [Resolved] (KAFKA-4879) KafkaConsumer.position may hang forever when deleting a topic

2018-05-30 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-4879. Resolution: Fixed This is addressed by KIP-266. > KafkaConsumer.position may hang forever

[jira] [Resolved] (KAFKA-6608) Add TimeoutException to KafkaConsumer#position()

2018-05-30 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-6608. Resolution: Fixed Fix Version/s: 2.0.0 > Add TimeoutException to KafkaConsumer#posit

Re: [DISCUSS] KIP-110: Add Codec for ZStandard Compression

2018-05-30 Thread Dongjin Lee
Hello. I updated the KIP page for this issue, following Ismael's guide. https://cwiki.apache.org/confluence/display/KAFKA/KIP-110%3A+Add+Codec+for+ ZStandard+Compression The main difference between the previous version is: - Motivation: Added real-world benchmark. (Thanks to Ivan) - Accompanying

[jira] [Created] (KAFKA-6969) AdminClient should provide a way to get the version of a node

2018-05-30 Thread Charly Molter (JIRA)
Charly Molter created KAFKA-6969: Summary: AdminClient should provide a way to get the version of a node Key: KAFKA-6969 URL: https://issues.apache.org/jira/browse/KAFKA-6969 Project: Kafka

[jira] [Created] (KAFKA-6968) Call RebalanceListener in MockConsumer

2018-05-30 Thread Andras Beni (JIRA)
Andras Beni created KAFKA-6968: -- Summary: Call RebalanceListener in MockConsumer Key: KAFKA-6968 URL: https://issues.apache.org/jira/browse/KAFKA-6968 Project: Kafka Issue Type: Improvement

Need help

2018-05-30 Thread Satyanarayana.R
Dell - Internal Use - Confidential Hi Team, As part of my project , Need to read data from kafka with Avro and load into my data base. Data containing with arrays [0],[1],[2] Under the Phone number we have phone key objects also . Please provide sample code to achieve this . [cid:image001