Re: [VOTE] KIP-115: Enforce offsets.topic.replication.factor

2017-01-25 Thread James Cheng
+1 > On Jan 25, 2017, at 9:48 PM, Ewen Cheslack-Postava wrote: > > +1 > > On Wed, Jan 25, 2017 at 9:23 PM, Joel Koshy wrote: > >> +1 >> >> >> On Wed, Jan 25, 2017 at 4:41 PM, Jason Gustafson >> wrote: >> >>> +1 >>> >>> On Wed, Jan 25, 2017 at 4:39 PM, Dong Lin wrote: >>> +1

Re: [DISCUSS] KIP-115: Enforce offsets.topic.replication.factor

2017-01-25 Thread James Cheng
> On Jan 25, 2017, at 9:26 PM, Joel Koshy wrote: > > already voted, but one thing worth considering (since this KIP speaks of > *enforcement*) is desired behavior if the topic already exists and the > config != existing RF. > Yeah, I'm curious about this too. -James > On Wed, Jan 25, 2017 at

[jira] [Commented] (KAFKA-4578) Upgrade notes for 0.10.2.0

2017-01-25 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839378#comment-15839378 ] Ismael Juma commented on KAFKA-4578: Yes, I was planning to submit this one today. >

[jira] [Updated] (KAFKA-4699) Transient Failure PlaintextConsumerTest.testInterceptros

2017-01-25 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-4699: --- Assignee: Ismael Juma (was: Jason Gustafson) > Transient Failure PlaintextConsumerTest.testIn

[jira] [Commented] (KAFKA-4699) Transient Failure PlaintextConsumerTest.testInterceptros

2017-01-25 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839364#comment-15839364 ] Jason Gustafson commented on KAFKA-4699: Actually, it is an assertion on the behav

[GitHub] kafka pull request #2436: HOTFIX: Consumer offsets not properly loaded on co...

2017-01-25 Thread hachikuji
GitHub user hachikuji opened a pull request: https://github.com/apache/kafka/pull/2436 HOTFIX: Consumer offsets not properly loaded on coordinator failover You can merge this pull request into a Git repository by running: $ git pull https://github.com/hachikuji/kafka hotfix-of

[jira] [Updated] (KAFKA-3959) __consumer_offsets wrong number of replicas at startup

2017-01-25 Thread Onur Karaman (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Onur Karaman updated KAFKA-3959: Fix Version/s: (was: 0.10.3.0) 0.10.2.0 > __consumer_offsets wrong number of

[jira] [Assigned] (KAFKA-4691) ProducerInterceptor.onSend() is called after key and value are serialized

2017-01-25 Thread Francesco Lemma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Francesco Lemma reassigned KAFKA-4691: -- Assignee: Francesco Lemma > ProducerInterceptor.onSend() is called after key and value

Re: [VOTE] KIP-115: Enforce offsets.topic.replication.factor

2017-01-25 Thread Ewen Cheslack-Postava
+1 On Wed, Jan 25, 2017 at 9:23 PM, Joel Koshy wrote: > +1 > > > On Wed, Jan 25, 2017 at 4:41 PM, Jason Gustafson > wrote: > > > +1 > > > > On Wed, Jan 25, 2017 at 4:39 PM, Dong Lin wrote: > > > > > +1 > > > > > > On Wed, Jan 25, 2017 at 4:37 PM, Ismael Juma > wrote: > > > > > > > +1 (binding

Build failed in Jenkins: kafka-trunk-jdk7 #1880

2017-01-25 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-4684: add kafka-configs.bat for Windows boxes [wangguoz] MINOR: Clarify misleading comment in WordCount example [wangguoz] MINOR: Fix typo in WordCountProcessorDemo [ismael] MINOR: Refactor partition la

Re: [DISCUSS] KIP-115: Enforce offsets.topic.replication.factor

2017-01-25 Thread Joel Koshy
already voted, but one thing worth considering (since this KIP speaks of *enforcement*) is desired behavior if the topic already exists and the config != existing RF. On Wed, Jan 25, 2017 at 4:30 PM, Dong Lin wrote: > +1 > > On Wed, Jan 25, 2017 at 4:22 PM, Ismael Juma wrote: > > > An important

Re: [VOTE] KIP-115: Enforce offsets.topic.replication.factor

2017-01-25 Thread Joel Koshy
+1 On Wed, Jan 25, 2017 at 4:41 PM, Jason Gustafson wrote: > +1 > > On Wed, Jan 25, 2017 at 4:39 PM, Dong Lin wrote: > > > +1 > > > > On Wed, Jan 25, 2017 at 4:37 PM, Ismael Juma wrote: > > > > > +1 (binding) > > > > > > Ismael > > > > > > On Thu, Jan 26, 2017 at 12:34 AM, Onur Karaman < > >

[jira] [Comment Edited] (KAFKA-3567) Add --security-protocol option to console consumer and producer

2017-01-25 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839246#comment-15839246 ] Bharat Viswanadham edited comment on KAFKA-3567 at 1/26/17 5:14 AM:

[jira] [Updated] (KAFKA-3567) Add --security-protocol option to console consumer and producer

2017-01-25 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated KAFKA-3567: -- Resolution: Won't Fix Status: Resolved (was: Patch Available) > Add --security-

[jira] [Commented] (KAFKA-3567) Add --security-protocol option to console consumer and producer

2017-01-25 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839246#comment-15839246 ] Bharat Viswanadham commented on KAFKA-3567: --- [~ewencp] I agree, if you think of

[jira] [Commented] (KAFKA-4680) min.insync.replicas can be set higher than replication factor

2017-01-25 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839234#comment-15839234 ] Ewen Cheslack-Postava commented on KAFKA-4680: -- I think it's totally reasonab

[jira] [Updated] (KAFKA-4578) Upgrade notes for 0.10.2.0

2017-01-25 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-4578: - Reviewer: Ewen Cheslack-Postava > Upgrade notes for 0.10.2.0 > ---

[jira] [Commented] (KAFKA-4578) Upgrade notes for 0.10.2.0

2017-01-25 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839224#comment-15839224 ] Ewen Cheslack-Postava commented on KAFKA-4578: -- [~ijuma] Looking at 0.10.2.0

Jenkins build is back to normal : kafka-trunk-jdk7 #1879

2017-01-25 Thread Apache Jenkins Server
See

[GitHub] kafka pull request #2435: Replaced for with foreach and replace if ,else if,...

2017-01-25 Thread akashsethi24
GitHub user akashsethi24 opened a pull request: https://github.com/apache/kafka/pull/2435 Replaced for with foreach and replace if ,else if, else condition with match In some Places for the loop was used but it can be replaced by the for each. In One file if else if else was us

[jira] [Commented] (KAFKA-3567) Add --security-protocol option to console consumer and producer

2017-01-25 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839184#comment-15839184 ] Ewen Cheslack-Postava commented on KAFKA-3567: -- [~bharatviswa] But you still

[jira] [Created] (KAFKA-4699) Transient Failure PlaintextConsumerTest.testInterceptros

2017-01-25 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-4699: -- Summary: Transient Failure PlaintextConsumerTest.testInterceptros Key: KAFKA-4699 URL: https://issues.apache.org/jira/browse/KAFKA-4699 Project: Kafka Is

Build failed in Jenkins: kafka-trunk-jdk8 #1219

2017-01-25 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Refactor partition lag metric for cleaner encapsulation -- [...truncated 4075 lines...] kafka.log.LogTest > testReadWithTooSmallMaxLength STARTED kafka.log.LogTest

Build failed in Jenkins: kafka-0.10.2-jdk7 #38

2017-01-25 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-4684: add kafka-configs.bat for Windows boxes [wangguoz] MINOR: Clarify misleading comment in WordCount example [wangguoz] MINOR: Fix typo in WordCountProcessorDemo [ismael] MINOR: Refactor partition lag

Build failed in Jenkins: kafka-trunk-jdk8 #1218

2017-01-25 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-4597; RecordMetadata should return log append time when [wangguoz] KAFKA-4684: add kafka-configs.bat for Windows boxes [wangguoz] MINOR: Clarify misleading comment in WordCount example [wangguoz] MINOR: Fi

[jira] [Resolved] (KAFKA-4026) consumer block

2017-01-25 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-4026. -- Resolution: Not A Problem Assignee: Ewen Cheslack-Postava Fix Ver

[jira] [Updated] (KAFKA-2329) Consumers balance fails when multiple consumers are started simultaneously.

2017-01-25 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-2329: - Fix Version/s: (was: 0.8.1.2) Removing the 0.8.1.2 fix version since it is inc

[jira] [Commented] (KAFKA-3567) Add --security-protocol option to console consumer and producer

2017-01-25 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839123#comment-15839123 ] Bharat Viswanadham commented on KAFKA-3567: --- [~ewencp] But it is really helpful

[jira] [Commented] (KAFKA-3103) Transient Failure in kafka.integration.PlaintextTopicMetadataTest.testIsrAfterBrokerShutDownAndJoinsBack

2017-01-25 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839118#comment-15839118 ] Ewen Cheslack-Postava commented on KAFKA-3103: -- [~guozhang] I don't think we'

[jira] [Updated] (KAFKA-3103) Transient Failure in kafka.integration.PlaintextTopicMetadataTest.testIsrAfterBrokerShutDownAndJoinsBack

2017-01-25 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3103: - Fix Version/s: (was: 0.9.0.1) Removing invalid fix version > Transient Failur

[jira] [Commented] (KAFKA-3567) Add --security-protocol option to console consumer and producer

2017-01-25 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839117#comment-15839117 ] Ewen Cheslack-Postava commented on KAFKA-3567: -- I think I'm in favor of closi

[jira] [Updated] (KAFKA-3567) Add --security-protocol option to console consumer and producer

2017-01-25 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3567: - Labels: needs-kip (was: ) Fix Version/s: (was: 0.9.0.0) Removing i

[jira] [Updated] (KAFKA-2615) Poll() method is broken wrt time

2017-01-25 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-2615: - Resolution: Implemented Fix Version/s: (was: 0.8.2.1)

[jira] [Commented] (KAFKA-2615) Poll() method is broken wrt time

2017-01-25 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839112#comment-15839112 ] Ewen Cheslack-Postava commented on KAFKA-2615: -- Semi unintentionally, KAFKA-2

[jira] [Updated] (KAFKA-1843) Metadata fetch/refresh in new producer should handle all node connection states gracefully

2017-01-25 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-1843: - Fix Version/s: (was: 0.8.2.1) > Metadata fetch/refresh in new producer should

Build failed in Jenkins: kafka-0.10.2-jdk7 #37

2017-01-25 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-4698; VerifyError in kafka/client/ClientUtils due to [jason] KAFKA-4597; RecordMetadata should return log append time when -- [...truncated 8424 lines...] kafka.netwo

[jira] [Updated] (KAFKA-2602) Incorrect descriptions about serializers for ProducerConfig in 0.8.2 and 0.8.3 documentation

2017-01-25 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-2602: - Resolution: Won't Fix Assignee: Ewen Cheslack-Postava Fix Version/s

[jira] [Updated] (KAFKA-1729) add doc for Kafka-based offset management in 0.8.2

2017-01-25 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-1729: - Resolution: Fixed Status: Resolved (was: Patch Available) A bit unclear w

[jira] [Updated] (KAFKA-3071) Kafka Server 0.8.2 ERROR OOME with siz

2017-01-25 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3071: - Fix Version/s: (was: 0.8.2.0) Removing invalid fix version > Kafka Server 0.8

[jira] [Resolved] (KAFKA-2501) getting one test failed when building apache kafka

2017-01-25 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-2501. -- Resolution: Duplicate Assignee: Ewen Cheslack-Postava Fix Version

[jira] [Commented] (KAFKA-2501) getting one test failed when building apache kafka

2017-01-25 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839095#comment-15839095 ] Ewen Cheslack-Postava commented on KAFKA-2501: -- Exact duplicate by same repor

[jira] [Resolved] (KAFKA-1568) Blackspider

2017-01-25 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-1568. -- Resolution: Won't Fix Assignee: Ewen Cheslack-Postava Fix Version

[GitHub] kafka pull request #2416: MINOR: Refactor partition lag metric for cleaner e...

2017-01-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2416 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Updated] (KAFKA-4083) ReassignPartitionsCommand does not check replication factor

2017-01-25 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-4083: - Fix Version/s: (was: 0.10.0.0) (was: 0.9.0.0)

[jira] [Commented] (KAFKA-1207) Launch Kafka from within Apache Mesos

2017-01-25 Thread postmas...@inn.ru (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839085#comment-15839085 ] postmas...@inn.ru commented on KAFKA-1207: -- Delivery is delayed to these recipien

[jira] [Commented] (KAFKA-1207) Launch Kafka from within Apache Mesos

2017-01-25 Thread postmas...@inn.ru (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839072#comment-15839072 ] postmas...@inn.ru commented on KAFKA-1207: -- Delivery is delayed to these recipien

[jira] [Commented] (KAFKA-4698) `-target:jvm-1.7` in scalaCompileOptions seems to cause java.lang.VerifyError when loading kafka/client/ClientUtils

2017-01-25 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839068#comment-15839068 ] Ismael Juma commented on KAFKA-4698: On second thought, I am not sure if we can backpo

[GitHub] kafka pull request #2431: KAFKA-4547 (0.10.1 hotfix): Avoid unnecessary offs...

2017-01-25 Thread vahidhashemian
Github user vahidhashemian closed the pull request at: https://github.com/apache/kafka/pull/2431 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[jira] [Commented] (KAFKA-4547) Consumer.position returns incorrect results for Kafka 0.10.1.0 client

2017-01-25 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839043#comment-15839043 ] ASF GitHub Bot commented on KAFKA-4547: --- Github user vahidhashemian closed the pull

[GitHub] kafka pull request #2410: MINOR: Fix typo in WordCountProcessorDemo

2017-01-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2410 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Re: [DISCUSS] KIP-98: Exactly Once Delivery and Transactional Messaging

2017-01-25 Thread Apurva Mehta
On Tue, Jan 17, 2017 at 6:17 PM, Apurva Mehta wrote: > Hi Jun, > > Some answers in line. > > > 109. Could you describe when Producer.send() will receive an Unrecognized > > MessageException? > > > This exception will be thrown if the producer sends a sequence number > which is greater than the se

[GitHub] kafka pull request #2400: MINOR: Clarify misleading comment in WordCount exa...

2017-01-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2400 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] kafka pull request #2419: kafka-4684: Kafka does not offer kafka-configs.bat...

2017-01-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2419 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Resolved] (KAFKA-4684) Kafka does not offer kafka-configs.bat on Windows box

2017-01-25 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-4684. -- Resolution: Fixed Fix Version/s: 0.10.2.0 0.10.3.0 Issue resolved by p

[jira] [Commented] (KAFKA-4698) `-target:jvm-1.7` in scalaCompileOptions seems to cause java.lang.VerifyError when loading kafka/client/ClientUtils

2017-01-25 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15838999#comment-15838999 ] Ismael Juma commented on KAFKA-4698: [~nickt], we can cherry-pick this into the 0.10.1

[jira] [Commented] (KAFKA-4698) `-target:jvm-1.7` in scalaCompileOptions seems to cause java.lang.VerifyError when loading kafka/client/ClientUtils

2017-01-25 Thread Nick Travers (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15838978#comment-15838978 ] Nick Travers commented on KAFKA-4698: - [~ijuma] [~hachikuji] - any chance we can get t

[jira] [Commented] (KAFKA-4597) Record metadata returned by producer doesn't consider log append time

2017-01-25 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15838973#comment-15838973 ] ASF GitHub Bot commented on KAFKA-4597: --- Github user asfgit closed the pull request

[jira] [Updated] (KAFKA-4597) Record metadata returned by producer doesn't consider log append time

2017-01-25 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-4597: --- Resolution: Fixed Status: Resolved (was: Patch Available) Issue resolved by pull requ

[GitHub] kafka pull request #2318: KAFKA-4597; RecordMetadata should return log appen...

2017-01-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2318 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Build failed in Jenkins: kafka-trunk-jdk8 #1217

2017-01-25 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-4698; VerifyError in kafka/client/ClientUtils due to -- [...truncated 823 lines...] kafka.server.KafkaConfigTest > testUncleanElectionEnabled STARTED kafka.server.Kaf

Re: [DISCUSS] KIP-98: Exactly Once Delivery and Transactional Messaging

2017-01-25 Thread Apurva Mehta
Hi Jun, Thanks again for the comments. More responses follow: > 101. Compatibility during upgrade: Suppose that the brokers are upgraded to > the new version, but the broker message format is still the old one. If a > new producer uses the transaction feature, should the producer get an error >

[GitHub] kafka pull request #2434: KAFKA-4698: VerifyError in kafka/client/ClientUtil...

2017-01-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2434 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Updated] (KAFKA-4698) `-target:jvm-1.7` in scalaCompileOptions seems to cause java.lang.VerifyError when loading kafka/client/ClientUtils

2017-01-25 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-4698: --- Resolution: Fixed Status: Resolved (was: Patch Available) Issue resolved by pull requ

[jira] [Commented] (KAFKA-4698) `-target:jvm-1.7` in scalaCompileOptions seems to cause java.lang.VerifyError when loading kafka/client/ClientUtils

2017-01-25 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15838927#comment-15838927 ] ASF GitHub Bot commented on KAFKA-4698: --- Github user asfgit closed the pull request

[jira] [Commented] (KAFKA-3806) Adjust default values of log.retention.hours and offsets.retention.minutes

2017-01-25 Thread Jeff Widman (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15838918#comment-15838918 ] Jeff Widman commented on KAFKA-3806: Too often people not super familiar with Kafka do

[jira] [Updated] (KAFKA-4698) `-target:jvm-1.7` in scalaCompileOptions seems to cause java.lang.VerifyError when loading kafka/client/ClientUtils

2017-01-25 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4698: --- Status: Patch Available (was: Open) > `-target:jvm-1.7` in scalaCompileOptions seems to cause java.la

Re: [VOTE] KIP-115: Enforce offsets.topic.replication.factor

2017-01-25 Thread Jason Gustafson
+1 On Wed, Jan 25, 2017 at 4:39 PM, Dong Lin wrote: > +1 > > On Wed, Jan 25, 2017 at 4:37 PM, Ismael Juma wrote: > > > +1 (binding) > > > > Ismael > > > > On Thu, Jan 26, 2017 at 12:34 AM, Onur Karaman < > > onurkaraman.apa...@gmail.com > > > wrote: > > > > > I'd like to start the vote for KIP-

[jira] [Commented] (KAFKA-4698) `-target:jvm-1.7` in scalaCompileOptions seems to cause java.lang.VerifyError when loading kafka/client/ClientUtils

2017-01-25 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15838906#comment-15838906 ] ASF GitHub Bot commented on KAFKA-4698: --- GitHub user ijuma opened a pull request:

[GitHub] kafka pull request #2434: KAFKA-4698: VerifyError in kafka/client/ClientUtil...

2017-01-25 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/2434 KAFKA-4698: VerifyError in kafka/client/ClientUtils due to -target:jvm-1.7 You can merge this pull request into a Git repository by running: $ git pull https://github.com/ijuma/kafka kafka-4698-

Re: [VOTE] KIP-115: Enforce offsets.topic.replication.factor

2017-01-25 Thread Dong Lin
+1 On Wed, Jan 25, 2017 at 4:37 PM, Ismael Juma wrote: > +1 (binding) > > Ismael > > On Thu, Jan 26, 2017 at 12:34 AM, Onur Karaman < > onurkaraman.apa...@gmail.com > > wrote: > > > I'd like to start the vote for KIP-115: Enforce > > offsets.topic.replication.factor > > > > https://cwiki.apache.

Re: [VOTE] KIP-115: Enforce offsets.topic.replication.factor

2017-01-25 Thread Ismael Juma
+1 (binding) Ismael On Thu, Jan 26, 2017 at 12:34 AM, Onur Karaman wrote: > I'd like to start the vote for KIP-115: Enforce > offsets.topic.replication.factor > > https://cwiki.apache.org/confluence/display/KAFKA/KIP- > 115%3A+Enforce+offsets.topic.replication.factor > > - Onur >

[VOTE] KIP-115: Enforce offsets.topic.replication.factor

2017-01-25 Thread Onur Karaman
I'd like to start the vote for KIP-115: Enforce offsets.topic.replication.factor https://cwiki.apache.org/confluence/display/KAFKA/KIP-115%3A+Enforce+offsets.topic.replication.factor - Onur

Re: [DISCUSS] KIP-115: Enforce offsets.topic.replication.factor

2017-01-25 Thread Jeff Widman
As a user, I'd personally rather see this land sooner rather than waiting for a major release... As long as it fails noisily if I don't have enough brokers when it tries to create the topic, then it's easy enough to solve... On Wed, Jan 25, 2017 at 4:22 PM, Ismael Juma wrote: > An important que

[jira] [Commented] (KAFKA-4691) ProducerInterceptor.onSend() is called after key and value are serialized

2017-01-25 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15838896#comment-15838896 ] Matthias J. Sax commented on KAFKA-4691: You should now have permission to assign

Re: [DISCUSS] KIP-115: Enforce offsets.topic.replication.factor

2017-01-25 Thread Dong Lin
+1 On Wed, Jan 25, 2017 at 4:22 PM, Ismael Juma wrote: > An important question is if this needs to wait for a major release or not. > > Ismael > > On Thu, Jan 26, 2017 at 12:19 AM, Ismael Juma wrote: > > > +1 from me too. > > > > Ismael > > > > On Thu, Jan 26, 2017 at 12:07 AM, Ewen Cheslack-Po

Re: [DISCUSS] KIP-115: Enforce offsets.topic.replication.factor

2017-01-25 Thread Ismael Juma
An important question is if this needs to wait for a major release or not. Ismael On Thu, Jan 26, 2017 at 12:19 AM, Ismael Juma wrote: > +1 from me too. > > Ismael > > On Thu, Jan 26, 2017 at 12:07 AM, Ewen Cheslack-Postava > wrote: > >> +1 >> >> Since this is an unusual one, I think it's wort

Re: [DISCUSS] KIP-115: Enforce offsets.topic.replication.factor

2017-01-25 Thread Ismael Juma
+1 from me too. Ismael On Thu, Jan 26, 2017 at 12:07 AM, Ewen Cheslack-Postava wrote: > +1 > > Since this is an unusual one, I think it's worth pointing out that the KIP > notes it is really a bug fix, but since it has compatibility implications > the KIP was worth it. It was a sort of intentio

Re: [DISCUSS] KIP-115: Enforce offsets.topic.replication.factor

2017-01-25 Thread Ewen Cheslack-Postava
+1 Since this is an unusual one, I think it's worth pointing out that the KIP notes it is really a bug fix, but since it has compatibility implications the KIP was worth it. It was a sort of intentional bug, but confusing and dangerous. Seems important to fix this ASAP since people are hitting th

[jira] [Commented] (KAFKA-4691) ProducerInterceptor.onSend() is called after key and value are serialized

2017-01-25 Thread Francesco Lemma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15838864#comment-15838864 ] Francesco Lemma commented on KAFKA-4691: Thanks [~mjsax] and [~apovzner]. Your poi

Re: [DISCUSS] KIP-115: Enforce offsets.topic.replication.factor

2017-01-25 Thread Jason Gustafson
+1 from me. The current behavior seems both surprising and dangerous. -Jason On Wed, Jan 25, 2017 at 3:58 PM, Onur Karaman wrote: > Hey everyone. > > I made a bug-fix KIP-115 to enforce offsets.topic.replication.factor: > https://cwiki.apache.org/confluence/display/KAFKA/KIP- > 115%3A+Enforce+o

[DISCUSS] KIP-115: Enforce offsets.topic.replication.factor

2017-01-25 Thread Onur Karaman
Hey everyone. I made a bug-fix KIP-115 to enforce offsets.topic.replication.factor: https://cwiki.apache.org/confluence/display/KAFKA/KIP-115%3A+Enforce+offsets.topic.replication.factor Comments are welcome. - Onur

[jira] [Commented] (KAFKA-4691) ProducerInterceptor.onSend() is called after key and value are serialized

2017-01-25 Thread Anna Povzner (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15838829#comment-15838829 ] Anna Povzner commented on KAFKA-4691: - I agree with [~mjsax] about not changing KafkaP

Build failed in Jenkins: kafka-trunk-jdk8 #1216

2017-01-25 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-3502: KStreamTestDriver needs to be closed after the test case [wangguoz] HOTFIX: KIP-104 follow-up: remove duplicated per-processor-node -- [...truncated 8440 lin

[jira] [Updated] (KAFKA-4698) `-target:jvm-1.7` in scalaCompileOptions seems to cause java.lang.VerifyError when loading kafka/client/ClientUtils

2017-01-25 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4698: --- Fix Version/s: 0.10.2.0 > `-target:jvm-1.7` in scalaCompileOptions seems to cause java.lang.VerifyErro

[jira] [Assigned] (KAFKA-4698) `-target:jvm-1.7` in scalaCompileOptions seems to cause java.lang.VerifyError when loading kafka/client/ClientUtils

2017-01-25 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma reassigned KAFKA-4698: -- Assignee: Ismael Juma > `-target:jvm-1.7` in scalaCompileOptions seems to cause java.lang.Verif

[jira] [Commented] (KAFKA-4691) ProducerInterceptor.onSend() is called after key and value are serialized

2017-01-25 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15838744#comment-15838744 ] Matthias J. Sax commented on KAFKA-4691: I see. Understood now. Seems to be a fair

[jira] [Commented] (KAFKA-1207) Launch Kafka from within Apache Mesos

2017-01-25 Thread postmas...@inn.ru (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15838740#comment-15838740 ] postmas...@inn.ru commented on KAFKA-1207: -- Delivery is delayed to these recipien

[jira] [Updated] (KAFKA-4698) `-target:jvm-1.7` in scalaCompileOptions seems to cause java.lang.VerifyError when loading kafka/client/ClientUtils

2017-01-25 Thread Chris Heisterkamp (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Heisterkamp updated KAFKA-4698: - Description: When we updated to kafka 2.11-0.10.1.1 from 2.11-0.8.2.2 we started getting t

[jira] [Created] (KAFKA-4698) `-target:jvm-1.7` in scalaCompileOptions seems to cause java.lang.VerifyError when loading kafka/client/ClientUtils

2017-01-25 Thread Chris Heisterkamp (JIRA)
Chris Heisterkamp created KAFKA-4698: Summary: `-target:jvm-1.7` in scalaCompileOptions seems to cause java.lang.VerifyError when loading kafka/client/ClientUtils Key: KAFKA-4698 URL: https://issues.apache.or

[jira] [Commented] (KAFKA-1207) Launch Kafka from within Apache Mesos

2017-01-25 Thread postmas...@inn.ru (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15838724#comment-15838724 ] postmas...@inn.ru commented on KAFKA-1207: -- Delivery is delayed to these recipien

[jira] [Comment Edited] (KAFKA-4691) ProducerInterceptor.onSend() is called after key and value are serialized

2017-01-25 Thread Francesco Lemma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15838657#comment-15838657 ] Francesco Lemma edited comment on KAFKA-4691 at 1/25/17 9:56 PM: ---

[jira] [Commented] (KAFKA-4691) ProducerInterceptor.onSend() is called after key and value are serialized

2017-01-25 Thread Francesco Lemma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15838657#comment-15838657 ] Francesco Lemma commented on KAFKA-4691: [~mjsax] This issue is not related to dyn

Re: [DISCUSS] KIP-112: Handle disk failure for JBOD

2017-01-25 Thread Dong Lin
Hey Colin, Good point! Yeah we have actually considered and tested this solution, which we call one-broker-per-disk. It would work and should require no major change in Kafka as compared to this JBOD KIP. So it would be a good short term solution. But it has a few drawbacks which makes it less de

[jira] [Commented] (KAFKA-4691) ProducerInterceptor.onSend() is called after key and value are serialized

2017-01-25 Thread Francesco Lemma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15838619#comment-15838619 ] Francesco Lemma commented on KAFKA-4691: Thanks Matthias. I perfectly understand w

Jenkins build is back to normal : kafka-trunk-jdk8 #1215

2017-01-25 Thread Apache Jenkins Server
See

Reg: Kafka ACLS

2017-01-25 Thread BigData dev
Hi, I have a question, can we use Kafka ACL's with only SASL/PLAIN mechanism. Because after I enabled, still I am able to produce/consume from topics. And one more observation is in kafka-_jaas.conf, there is no client section, will get an WARN as below, as we dont have this kind of mechanisim wit

[jira] [Commented] (KAFKA-4691) ProducerInterceptor.onSend() is called after key and value are serialized

2017-01-25 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15838565#comment-15838565 ] Matthias J. Sax commented on KAFKA-4691: Btw: we got "dynamic routing" (ie, comput

[jira] [Comment Edited] (KAFKA-4691) ProducerInterceptor.onSend() is called after key and value are serialized

2017-01-25 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15838558#comment-15838558 ] Matthias J. Sax edited comment on KAFKA-4691 at 1/25/17 8:55 PM: ---

[jira] [Commented] (KAFKA-4691) ProducerInterceptor.onSend() is called after key and value are serialized

2017-01-25 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15838558#comment-15838558 ] Matthias J. Sax commented on KAFKA-4691: Sorry for not being precise enough. For {

[jira] [Comment Edited] (KAFKA-4691) ProducerInterceptor.onSend() is called after key and value are serialized

2017-01-25 Thread Francesco Lemma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15838538#comment-15838538 ] Francesco Lemma edited comment on KAFKA-4691 at 1/25/17 8:46 PM: ---

  1   2   >