Re: [VOTE] KIP-45: Standardize KafkaConsumer API to use Collection

2016-04-28 Thread Harsha
Hi Jason, "t. I think what you're saying is that the KafkaSpout has been compiled against the 0.9 client, but it may need to be to run against 0.10 (if the user depends on that version instead). Is that correct?" Yes thats true. " Is that correct? In general, are you expecting that KafkaSpout

[jira] [Commented] (KAFKA-3578) Allow cross origin HTTP requests on all HTTP methods

2016-04-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263371#comment-15263371 ] ASF GitHub Bot commented on KAFKA-3578: --- GitHub user Ishiihara opened a pull request

[jira] [Commented] (KAFKA-1880) Add support for checking binary/source compatibility

2016-04-28 Thread Grant Henke (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263372#comment-15263372 ] Grant Henke commented on KAFKA-1880: I actually did not use the compatibility checker

[GitHub] kafka pull request: KAFKA-3578: Allow cross origin HTTP requests o...

2016-04-28 Thread Ishiihara
GitHub user Ishiihara opened a pull request: https://github.com/apache/kafka/pull/1288 KAFKA-3578: Allow cross origin HTTP requests on all HTTP methods You can merge this pull request into a Git repository by running: $ git pull https://github.com/Ishiihara/kafka kip-56 Alter

[jira] [Commented] (KAFKA-1880) Add support for checking binary/source compatibility

2016-04-28 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263358#comment-15263358 ] Ismael Juma commented on KAFKA-1880: That page lists a number of tools. What's the thi

[jira] [Commented] (KAFKA-1880) Add support for checking binary/source compatibility

2016-04-28 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263355#comment-15263355 ] Ismael Juma commented on KAFKA-1880: This is definitely much needed. > Add support fo

[jira] [Commented] (KAFKA-1880) Add support for checking binary/source compatibility

2016-04-28 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263347#comment-15263347 ] Gwen Shapira commented on KAFKA-1880: - It is useful already! Thank you for this cool c

Build failed in Jenkins: kafka-trunk-jdk7 #1231

2016-04-28 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Avoid compiler warnings when registering metrics in KafkaServer [me] KAFKA-3382: Add system test for ReplicationVerificationTool -- [...truncated 1611 lines...] ka

Re: [DISCUSS] KIP-54 Sticky Partition Assignment Strategy

2016-04-28 Thread Jason Gustafson
Hey Edo, The background is here: https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Client-side+Assignment+Proposal. Yes, it's more work for implementations, but it also opens the door for other use cases (e.g. Kafka Connect is using the same protocol). It also makes it easier for clients to

Build failed in Jenkins: kafka-trunk-jdk8 #567

2016-04-28 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Avoid compiler warnings when registering metrics in KafkaServer [me] KAFKA-3382: Add system test for ReplicationVerificationTool -- [...truncated 4839 lines...] kaf

Re: [VOTE] KIP-45: Standardize KafkaConsumer API to use Collection

2016-04-28 Thread Grant Henke
FYI. I have attached a sample clients API change/compatibility report to KAFKA-1880 . The report shows changes in the public apis between the 0.9 and trunk branches. Some of them are expected per KIP-45 obviously. Thanks, Grant On Thu, Apr 28, 20

Re: [VOTE] KIP-45: Standardize KafkaConsumer API to use Collection

2016-04-28 Thread Jason Gustafson
Hey Harsha, We're just trying to understand the problem first. I think what you're saying is that the KafkaSpout has been compiled against the 0.9 client, but it may need to be to run against 0.10 (if the user depends on that version instead). Is that correct? In general, are you expecting that Ka

[jira] [Updated] (KAFKA-1880) Add support for checking binary/source compatibility

2016-04-28 Thread Grant Henke (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke updated KAFKA-1880: --- Attachment: compatibilityReport.html Attaching a sample html compatibility report for all public chang

[jira] [Commented] (KAFKA-1880) Add support for checking binary/source compatibility

2016-04-28 Thread Grant Henke (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263239#comment-15263239 ] Grant Henke commented on KAFKA-1880: I have started hacking together a solution for th

[jira] [Assigned] (KAFKA-1880) Add support for checking binary/source compatibility

2016-04-28 Thread Grant Henke (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke reassigned KAFKA-1880: -- Assignee: Grant Henke (was: Ashish K Singh) > Add support for checking binary/source compatibi

[jira] [Created] (KAFKA-3641) Fix RecordMetadata constructor backward compatibility

2016-04-28 Thread Grant Henke (JIRA)
Grant Henke created KAFKA-3641: -- Summary: Fix RecordMetadata constructor backward compatibility Key: KAFKA-3641 URL: https://issues.apache.org/jira/browse/KAFKA-3641 Project: Kafka Issue Type:

Re: [DISCUSS] KIP-54 Sticky Partition Assignment Strategy

2016-04-28 Thread Edoardo Comar
Hi why is the calculation of the partition assignments to group member being executed by the client (leader of the group), rather than server (eg by the group Coordinator) ? This question came up working with Vahid Hashemian on https://issues.apache.org/jira/browse/KAFKA-2273 We have impleme

Build failed in Jenkins: kafka-trunk-jdk8 #566

2016-04-28 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-3636; Change default max session timeout to 5 minutes -- [...truncated 1664 lines...] kafka.server.ServerStartupTest > testConflictBrokerRegistration PASSED kafka.se

[jira] [Created] (KAFKA-3640) Reduce the latency of topic metadata requests

2016-04-28 Thread Flavio Junqueira (JIRA)
Flavio Junqueira created KAFKA-3640: --- Summary: Reduce the latency of topic metadata requests Key: KAFKA-3640 URL: https://issues.apache.org/jira/browse/KAFKA-3640 Project: Kafka Issue Type:

[jira] [Resolved] (KAFKA-3638) Using kafka-console-producer with invalid broker list weirds to unexpected behavior

2016-04-28 Thread Grant Henke (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke resolved KAFKA-3638. Resolution: Duplicate Assignee: Grant Henke > Using kafka-console-producer with invalid broker

[jira] [Commented] (KAFKA-2273) Add rebalance with a minimal number of reassignments to server-defined strategy list

2016-04-28 Thread Edoardo Comar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263195#comment-15263195 ] Edoardo Comar commented on KAFKA-2273: -- Working on this with [~vahid] - propagating t

[jira] [Commented] (KAFKA-3382) Add system test for ReplicationVerificationTool

2016-04-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263191#comment-15263191 ] ASF GitHub Bot commented on KAFKA-3382: --- Github user asfgit closed the pull request

[jira] [Updated] (KAFKA-3382) Add system test for ReplicationVerificationTool

2016-04-28 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3382: - Resolution: Fixed Status: Resolved (was: Patch Available) Issue resolved

[GitHub] kafka pull request: KAFKA-3382: Add system test for ReplicationVer...

2016-04-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1160 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-3638) Using kafka-console-producer with invalid broker list weirds to unexpected behavior

2016-04-28 Thread Jarek Jarcec Cecho (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263187#comment-15263187 ] Jarek Jarcec Cecho commented on KAFKA-3638: --- Yup KAFKA-3468 definitely seems to

[jira] [Commented] (KAFKA-3638) Using kafka-console-producer with invalid broker list weirds to unexpected behavior

2016-04-28 Thread Grant Henke (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263182#comment-15263182 ] Grant Henke commented on KAFKA-3638: [~jarcec] This looks like it might be covered by

[GitHub] kafka pull request: MINOR: Avoid compiler warnings when registerin...

2016-04-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1280 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Updated] (KAFKA-3440) Add Javadoc for KTable (changelog stream) and KStream (record stream)

2016-04-28 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-3440: --- Status: Patch Available (was: In Progress) > Add Javadoc for KTable (changelog stream) and KS

[jira] [Commented] (KAFKA-3440) Add Javadoc for KTable (changelog stream) and KStream (record stream)

2016-04-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263166#comment-15263166 ] ASF GitHub Bot commented on KAFKA-3440: --- GitHub user mjsax opened a pull request:

[GitHub] kafka pull request: KAFKA-3440: update JavaDoc

2016-04-28 Thread mjsax
GitHub user mjsax opened a pull request: https://github.com/apache/kafka/pull/1287 KAFKA-3440: update JavaDoc - add class doc for KTable, KStream, JoinWindows - add missing @return tags You can merge this pull request into a Git repository by running: $ git pull https://git

Re: Tell us how you're using Kafka and what you'd like to see in the future

2016-04-28 Thread Grant Henke
Hi Neha, Thanks for sending out this Survey! Hopefully we got a lot of responses from the community. Are there any results to share? Thank you, Grant On Wed, Apr 6, 2016 at 4:58 PM, Neha Narkhede wrote: > Folks, > > We'd like to hear from community members about how you are using Kafka > today

Re: No Heartbeat request on commit

2016-04-28 Thread vinay sharma
I sent it as attachment. I did not zip it and may have been rejected by mail server. Will send again shortly. On Apr 28, 2016 5:11 PM, "Jason Gustafson" wrote: > Hey Vinay, > > Did you forget to attach the simple class? > > -Jason > > On Thu, Apr 28, 2016 at 1:14 PM, vinay sharma > wrote: > > >

Build failed in Jenkins: kafka-trunk-jdk8 #565

2016-04-28 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-3617; Unit tests for SASL authenticator -- [...truncated 4371 lines...] kafka.admin.AdminRackAwareTest > testAssignmentWithRackAwareWithUnevenReplicas PASSED kafka.

[jira] [Commented] (KAFKA-3618) Handle ApiVersionRequest before SASL handshake

2016-04-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263093#comment-15263093 ] ASF GitHub Bot commented on KAFKA-3618: --- GitHub user rajinisivaram opened a pull req

[GitHub] kafka pull request: KAFKA-3618: Handle ApiVersionsRequest before S...

2016-04-28 Thread rajinisivaram
GitHub user rajinisivaram opened a pull request: https://github.com/apache/kafka/pull/1286 KAFKA-3618: Handle ApiVersionsRequest before SASL authentication Server-side implementation and tests for handling ApiVersionsRequest before SaslHandshakeRequest. You can merge this pull requ

[jira] [Created] (KAFKA-3639) Configure default serdes passed via StreamsConfig

2016-04-28 Thread Guozhang Wang (JIRA)
Guozhang Wang created KAFKA-3639: Summary: Configure default serdes passed via StreamsConfig Key: KAFKA-3639 URL: https://issues.apache.org/jira/browse/KAFKA-3639 Project: Kafka Issue Type: B

[GitHub] kafka pull request: KAFKA-3618: Handle ApiVersionsRequest before S...

2016-04-28 Thread rajinisivaram
Github user rajinisivaram closed the pull request at: https://github.com/apache/kafka/pull/1276 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[jira] [Commented] (KAFKA-3634) Add ducktape tests for upgrade with SASL

2016-04-28 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263065#comment-15263065 ] Ismael Juma commented on KAFKA-3634: I think we may already have the first case descri

[jira] [Updated] (KAFKA-3515) Migrate org.apache.kafka.connect.json.JsonSerializer / Deser to common package

2016-04-28 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3515: --- Fix Version/s: (was: 0.10.0.0) 0.10.1.0 > Migrate org.apache.kafka.connect.json

[jira] [Created] (KAFKA-3638) Using kafka-console-producer with invalid broker list weirds to unexpected behavior

2016-04-28 Thread Jarek Jarcec Cecho (JIRA)
Jarek Jarcec Cecho created KAFKA-3638: - Summary: Using kafka-console-producer with invalid broker list weirds to unexpected behavior Key: KAFKA-3638 URL: https://issues.apache.org/jira/browse/KAFKA-3638

[jira] [Commented] (KAFKA-3618) Handle ApiVersionRequest before SASL handshake

2016-04-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263050#comment-15263050 ] ASF GitHub Bot commented on KAFKA-3618: --- Github user rajinisivaram closed the pull r

[jira] [Resolved] (KAFKA-3636) Increase default group.max.session.timeout.ms to 5 minutes

2016-04-28 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-3636. Resolution: Fixed Fix Version/s: 0.10.0.0 Issue resolved by pull request 1284 [https://github

[jira] [Commented] (KAFKA-3636) Increase default group.max.session.timeout.ms to 5 minutes

2016-04-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263045#comment-15263045 ] ASF GitHub Bot commented on KAFKA-3636: --- Github user asfgit closed the pull request

[GitHub] kafka pull request: KAFKA-3636: change default max session timeout...

2016-04-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1284 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Re: No Heartbeat request on commit

2016-04-28 Thread Jason Gustafson
Hey Vinay, Did you forget to attach the simple class? -Jason On Thu, Apr 28, 2016 at 1:14 PM, vinay sharma wrote: > I was also wondering that if commitSync acts as heartbeat then why do we > still trigger heartbeat request on commit? why not just reset its time on > successful commitSync? or a

Re: [VOTE] KIP-45: Standardize KafkaConsumer API to use Collection

2016-04-28 Thread Harsha
Hi Ismael, This will solve both binary and source compatibility. Storm has new KafkaSpout that used 0.9.x new KafkaSpout API. As part of that spout we used KafkaConsumer.seekToBeginning and other methods. Since the method signatu

[GitHub] kafka pull request: KAFKA-3617: Unit tests for SASL authenticator

2016-04-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1273 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Updated] (KAFKA-3617) Add unit tests for SASL authentication

2016-04-28 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3617: --- Resolution: Fixed Status: Resolved (was: Patch Available) Issue resolved by pull request 1273

[jira] [Commented] (KAFKA-3617) Add unit tests for SASL authentication

2016-04-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262945#comment-15262945 ] ASF GitHub Bot commented on KAFKA-3617: --- Github user asfgit closed the pull request

Re: [Release] Status update

2016-04-28 Thread Gwen Shapira
Small clarification: "Two KIPs may get in after the release (provided high quality, documented and well-tested PR):" I meant "after the next release candidate but still get into 0.10.0 release" Gwen On Thu, Apr 28, 2016 at 11:02 AM, Ismael Juma wrote: > Thanks for the update Gwen. Looking at th

Re: [VOTE] KIP-45: Standardize KafkaConsumer API to use Collection

2016-04-28 Thread Ismael Juma
Hi Harsha, What is the aim of the PR, is it to fix binary compatibility, source compatibility or both? I think it only fixes source compatibility, so I am interested in what testing has been done to ensure that this fix solves the Storm issue. Thanks, Ismael On Thu, Apr 28, 2016 at 12:58 PM, Har

Re: No Heartbeat request on commit

2016-04-28 Thread vinay sharma
I was also wondering that if commitSync acts as heartbeat then why do we still trigger heartbeat request on commit? why not just reset its time on successful commitSync? or am i wrong and we do this already? Regards, Vinay On Thu, Apr 28, 2016 at 3:38 PM, vinay sharma wrote: > Hi Jason, > > Att

Re: [VOTE] KIP-45: Standardize KafkaConsumer API to use Collection

2016-04-28 Thread Harsha
Hi, We missed this vote earlier and realized thats its breaking the 0.9.x client api compatibility. I opened a JIRA here https://issues.apache.org/jira/browse/KAFKA-3633 . Can we keep the old methods with deprecated tag in 0.10 release. Thanks, Harsha On Fri, Mar 18,

Re: [DISCUSSION] KAFKA-3633. Kafka Consumer API breaking backward compatibility

2016-04-28 Thread Hugo Da Cruz Louro
Hi Jason, In my opinion, if one changes the implementation (KafkaConsumer), one is not technically changing the API, which is the Consumer interface. That’s the reason behind coding behind interfaces, that the implementation can change, but the (public) API remains unchanged. We are not fundame

Re: [DISCUSSION] KAFKA-3633. Kafka Consumer API breaking backward compatibility

2016-04-28 Thread Harsha
Hi Jason, Agree and its my bad to not to raise this during the voting of KIP-45. Which I missed it. We can definitely start a vote around it. Thanks, Harsha On Thu, Apr 28, 2016, at 12:45 PM, Jason Gustafson wrote: > Hey Harsha, > > Probably the main concern is that w

Build failed in Jenkins: kafka-trunk-jdk8 #564

2016-04-28 Thread Apache Jenkins Server
See Changes: [me] KAFKA-3611: Remove warnings when using reflections -- [...truncated 4443 lines...] kafka.admin.AdminRackAwareTest > testRackAwareExpansion PASSED kafka.admin.AdminRackAwareTes

Re: [DISCUSSION] KAFKA-3633. Kafka Consumer API breaking backward compatibility

2016-04-28 Thread Jason Gustafson
Hey Harsha, Probably the main concern is that we already voted to do this in KIP-45. The compatibility concern was brought up in the discussion (I was actually in favor of overloading), but we ultimately decided to make the breaking change to keep the API small. That may or may not have been the r

Re: No Heartbeat request on commit

2016-04-28 Thread vinay sharma
Hi Jason, Attached is a simple class with a main method. I used this for reproducing issue and generate logs that i attached earlier. This class has code snippets of poller relevant to the issue. Regards, Vinay Sharma On Thu, Apr 28, 2016 at 3:30 PM, Jason Gustafson wrote: > Hey Vinay, > > Tha

Re: [DISCUSSION] KAFKA-3633. Kafka Consumer API breaking backward compatibility

2016-04-28 Thread Hugo Da Cruz Louro
Hello everyone, I understand the concerns over making the API more confusing to new users, but the current implementation does not add any new methods to the interface Consumer. It simply adds the pre-existing methods with varargs parameters to t

Re: No Heartbeat request on commit

2016-04-28 Thread Jason Gustafson
Hey Vinay, Thanks, that's really helpful. It does seem like there might be a problem with the heartbeat trigger logic. I'll see if I can reproduce what you're seeing locally. Might be helpful if you share a snippet of your poll loop. Thanks, Jason On Thu, Apr 28, 2016 at 11:55 AM, vinay sharma

[jira] [Updated] (KAFKA-3636) Increase default group.max.session.timeout.ms to 5 minutes

2016-04-28 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-3636: --- Summary: Increase default group.max.session.timeout.ms to 5 minutes (was: Increase default gr

[jira] [Commented] (KAFKA-3636) Increase default group.max.session.timeout.ms to 3 minutes

2016-04-28 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262790#comment-15262790 ] Jason Gustafson commented on KAFKA-3636: I talked with [~ijuma] and [~guozhang] an

[DISCUSSION] KAFKA-3633. Kafka Consumer API breaking backward compatibility

2016-04-28 Thread Harsha
Hi All, We noticed KIP-45 broke the compatibility with the consumer API that shipped in 0.9.x releases. Hugo posted a patch that only adds these old methods back to KafkaConsumer.java with the deprecated tag. I would like to get this in 0.10 release so that it will help anyone who us

[jira] [Commented] (KAFKA-3633) Kafka Consumer API breaking backward compatibility

2016-04-28 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262762#comment-15262762 ] Sriharsha Chintalapani commented on KAFKA-3633: --- [~gwenshap] the above patch

[jira] [Comment Edited] (KAFKA-3633) Kafka Consumer API breaking backward compatibility

2016-04-28 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262756#comment-15262756 ] Gwen Shapira edited comment on KAFKA-3633 at 4/28/16 7:04 PM: --

[jira] [Commented] (KAFKA-3633) Kafka Consumer API breaking backward compatibility

2016-04-28 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262756#comment-15262756 ] Gwen Shapira commented on KAFKA-3633: - It doesn't cause immediate issues, but it makes

[jira] [Commented] (KAFKA-3611) Remove WARNs when using reflections

2016-04-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262745#comment-15262745 ] ASF GitHub Bot commented on KAFKA-3611: --- Github user asfgit closed the pull request

[jira] [Updated] (KAFKA-3611) Remove WARNs when using reflections

2016-04-28 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3611: - Resolution: Fixed Fix Version/s: (was: 0.10.0.0) 0.10

[GitHub] kafka pull request: KAFKA-3611: Remove warnings when using reflect...

2016-04-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1259 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Updated] (KAFKA-3637) Add method that checks if streams are initialised

2016-04-28 Thread Eno Thereska (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eno Thereska updated KAFKA-3637: Assignee: (was: Guozhang Wang) > Add method that checks if streams are initialised > ---

[jira] [Created] (KAFKA-3637) Add method that checks if streams are initialised

2016-04-28 Thread Eno Thereska (JIRA)
Eno Thereska created KAFKA-3637: --- Summary: Add method that checks if streams are initialised Key: KAFKA-3637 URL: https://issues.apache.org/jira/browse/KAFKA-3637 Project: Kafka Issue Type: Sub

[jira] [Updated] (KAFKA-3440) Add Javadoc for KTable (changelog stream) and KStream (record stream)

2016-04-28 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-3440: --- Description: Currently we only have a 1-liner in {code}KTable{code} and {code}KStream{code} c

[jira] [Work started] (KAFKA-3440) Add Javadoc for KTable (changelog stream) and KStream (record stream)

2016-04-28 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-3440 started by Matthias J. Sax. -- > Add Javadoc for KTable (changelog stream) and KStream (record stream) > ---

Re: No Heartbeat request on commit

2016-04-28 Thread vinay sharma
Hi Jason, i reverted back to KAFKA-3149. Producer still had issues related to schema but my consumer worked. Now consumer worked as expected. Although i did not encountered an error and generation was not marked dead by coordinator but i still see that successful heartbeat response are not logged

[jira] [Resolved] (KAFKA-3574) Add missing @returns tags for JavaDoc

2016-04-28 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-3574. Resolution: Duplicate > Add missing @returns tags for JavaDoc >

[jira] [Closed] (KAFKA-3574) Add missing @returns tags for JavaDoc

2016-04-28 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax closed KAFKA-3574. -- > Add missing @returns tags for JavaDoc > - > >

[jira] [Updated] (KAFKA-3440) Add Javadoc for KTable (changelog stream) and KStream (record stream)

2016-04-28 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-3440: --- Description: Currently we only have a 1-liner in {code}KTable{code} and {code}KStream{code} c

[jira] [Assigned] (KAFKA-3440) Add Javadoc for KTable (changelog stream) and KStream (record stream)

2016-04-28 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-3440: -- Assignee: Matthias J. Sax > Add Javadoc for KTable (changelog stream) and KStream (reco

[jira] [Assigned] (KAFKA-3574) Add missing @returns tags for JavaDoc

2016-04-28 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-3574: -- Assignee: Matthias J. Sax (was: Guozhang Wang) > Add missing @returns tags for JavaDoc

[jira] [Updated] (KAFKA-3597) Enable query ConsoleConsumer and VerifiableProducer if they shutdown cleanly

2016-04-28 Thread Anna Povzner (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anna Povzner updated KAFKA-3597: Status: Patch Available (was: In Progress) > Enable query ConsoleConsumer and VerifiableProducer if

[jira] [Commented] (KAFKA-3633) Kafka Consumer API breaking backward compatibility

2016-04-28 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262646#comment-15262646 ] Sriharsha Chintalapani commented on KAFKA-3633: --- [~gwenshap] I understand th

Re: [Release] Status update

2016-04-28 Thread Ismael Juma
Thanks for the update Gwen. Looking at that list, it seems to me that the community did very well in a relatively short period of time (and it doesn't include the large number of bug fixes, test and documentation improvements). Ismael On Thu, Apr 28, 2016 at 10:53 AM, Gwen Shapira wrote: > Hi T

[jira] [Commented] (KAFKA-3294) Kafka REST API

2016-04-28 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262631#comment-15262631 ] Sriharsha Chintalapani commented on KAFKA-3294: --- [~lindong] we just shared t

[GitHub] kafka pull request: MINOR: Added more integration tests

2016-04-28 Thread enothereska
GitHub user enothereska opened a pull request: https://github.com/apache/kafka/pull/1285 MINOR: Added more integration tests You can merge this pull request into a Git repository by running: $ git pull https://github.com/enothereska/kafka more-integration-tests Alternatively

[Release] Status update

2016-04-28 Thread Gwen Shapira
Hi Team Kafka, Here's a short status update before I am merging trunk into 0.10.0 branch and creating a new release candidate, tomorrow morning. KIPs included in the release: KIP-28 Kafka Streams KIP-31 Relative offsets in compressed messages KIP-32 Add timestamps to messages KIP-36 Rack awar

[jira] [Commented] (KAFKA-3633) Kafka Consumer API breaking backward compatibility

2016-04-28 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262593#comment-15262593 ] Gwen Shapira commented on KAFKA-3633: - I completely understand the pain that this chan

[jira] [Commented] (KAFKA-3294) Kafka REST API

2016-04-28 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262592#comment-15262592 ] Dong Lin commented on KAFKA-3294: - [~harsha_ch] [~parth.brahmbhatt] This seems to be a big

[GitHub] kafka pull request: KAFKA-3636: change default max session timeout...

2016-04-28 Thread hachikuji
GitHub user hachikuji opened a pull request: https://github.com/apache/kafka/pull/1284 KAFKA-3636: change default max session timeout to 3 minutes You can merge this pull request into a Git repository by running: $ git pull https://github.com/hachikuji/kafka KAFKA-3636 Altern

[jira] [Commented] (KAFKA-3636) Increase default group.max.session.timeout.ms to 3 minutes

2016-04-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262567#comment-15262567 ] ASF GitHub Bot commented on KAFKA-3636: --- GitHub user hachikuji opened a pull request

[jira] [Created] (KAFKA-3636) Increase default group.max.session.timeout.ms to 3 minutes

2016-04-28 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-3636: -- Summary: Increase default group.max.session.timeout.ms to 3 minutes Key: KAFKA-3636 URL: https://issues.apache.org/jira/browse/KAFKA-3636 Project: Kafka

Re: No Heartbeat request on commit

2016-04-28 Thread Jason Gustafson
Ah, yeah. That's probably caused by the new topic metadata version, which isn't supported on 0.9 brokers. To test on trunk, you'd have to upgrade the brokers as well. Either that or you can rewind to before KAFKA-3306 (which was just committed the day before yesterday)? -Jason On Thu, Apr 28, 201

Re: [VOTE] KIP-57: Interoperable LZ4 Framing

2016-04-28 Thread Dana Powers
Sure thing. Yes, the substantive change is fixing the HC checksum. But to further improve interoperability, the kafka LZ4 class would no longer reject messages that have these optional header flags set. The flags might get set if the client/user chooses to use a non-java lz4 compression library th

Re: No Heartbeat request on commit

2016-04-28 Thread vinay sharma
Hi Jason, I build kafka-client and tried using it but my producers and consumers started throwing below exception. Is 0.10 not going to be compatible with brokers on version 0.9.0.1? or do i need to make some config changes to producers / consumers to make them compatible with brokers on old versi

[jira] [Updated] (KAFKA-2651) Remove deprecated config alteration from TopicCommand in 0.9.1.0

2016-04-28 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar Reddy updated KAFKA-2651: --- Assignee: Manikumar Reddy Status: Patch Available (was: Open) > Remove deprecated confi

[jira] [Commented] (KAFKA-2651) Remove deprecated config alteration from TopicCommand in 0.9.1.0

2016-04-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262372#comment-15262372 ] ASF GitHub Bot commented on KAFKA-2651: --- GitHub user omkreddy opened a pull request:

[GitHub] kafka pull request: KAFKA-2651; Remove deprecated config alteratio...

2016-04-28 Thread omkreddy
GitHub user omkreddy opened a pull request: https://github.com/apache/kafka/pull/1283 KAFKA-2651; Remove deprecated config alteration from TopicCommand You can merge this pull request into a Git repository by running: $ git pull https://github.com/omkreddy/kafka KAFKA-2651 Al

Re: [VOTE] KIP-47 - Add timestamp-based log deletion policy

2016-04-28 Thread Bill Warshaw
I'd like to re-initiate the vote for KIP-47 now that KIP-33 has been accepted and is in-progress. I've updated the KIP ( https://cwiki.apache.org/confluence/display/KAFKA/KIP-47+-+Add+timestamp-based+log+deletion+policy). I have a commit with the functionality for KIP-47 ready to go once KIP-33 is

Re: [VOTE] KIP-50: Move Authorizer to o.a.k.common package - Round 2

2016-04-28 Thread Jun Rao
Ashish, Thanks for the proposal. +1 Jun On Mon, Apr 25, 2016 at 10:04 AM, Ashish Singh wrote: > Hey Guys, > > I would like to re-initiate the voting process for KIP-50: Move Authorizer > to o.a.k.common package. KIP-50 is available here > < > https://cwiki.apache.org/confluence/display/KAFKA/K

Re: [VOTE] KIP-57: Interoperable LZ4 Framing

2016-04-28 Thread Jun Rao
Hi, Dana, Could you explain the following from the KIP a bit more? The KIP is intended to just fix the HC checksum, but the following seems to suggest there are other format changes? KafkaLZ4* code: - add naive support for optional header flags (ContentSize, ContentChecksum) to enable inte

[jira] [Assigned] (KAFKA-3587) LogCleaner fails due to incorrect offset map computation on a replica

2016-04-28 Thread Edoardo Comar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edoardo Comar reassigned KAFKA-3587: Assignee: Edoardo Comar (was: Manikumar Reddy) > LogCleaner fails due to incorrect offset

  1   2   >