[GitHub] kafka pull request: KAFKA-1595; Remove deprecated and slower scala...

2015-07-14 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/74 KAFKA-1595; Remove deprecated and slower scala JSON parser A thin wrapper over Jackson's Tree Model API is used as the replacement. This wrapper increases safety while providing a simple, but powerf

[jira] [Commented] (KAFKA-1595) Remove deprecated and slower scala JSON parser from kafka.consumer.TopicCount

2015-07-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14626050#comment-14626050 ] ASF GitHub Bot commented on KAFKA-1595: --- GitHub user ijuma opened a pull request:

[jira] [Updated] (KAFKA-2320) Configure GitHub pull request build in Jenkins

2015-07-14 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-2320: --- Description: The details are available in the following Apache Infra post: https://blogs.apache.org/in

Re: [DISCUSS] Using GitHub Pull Requests for contributions and code review

2015-07-14 Thread Ismael Juma
Hi Jun, On Tue, Jul 14, 2015 at 2:09 AM, Jun Rao wrote: > Ismael, > > I followed the instructions in KAFKA-2320 and created a new Jenkins job ( > https://builds.apache.org/job/kafka-trunk-git-pr/). Could you check if it > works? > Thanks! It seems to be building when trunk changes as opposed t

[jira] [Commented] (KAFKA-1835) Kafka new producer needs options to make blocking behavior explicit

2015-07-14 Thread Stefan Miklosovic (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14626122#comment-14626122 ] Stefan Miklosovic commented on KAFKA-1835: -- Awesome discussion guys! I love to ha

Re: Review Request 34641: Patch for KAFKA-2214

2015-07-14 Thread Manikumar Reddy O
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34641/ --- (Updated July 14, 2015, 10:03 a.m.) Review request for kafka. Bugs: KAFKA-221

[jira] [Commented] (KAFKA-2214) kafka-reassign-partitions.sh --verify should return non-zero exit codes when reassignment is not completed yet

2015-07-14 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14626148#comment-14626148 ] Manikumar Reddy commented on KAFKA-2214: Updated reviewboard https://reviews.apach

[jira] [Updated] (KAFKA-2214) kafka-reassign-partitions.sh --verify should return non-zero exit codes when reassignment is not completed yet

2015-07-14 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar Reddy updated KAFKA-2214: --- Attachment: KAFKA-2214_2015-07-14_15:31:12.patch > kafka-reassign-partitions.sh --verify shoul

Re: Review Request 34641: Patch for KAFKA-2214

2015-07-14 Thread Manikumar Reddy O
> On May 26, 2015, 7:08 a.m., Michael Noll wrote: > > core/src/main/scala/kafka/admin/ReassignPartitionsCommand.scala, line 81 > > > > > > Should we also consider reassignments that are in-progress as "errors"? > >

[jira] [Commented] (KAFKA-2214) kafka-reassign-partitions.sh --verify should return non-zero exit codes when reassignment is not completed yet

2015-07-14 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14626153#comment-14626153 ] Manikumar Reddy commented on KAFKA-2214: Uploaded a new patch which returns differ

Re: Review Request 34641: Patch for KAFKA-2214

2015-07-14 Thread Manikumar Reddy O
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34641/ --- (Updated July 14, 2015, 10:13 a.m.) Review request for kafka. Bugs: KAFKA-221

[jira] [Commented] (KAFKA-2214) kafka-reassign-partitions.sh --verify should return non-zero exit codes when reassignment is not completed yet

2015-07-14 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14626157#comment-14626157 ] Manikumar Reddy commented on KAFKA-2214: Updated reviewboard https://reviews.apach

[jira] [Updated] (KAFKA-2214) kafka-reassign-partitions.sh --verify should return non-zero exit codes when reassignment is not completed yet

2015-07-14 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar Reddy updated KAFKA-2214: --- Attachment: KAFKA-2214_2015-07-14_15:40:49.patch > kafka-reassign-partitions.sh --verify shoul

Re: Build failed in Jenkins: KafkaPreCommit #147

2015-07-14 Thread Ismael Juma
On Tue, Jul 14, 2015 at 7:01 AM, Gwen Shapira wrote: > Looks like ConsumerBounceTest is flaky. Anyone knows if there's a JIRA for > it? > It seemed to be failing more-or-less at random in the last few builds. > I haven't seen one. Another test that is quite flaky for me is `SocketServerTest`. It

[jira] [Updated] (KAFKA-2300) Error in controller log when broker tries to rejoin cluster

2015-07-14 Thread Flavio Junqueira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flavio Junqueira updated KAFKA-2300: Attachment: KAFKA-2300.patch Attaching a preliminary patch in the case anyone is willing to

Re: Review Request 35867: Patch for KAFKA-1901

2015-07-14 Thread Manikumar Reddy O
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/35867/ --- (Updated July 14, 2015, 12:32 p.m.) Review request for kafka. Bugs: KAFKA-190

[jira] [Updated] (KAFKA-1901) Move Kafka version to be generated in code by build (instead of in manifest)

2015-07-14 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar Reddy updated KAFKA-1901: --- Attachment: KAFKA-1901_2015-07-14_17:59:56.patch > Move Kafka version to be generated in code

Re: Review Request 35867: Patch for KAFKA-1901

2015-07-14 Thread Manikumar Reddy O
> On July 14, 2015, 1:59 a.m., Joel Koshy wrote: > > core/src/main/scala/kafka/common/AppInfo.scala, line 27 > > > > > > Per the comment in the previous diff, I think this can go now right? > > i.e., kafka server dep

[jira] [Commented] (KAFKA-1901) Move Kafka version to be generated in code by build (instead of in manifest)

2015-07-14 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14626292#comment-14626292 ] Manikumar Reddy commented on KAFKA-1901: Updated reviewboard https://reviews.apach

[jira] [Comment Edited] (KAFKA-2300) Error in controller log when broker tries to rejoin cluster

2015-07-14 Thread Flavio Junqueira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14626247#comment-14626247 ] Flavio Junqueira edited comment on KAFKA-2300 at 7/14/15 1:13 PM: --

Re: Build failed in Jenkins: KafkaPreCommit #147

2015-07-14 Thread Guozhang Wang
I think there is no JIRA ticket created for ConsumerBounceTest yet. We can create a new one for it. On Tue, Jul 14, 2015 at 4:12 AM, Ismael Juma wrote: > On Tue, Jul 14, 2015 at 7:01 AM, Gwen Shapira wrote: > > > Looks like ConsumerBounceTest is flaky. Anyone knows if there's a JIRA > for > > i

Re: Build failed in Jenkins: KafkaPreCommit #147

2015-07-14 Thread Jason Gustafson
Looks like there is already KAFKA-2055 for the transient ConsumerBounceTest failure. I'll have a look at it. -Jason On Tue, Jul 14, 2015 at 9:02 AM, Guozhang Wang wrote: > I think there is no JIRA ticket created for ConsumerBounceTest yet. We can > create a new one for it. > > On Tue, Jul 14, 2

[jira] [Commented] (KAFKA-1835) Kafka new producer needs options to make blocking behavior explicit

2015-07-14 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14626627#comment-14626627 ] Guozhang Wang commented on KAFKA-1835: -- [~becket_qin][~smiklosovic][~ewencp] I think

Re: Build failed in Jenkins: KafkaPreCommit #147

2015-07-14 Thread Guozhang Wang
Ohhh ... you are right, and I cannot believe it was created by myself, totally forgot about that. On Tue, Jul 14, 2015 at 9:30 AM, Jason Gustafson wrote: > Looks like there is already KAFKA-2055 for the transient ConsumerBounceTest > failure. I'll have a look at it. > > -Jason > > On Tue, Jul 14

[jira] [Updated] (KAFKA-2188) JBOD Support

2015-07-14 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-2188: --- Reviewer: Jun Rao (was: Jay Kreps) > JBOD Support > > > Key: KAFKA-2188 >

[jira] [Updated] (KAFKA-2210) KafkaAuthorizer: Add all public entities, config changes and changes to KafkaAPI and kafkaServer to allow pluggable authorizer implementation.

2015-07-14 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-2210: --- Reviewer: Jun Rao > KafkaAuthorizer: Add all public entities, config changes and changes to > KafkaAPI and ka

[jira] [Updated] (KAFKA-2123) Make new consumer offset commit API use callback + future

2015-07-14 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-2123: --- Reviewer: Guozhang Wang (was: Jay Kreps) > Make new consumer offset commit API use callback + future > --

Re: Review Request 34492: Patch for KAFKA-2210

2015-07-14 Thread Parth Brahmbhatt
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34492/ --- (Updated July 14, 2015, 5:02 p.m.) Review request for kafka. Bugs: KAFKA-2210

[jira] [Updated] (KAFKA-2210) KafkaAuthorizer: Add all public entities, config changes and changes to KafkaAPI and kafkaServer to allow pluggable authorizer implementation.

2015-07-14 Thread Parth Brahmbhatt (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Parth Brahmbhatt updated KAFKA-2210: Attachment: KAFKA-2210_2015-07-14_10:02:19.patch > KafkaAuthorizer: Add all public entities,

[jira] [Commented] (KAFKA-2210) KafkaAuthorizer: Add all public entities, config changes and changes to KafkaAPI and kafkaServer to allow pluggable authorizer implementation.

2015-07-14 Thread Parth Brahmbhatt (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14626663#comment-14626663 ] Parth Brahmbhatt commented on KAFKA-2210: - Updated reviewboard https://reviews.apa

Re: [DISCUSS] Using GitHub Pull Requests for contributions and code review

2015-07-14 Thread Jun Rao
I made a couple of changes to the new Jenkins job. Could you try again? For b, if we can't easily change the behavior of pull request bot, we can also just flip back and forth btw "In Progress" and "Open". Thanks, Jun On Tue, Jul 14, 2015 at 2:13 AM, Ismael Juma wrote: > Hi Jun, > > On Tue, J

[jira] [Resolved] (KAFKA-1788) producer record can stay in RecordAccumulator forever if leader is no available

2015-07-14 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved KAFKA-1788. - Resolution: Fixed Will be covered by KAFKA-2120 > producer record can stay in RecordAccumulator f

[jira] [Commented] (KAFKA-1788) producer record can stay in RecordAccumulator forever if leader is no available

2015-07-14 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14626707#comment-14626707 ] Jiangjie Qin commented on KAFKA-1788: - [~parth.brahmbhatt], yes, we can resolve this t

Re: Review Request 34554: Patch for KAFKA-2205

2015-07-14 Thread Aditya Auradkar
> On July 9, 2015, 2:28 a.m., Jun Rao wrote: > > core/src/main/scala/kafka/server/ConfigHandler.scala, line 27 > > > > > > Do we need JavaConversions? If this is needed, it would be better to > > import it in the con

Re: Review Request 34554: Patch for KAFKA-2205

2015-07-14 Thread Aditya Auradkar
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34554/ --- (Updated July 14, 2015, 5:34 p.m.) Review request for kafka, Joel Koshy and Jun

[jira] [Commented] (KAFKA-2205) Generalize TopicConfigManager to handle multiple entity configs

2015-07-14 Thread Aditya A Auradkar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14626731#comment-14626731 ] Aditya A Auradkar commented on KAFKA-2205: -- Updated reviewboard https://reviews.a

[jira] [Updated] (KAFKA-2205) Generalize TopicConfigManager to handle multiple entity configs

2015-07-14 Thread Aditya A Auradkar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya A Auradkar updated KAFKA-2205: - Attachment: KAFKA-2205_2015-07-14_10:33:47.patch > Generalize TopicConfigManager to handle

[jira] [Commented] (KAFKA-2205) Generalize TopicConfigManager to handle multiple entity configs

2015-07-14 Thread Aditya A Auradkar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14626734#comment-14626734 ] Aditya A Auradkar commented on KAFKA-2205: -- Updated reviewboard https://reviews.a

Re: Review Request 34554: Patch for KAFKA-2205

2015-07-14 Thread Aditya Auradkar
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34554/ --- (Updated July 14, 2015, 5:36 p.m.) Review request for kafka, Joel Koshy and Jun

Re: Review Request 34554: Patch for KAFKA-2205

2015-07-14 Thread Aditya Auradkar
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34554/ --- (Updated July 14, 2015, 5:37 p.m.) Review request for kafka, Joel Koshy and Jun

[jira] [Updated] (KAFKA-2205) Generalize TopicConfigManager to handle multiple entity configs

2015-07-14 Thread Aditya A Auradkar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya A Auradkar updated KAFKA-2205: - Attachment: KAFKA-2205_2015-07-14_10:36:36.patch > Generalize TopicConfigManager to handle

Re: Review Request 34554: Patch for KAFKA-2205

2015-07-14 Thread Aditya Auradkar
> On July 9, 2015, 2:28 a.m., Jun Rao wrote: > > core/src/main/scala/kafka/admin/ConfigCommand.scala, line 123 > > > > > > Could we list the valid configs name for each entity-type as we did in > > TopicCommand? I'

Re: Review Request 36333: Patch for KAFKA-2123

2015-07-14 Thread Ewen Cheslack-Postava
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/36333/#review91646 --- clients/src/main/java/org/apache/kafka/clients/consumer/internals/F

[jira] [Comment Edited] (KAFKA-972) MetadataRequest returns stale list of brokers

2015-07-14 Thread Ashish K Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14626807#comment-14626807 ] Ashish K Singh edited comment on KAFKA-972 at 7/14/15 6:22 PM: --

[jira] [Commented] (KAFKA-972) MetadataRequest returns stale list of brokers

2015-07-14 Thread Ashish K Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14626807#comment-14626807 ] Ashish K Singh commented on KAFKA-972: -- Thanks Jun! > MetadataRequest returns stale l

[jira] [Commented] (KAFKA-2205) Generalize TopicConfigManager to handle multiple entity configs

2015-07-14 Thread Aditya Auradkar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14626814#comment-14626814 ] Aditya Auradkar commented on KAFKA-2205: [~junrao] Thanks! I addressed your remain

Re: Review Request 34492: Patch for KAFKA-2210

2015-07-14 Thread Edward Ribeiro
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34492/#review91638 --- core/src/main/scala/kafka/security/auth/Acl.scala (line 24)

[jira] [Assigned] (KAFKA-2260) Allow specifying expected offset on produce

2015-07-14 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava reassigned KAFKA-2260: Assignee: Ewen Cheslack-Postava > Allow specifying expected offset on produ

[jira] [Updated] (KAFKA-2032) ConsumerConfig doesn't validate partition.assignment.strategy values

2015-07-14 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2032: - Reviewer: Guozhang Wang > ConsumerConfig doesn't validate partition.assignment.strategy values > -

[jira] [Updated] (KAFKA-2329) Consumers balance fails when multiple consumers are started simultaneously.

2015-07-14 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2329: - Reviewer: Guozhang Wang > Consumers balance fails when multiple consumers are started simultaneous

[jira] [Updated] (KAFKA-2311) Consumer's ensureNotClosed method not thread safe

2015-07-14 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-2311: - Reviewer: Neha Narkhede > Consumer's ensureNotClosed method not thread safe >

[jira] [Updated] (KAFKA-2324) Update to Scala 2.11.7

2015-07-14 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-2324: - Reviewer: Neha Narkhede > Update to Scala 2.11.7 > -- > > Key:

[jira] [Updated] (KAFKA-2321) Introduce CONTRIBUTING.md

2015-07-14 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-2321: - Reviewer: Neha Narkhede > Introduce CONTRIBUTING.md > - > >

[jira] [Updated] (KAFKA-2323) Simplify ScalaTest dependency versions

2015-07-14 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-2323: - Reviewer: Jun Rao > Simplify ScalaTest dependency versions > -

Request to be added to the contributor list

2015-07-14 Thread Aravind Selvan
Hi, Please add me to the contributor list. Thanks. ~Aravind Selvan

[jira] [Commented] (KAFKA-1977) Make logEndOffset available in the Zookeeper consumer

2015-07-14 Thread James Cheng (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14626900#comment-14626900 ] James Cheng commented on KAFKA-1977: Will maxEndOffset will be exposed in the new Java

[jira] [Updated] (KAFKA-2300) Error in controller log when broker tries to rejoin cluster

2015-07-14 Thread Bob Cotton (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Cotton updated KAFKA-2300: -- Attachment: KAFKA-2300-controller-logs.tar.gz Controller logs > Error in controller log when broker tr

[jira] [Updated] (KAFKA-2055) ConsumerBounceTest.testSeekAndCommitWithBrokerFailures transient failure

2015-07-14 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2055: - Reviewer: Jason Gustafson > ConsumerBounceTest.testSeekAndCommitWithBrokerFailures transient failu

Re: Review Request 36333: Patch for KAFKA-2123

2015-07-14 Thread Jason Gustafson
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/36333/ --- (Updated July 14, 2015, 8:21 p.m.) Review request for kafka. Bugs: KAFKA-2123

[jira] [Updated] (KAFKA-2123) Make new consumer offset commit API use callback + future

2015-07-14 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-2123: --- Attachment: KAFKA-2123_2015-07-14_13:20:25.patch > Make new consumer offset commit API use cal

[jira] [Commented] (KAFKA-2123) Make new consumer offset commit API use callback + future

2015-07-14 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14626987#comment-14626987 ] Jason Gustafson commented on KAFKA-2123: Updated reviewboard https://reviews.apach

Re: Review Request 36333: Patch for KAFKA-2123

2015-07-14 Thread Jason Gustafson
> On July 14, 2015, 6 p.m., Ewen Cheslack-Postava wrote: > > clients/src/main/java/org/apache/kafka/clients/consumer/internals/Fetcher.java, > > line 274 > > > > > > Seems like we're not handling this anymore? sen

[jira] [Commented] (KAFKA-2260) Allow specifying expected offset on produce

2015-07-14 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14627018#comment-14627018 ] Ewen Cheslack-Postava commented on KAFKA-2260: -- Hey [~bkirwi], this looks int

[jira] [Created] (KAFKA-2334) Prevent HW from going back during leader failover

2015-07-14 Thread Guozhang Wang (JIRA)
Guozhang Wang created KAFKA-2334: Summary: Prevent HW from going back during leader failover Key: KAFKA-2334 URL: https://issues.apache.org/jira/browse/KAFKA-2334 Project: Kafka Issue Type:

[jira] [Commented] (KAFKA-2334) Prevent HW from going back during leader failover

2015-07-14 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14627040#comment-14627040 ] Guozhang Wang commented on KAFKA-2334: -- One possible solution to this issue is to let

[jira] [Commented] (KAFKA-2055) ConsumerBounceTest.testSeekAndCommitWithBrokerFailures transient failure

2015-07-14 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14627041#comment-14627041 ] Guozhang Wang commented on KAFKA-2055: -- [~lvfangmin] Thanks for the patch, I agree th

[VOTE] KIP-26 Add Copycat connector framework for data import/export

2015-07-14 Thread Ewen Cheslack-Postava
Hi all, Let's start a vote on KIP-26: Add Copycat connector framework for data import/export For reference, here's the wiki: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=58851767 And the mailing list thread (split across two months): http://mail-archives.apache.org/mod_mbox/ka

Re: [VOTE] KIP-26 Add Copycat connector framework for data import/export

2015-07-14 Thread Joe Stein
+1 (binding) ~ Joe Stein - - - - - - - - - - - - - - - - - - - [image: Logo-Black.jpg] http://www.elodina.net http://www.stealth.ly - - - - - - - - - - - - - - - - - - - On Tue, Jul 14, 2015 at 5:09 PM, Ewen Cheslack-Postava wrote: > Hi all, > > Let's start a vote on KIP-26: Add Copy

Re: Review Request 34492: Patch for KAFKA-2210

2015-07-14 Thread Parth Brahmbhatt
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34492/ --- (Updated July 14, 2015, 9:13 p.m.) Review request for kafka. Bugs: KAFKA-2210

[jira] [Updated] (KAFKA-2210) KafkaAuthorizer: Add all public entities, config changes and changes to KafkaAPI and kafkaServer to allow pluggable authorizer implementation.

2015-07-14 Thread Parth Brahmbhatt (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Parth Brahmbhatt updated KAFKA-2210: Attachment: KAFKA-2210_2015-07-14_14:13:19.patch > KafkaAuthorizer: Add all public entities,

[jira] [Commented] (KAFKA-2210) KafkaAuthorizer: Add all public entities, config changes and changes to KafkaAPI and kafkaServer to allow pluggable authorizer implementation.

2015-07-14 Thread Parth Brahmbhatt (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14627049#comment-14627049 ] Parth Brahmbhatt commented on KAFKA-2210: - Updated reviewboard https://reviews.apa

Re: [DISCUSS] Json libraries for Kafka

2015-07-14 Thread Ewen Cheslack-Postava
Currently the clients/server mismatch wouldn't be an issue since there are no client-side uses of JSON, right? That said, if Copycat ends up included in Kafka we'll need to provide at least one serializer which would be written in Java and I suspect some people would like JSON to be a candidate for

Re: [DISCUSS] Json libraries for Kafka

2015-07-14 Thread Joe Stein
Fasterxml/Jackson +1 to that. The scala databinds to case classes are gr8. ~ Joestein On Jul 14, 2015 5:42 PM, "Ewen Cheslack-Postava" wrote: > Currently the clients/server mismatch wouldn't be an issue since there are > no client-side uses of JSON, right? That said, if Copycat ends up included

Re: [VOTE] KIP-26 Add Copycat connector framework for data import/export

2015-07-14 Thread Jay Kreps
+1 Super excited! -Jay On Tue, Jul 14, 2015 at 2:09 PM, Ewen Cheslack-Postava wrote: > Hi all, > > Let's start a vote on KIP-26: Add Copycat connector framework for data > import/export > > For reference, here's the wiki: > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=58851

Re: [VOTE] KIP-26 Add Copycat connector framework for data import/export

2015-07-14 Thread Neha Narkhede
+1 (binding) Thanks Ewen for taking on something that the Kafka project has long waited for! On Tue, Jul 14, 2015 at 2:58 PM, Jay Kreps wrote: > +1 > > Super excited! > > -Jay > > On Tue, Jul 14, 2015 at 2:09 PM, Ewen Cheslack-Postava > wrote: > > > Hi all, > > > > Let's start a vote on KIP-26

Re: [DISCUSS] Json libraries for Kafka

2015-07-14 Thread Jay Kreps
Is this going to become a dependency for core and then transitively for the old clients? The current json library is definitely not great, but it does parse json and it's not used in any context where performance is a concern. Because the older clients aren't well modularized, adding core dependen

Re: [DISCUSS] Json libraries for Kafka

2015-07-14 Thread Joe Stein
Maybe after the existing scala clients are deprecated. ~ Joestein On Jul 14, 2015 6:04 PM, "Jay Kreps" wrote: > Is this going to become a dependency for core and then transitively for the > old clients? The current json library is definitely not great, but it does > parse json and it's not used

Re: Review Request 36333: Patch for KAFKA-2123

2015-07-14 Thread Guozhang Wang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/36333/#review91651 --- LGTM overall, just some minor comments below. clients/src/main/jav

[jira] [Commented] (KAFKA-1835) Kafka new producer needs options to make blocking behavior explicit

2015-07-14 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14627184#comment-14627184 ] Jiangjie Qin commented on KAFKA-1835: - We discussed this in today's KIP hangout. Just

[jira] [Commented] (KAFKA-2275) Add a ListTopics() API to the new consumer

2015-07-14 Thread Onur Karaman (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14627186#comment-14627186 ] Onur Karaman commented on KAFKA-2275: - Currently, the consumer has the following API:

[jira] [Commented] (KAFKA-1835) Kafka new producer needs options to make blocking behavior explicit

2015-07-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14627190#comment-14627190 ] Joel Koshy commented on KAFKA-1835: --- bq. Similar proposal applies to KAFKA-2275 https:/

[jira] [Updated] (KAFKA-1901) Move Kafka version to be generated in code by build (instead of in manifest)

2015-07-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-1901: -- Reviewer: Joel Koshy > Move Kafka version to be generated in code by build (instead of in manifest) > --

Re: Review Request 34492: Patch for KAFKA-2210

2015-07-14 Thread Edward Ribeiro
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34492/#review91671 --- core/src/main/scala/kafka/security/auth/Operation.scala (line 35) <

Re: Review Request 34492: Patch for KAFKA-2210

2015-07-14 Thread Edward Ribeiro
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34492/#review91672 --- core/src/main/scala/kafka/security/auth/Acl.scala (line 24)

Re: Review Request 34492: Patch for KAFKA-2210

2015-07-14 Thread Edward Ribeiro
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34492/#review91675 --- core/src/main/scala/kafka/security/auth/PermissionType.scala (line

Re: Review Request 34492: Patch for KAFKA-2210

2015-07-14 Thread Edward Ribeiro
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34492/#review91676 --- core/src/main/scala/kafka/security/auth/Resource.scala (line 25)

[CFP] Developer showcase at Strata NYC

2015-07-14 Thread Gwen Shapira
Hi Kafka fans, Strata NYC is looking for emerging, open source, big data projects to highlight in the developer showcase: http://strataconf.com/big-data-conference-ny-2015/public/cfp/409 Depending on how you look at it, it is either science faire for grownups or free conference booth for open sou

[jira] [Commented] (KAFKA-1835) Kafka new producer needs options to make blocking behavior explicit

2015-07-14 Thread Mayuresh Gharat (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14627263#comment-14627263 ] Mayuresh Gharat commented on KAFKA-1835: Either way user will have to block or han

Re: Review Request 34492: Patch for KAFKA-2210

2015-07-14 Thread Edward Ribeiro
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34492/#review91679 --- core/src/main/scala/kafka/security/auth/Acl.scala (line 110)

Re: [CFP] Developer showcase at Strata NYC

2015-07-14 Thread Neha Narkhede
All of the ones you've mentioned there sound great. I'd want to see copycat there. On Tue, Jul 14, 2015 at 4:22 PM, Gwen Shapira wrote: > Hi Kafka fans, > > Strata NYC is looking for emerging, open source, big data projects to > highlight in the developer showcase: > http://strataconf.com/big-da

[GitHub] kafka pull request: kafka-2320; Test PR builder

2015-07-14 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/75 kafka-2320; Test PR builder Just trying to trigger a build in Jenkins. You can merge this pull request into a Git repository by running: $ git pull https://github.com/ijuma/kafka kafka-2320 Altern

[GitHub] kafka pull request: KAFKA-1595; Remove deprecated and slower scala...

2015-07-14 Thread ijuma
Github user ijuma closed the pull request at: https://github.com/apache/kafka/pull/74 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled

[jira] [Commented] (KAFKA-1595) Remove deprecated and slower scala JSON parser from kafka.consumer.TopicCount

2015-07-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14627269#comment-14627269 ] ASF GitHub Bot commented on KAFKA-1595: --- Github user ijuma closed the pull request a

[GitHub] kafka pull request: kafka-2320; Test PR builder

2015-07-14 Thread ijuma
Github user ijuma closed the pull request at: https://github.com/apache/kafka/pull/75 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled

Re: Review Request 34492: Patch for KAFKA-2210

2015-07-14 Thread Edward Ribeiro
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34492/#review91680 --- core/src/test/scala/unit/kafka/security/auth/AclTest.scala (line 24

[GitHub] kafka pull request: kafka-2320; Test commit

2015-07-14 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/76 kafka-2320; Test commit Trying to test the CI build created via kafka-2320. You can merge this pull request into a Git repository by running: $ git pull https://github.com/ijuma/kafka kafka-2320 A

[jira] [Commented] (KAFKA-1835) Kafka new producer needs options to make blocking behavior explicit

2015-07-14 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14627279#comment-14627279 ] Guozhang Wang commented on KAFKA-1835: -- Thanks [~becket_qin] for the summary. Some fo

Re: Review Request 34492: Patch for KAFKA-2210

2015-07-14 Thread Edward Ribeiro
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34492/#review91682 --- core/src/main/scala/kafka/security/auth/ResourceType.scala (line 45

Re: [VOTE] KIP-26 Add Copycat connector framework for data import/export

2015-07-14 Thread Guozhang Wang
+1. Thanks Ewen!! On Tue, Jul 14, 2015 at 3:01 PM, Neha Narkhede wrote: > +1 (binding) > > Thanks Ewen for taking on something that the Kafka project has long waited > for! > > On Tue, Jul 14, 2015 at 2:58 PM, Jay Kreps wrote: > > > +1 > > > > Super excited! > > > > -Jay > > > > On Tue, Jul 14,

Re: [DISCUSS] Json libraries for Kafka

2015-07-14 Thread Ismael Juma
Ewen, On Tue, Jul 14, 2015 at 10:41 PM, Ewen Cheslack-Postava wrote: > Currently the clients/server mismatch wouldn't be an issue since there are > no client-side uses of JSON, right? That said, if Copycat ends up included > in Kafka we'll need to provide at least one serializer which would be >

  1   2   >