[jira] [Commented] (KAFKA-1145) Broker fail to sync after restart

2013-11-26 Thread David Lao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13833513#comment-13833513 ] David Lao commented on KAFKA-1145: -- Haven't tried this on the trunk. It takes a while to

[jira] [Commented] (KAFKA-1150) Fetch on a replicated topic does not return as soon as possible

2013-11-26 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13833474#comment-13833474 ] Jun Rao commented on KAFKA-1150: Right, the first problem (second fetch is needed) is due

[jira] [Updated] (KAFKA-1151) The Hadoop consumer API doc is not referencing the contrib consumer

2013-11-26 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1151: - Fix Version/s: 0.8.1 > The Hadoop consumer API doc is not referencing the contrib consumer >

[jira] [Created] (KAFKA-1151) The Hadoop consumer API doc is not referencing the contrib consumer

2013-11-26 Thread Joe Stein (JIRA)
Joe Stein created KAFKA-1151: Summary: The Hadoop consumer API doc is not referencing the contrib consumer Key: KAFKA-1151 URL: https://issues.apache.org/jira/browse/KAFKA-1151 Project: Kafka Is

[jira] [Commented] (KAFKA-1150) Fetch on a replicated topic does not return as soon as possible

2013-11-26 Thread Andrey Balmin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13833401#comment-13833401 ] Andrey Balmin commented on KAFKA-1150: -- Notice that there are two problems here. Firs

[jira] [Commented] (KAFKA-1145) Broker fail to sync after restart

2013-11-26 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13833374#comment-13833374 ] Jun Rao commented on KAFKA-1145: Thanks for reporting this. Does the same issue exist in t

[jira] [Commented] (KAFKA-1140) Move the decoding logic from ConsumerIterator.makeNext to next

2013-11-26 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13833373#comment-13833373 ] Guozhang Wang commented on KAFKA-1140: -- Updated reviewboard https://reviews.apache.or

[jira] [Updated] (KAFKA-1140) Move the decoding logic from ConsumerIterator.makeNext to next

2013-11-26 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1140: - Attachment: KAFKA-1140_2013-11-26_18:29:53.patch > Move the decoding logic from ConsumerIterator.

Re: Review Request 15805: KAFKA-1140.v4

2013-11-26 Thread Guozhang Wang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/15805/ --- (Updated Nov. 27, 2013, 2:29 a.m.) Review request for kafka. Summary (updated

[jira] [Commented] (KAFKA-1150) Fetch on a replicated topic does not return as soon as possible

2013-11-26 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13833366#comment-13833366 ] Joel Koshy commented on KAFKA-1150: --- Thank you for reporting this. We currently unblock

[jira] [Commented] (KAFKA-1144) commitOffsets can be passed the offsets to commit

2013-11-26 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13833359#comment-13833359 ] Joel Koshy commented on KAFKA-1144: --- I agree that this is a useful feature. It may be wo

Re: Review Request 15805: KAFKA-1140.v3: addressed more of Jun's comments, changed the API of MessageAndMetadata

2013-11-26 Thread Jun Rao
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/15805/#review29465 --- core/src/main/scala/kafka/consumer/ConsumerIterator.scala

[jira] [Commented] (KAFKA-1140) Move the decoding logic from ConsumerIterator.makeNext to next

2013-11-26 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13833172#comment-13833172 ] Guozhang Wang commented on KAFKA-1140: -- Updated reviewboard https://reviews.apache.or

[jira] [Updated] (KAFKA-1140) Move the decoding logic from ConsumerIterator.makeNext to next

2013-11-26 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1140: - Attachment: KAFKA-1140_2013-11-26_14:41:00.patch > Move the decoding logic from ConsumerIterator.

Re: Review Request 15805: KAFKA-1140.v3: addressed more of Jun's comments, changed the API of MessageAndMetadata

2013-11-26 Thread Guozhang Wang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/15805/ --- (Updated Nov. 26, 2013, 10:41 p.m.) Review request for kafka. Summary (update

[VOTE] Apache Kafka Release 0.8.0 - Candidate 5

2013-11-26 Thread Joe Stein
This is the fifth candidate for release of Apache Kafka 0.8.0. This release candidate is now built from JDK 6 as RC4 was built with JDK 7. Release Notes for the 0.8.0 release http://people.apache.org/~joestein/kafka-0.8.0-candidate5/RELEASE_NOTES.html *** Please download, test and vote by Monda

Re: Review Request 15805: KAFKA-1140.v2: addressed Jun's comments

2013-11-26 Thread Guozhang Wang
> On Nov. 26, 2013, 2:45 a.m., Jun Rao wrote: > > core/src/test/scala/unit/kafka/consumer/ConsumerIteratorTest.scala, lines > > 102-103 > > > > > > We probably should just use ConsumerConfig.ConsumerTimeoutMs here, to

Re: [VOTE] Apache Kafka Release 0.8.0 - Candidate 4

2013-11-26 Thread Joe Stein
yes, that is my bad {again}, forgot to use my other vm to build instead of my usual one ... will update the release docs too VOTE canceled, rebuilding for RC5 hopefully out later tonight /*** Joe Stein Founder, Principal Consultant Big Data Open Source

Re: [VOTE] Apache Kafka Release 0.8.0 - Candidate 4

2013-11-26 Thread Joel Koshy
I'm getting this with console consumer in the binary package which seems to be because it was built under Java 7. Can we stick to 6? Exception in thread "main" java.lang.UnsupportedClassVersionError: kafka/javaapi/consumer/ConsumerConnector : Unsupported major.minor version 51.0 at java.l

[jira] [Commented] (KAFKA-1144) commitOffsets can be passed the offsets to commit

2013-11-26 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13833068#comment-13833068 ] Imran Rashid commented on KAFKA-1144: - Hi Jun, yes, that will do the trick. I think

[jira] [Commented] (KAFKA-1146) toString() on KafkaStream gets stuck indefinitely

2013-11-26 Thread Arup Malakar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13833003#comment-13833003 ] Arup Malakar commented on KAFKA-1146: - [~jjkoshy] Yes overriding would definitely be b

[jira] [Created] (KAFKA-1150) Fetch on a replicated topic does not return as soon as possible

2013-11-26 Thread Andrey Balmin (JIRA)
Andrey Balmin created KAFKA-1150: Summary: Fetch on a replicated topic does not return as soon as possible Key: KAFKA-1150 URL: https://issues.apache.org/jira/browse/KAFKA-1150 Project: Kafka

[jira] [Comment Edited] (KAFKA-903) [0.8.0 - windows] FATAL - [highwatermark-checkpoint-thread1] (Logging.scala:109) - Attempt to swap the new high watermark file with the old one failed

2013-11-26 Thread Sean Glover (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13832845#comment-13832845 ] Sean Glover edited comment on KAFKA-903 at 11/26/13 7:58 PM: - I

[jira] [Updated] (KAFKA-1146) toString() on KafkaStream gets stuck indefinitely

2013-11-26 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-1146: -- Fix Version/s: 0.8.1 Yes this is due to KafkaStream being a scala iterable - toString on an iterable (p

[jira] [Created] (KAFKA-1149) Please delete old releases from mirroring system

2013-11-26 Thread Sebb (JIRA)
Sebb created KAFKA-1149: --- Summary: Please delete old releases from mirroring system Key: KAFKA-1149 URL: https://issues.apache.org/jira/browse/KAFKA-1149 Project: Kafka Issue Type: Bug Environ

[jira] [Created] (KAFKA-1148) Delayed fetch/producer requests should be satisfied on a leader change

2013-11-26 Thread Joel Koshy (JIRA)
Joel Koshy created KAFKA-1148: - Summary: Delayed fetch/producer requests should be satisfied on a leader change Key: KAFKA-1148 URL: https://issues.apache.org/jira/browse/KAFKA-1148 Project: Kafka

[jira] [Created] (KAFKA-1147) Consumer socket timeout should be greater than fetch max wait

2013-11-26 Thread Joel Koshy (JIRA)
Joel Koshy created KAFKA-1147: - Summary: Consumer socket timeout should be greater than fetch max wait Key: KAFKA-1147 URL: https://issues.apache.org/jira/browse/KAFKA-1147 Project: Kafka Issue

[jira] [Comment Edited] (KAFKA-903) [0.8.0 - windows] FATAL - [highwatermark-checkpoint-thread1] (Logging.scala:109) - Attempt to swap the new high watermark file with the old one failed

2013-11-26 Thread Sean Glover (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13832845#comment-13832845 ] Sean Glover edited comment on KAFKA-903 at 11/26/13 7:15 PM: - I

[jira] [Created] (KAFKA-1146) toString() on KafkaStream gets stuck indefinitely

2013-11-26 Thread Arup Malakar (JIRA)
Arup Malakar created KAFKA-1146: --- Summary: toString() on KafkaStream gets stuck indefinitely Key: KAFKA-1146 URL: https://issues.apache.org/jira/browse/KAFKA-1146 Project: Kafka Issue Type: Bug

[jira] [Updated] (KAFKA-1145) Broker fail to sync after restart

2013-11-26 Thread David Lao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Lao updated KAFKA-1145: - Attachment: broker-3.txt broker-0.txt > Broker fail to sync after restart > -

[jira] [Created] (KAFKA-1145) Broker fail to sync after restart

2013-11-26 Thread David Lao (JIRA)
David Lao created KAFKA-1145: Summary: Broker fail to sync after restart Key: KAFKA-1145 URL: https://issues.apache.org/jira/browse/KAFKA-1145 Project: Kafka Issue Type: Bug Components:

[jira] [Comment Edited] (KAFKA-903) [0.8.0 - windows] FATAL - [highwatermark-checkpoint-thread1] (Logging.scala:109) - Attempt to swap the new high watermark file with the old one failed

2013-11-26 Thread Sean Glover (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13832845#comment-13832845 ] Sean Glover edited comment on KAFKA-903 at 11/26/13 6:53 PM: - I

[jira] [Commented] (KAFKA-903) [0.8.0 - windows] FATAL - [highwatermark-checkpoint-thread1] (Logging.scala:109) - Attempt to swap the new high watermark file with the old one failed

2013-11-26 Thread Sean Glover (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13832845#comment-13832845 ] Sean Glover commented on KAFKA-903: --- I still see this exception on Windows 7 Pro SP1 with

RE: Review Request 15805: KAFKA-1140.v2: addressed Jun's comments

2013-11-26 Thread Guozhang Wang
Does this enforce the key/value decoder to be passed also into MessageAndMetadata? Guozhang From: Jun Rao [nore...@reviews.apache.org] on behalf of Jun Rao [jun...@gmail.com] Sent: Tuesday, November 26, 2013 9:30 AM To: kafka; Jun Rao; Guozhang Wang Subject: Re:

Re: Review Request 15805: KAFKA-1140.v2: addressed Jun's comments

2013-11-26 Thread Jun Rao
Yes, we will have to pass in the decoders to MessageAndMetadata. Thanks, Jun On Tue, Nov 26, 2013 at 10:09 AM, Guozhang Wang wrote: > Does this enforce the key/value decoder to be passed also into > MessageAndMetadata? > > Guozhang > -- > *From:* Jun Rao [nore...

[jira] [Resolved] (KAFKA-1141) make changes to downloads for the archive old releases to new old_releases folder

2013-11-26 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein resolved KAFKA-1141. -- Resolution: Fixed all set, downloads page is live with the updates Sent email to Henk that he can clob

Re: Review Request 15805: KAFKA-1140.v2: addressed Jun's comments

2013-11-26 Thread Jun Rao
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/15805/#review29438 --- Thinking about this a bit more. It seems that a better approach is t

[jira] [Commented] (KAFKA-1144) commitOffsets can be passed the offsets to commit

2013-11-26 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13832775#comment-13832775 ] Jun Rao commented on KAFKA-1144: KAFKA-1000 will allow the consumer to explicitly commit o

[jira] [Work started] (KAFKA-1141) make changes to downloads for the archive old releases to new old_releases folder

2013-11-26 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-1141 started by Joe Stein. > make changes to downloads for the archive old releases to new old_releases > folder >

[jira] [Updated] (KAFKA-1141) make changes to downloads for the archive old releases to new old_releases folder

2013-11-26 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1141: - Affects Version/s: 0.7.3 0.7.2 0.8 0.