[jira] [Created] (KAFKA-1324) Debian packaging

2014-03-25 Thread David Stendardi (JIRA)
David Stendardi created KAFKA-1324: -- Summary: Debian packaging Key: KAFKA-1324 URL: https://issues.apache.org/jira/browse/KAFKA-1324 Project: Kafka Issue Type: Improvement Componen

[jira] [Updated] (KAFKA-1324) Debian packaging

2014-03-25 Thread David Stendardi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Stendardi updated KAFKA-1324: --- Description: The following patch add a task releaseDeb to the gradle build : ./gradlew relea

[jira] [Updated] (KAFKA-1324) Debian packaging

2014-03-25 Thread David Stendardi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Stendardi updated KAFKA-1324: --- Attachment: packaging.patch > Debian packaging > > > Key: KA

Re: Review Request 19611: Debian packaging

2014-03-25 Thread David Stendardi
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/19611/ --- (Updated March 25, 2014, 1:09 p.m.) Review request for kafka. Bugs: KAFKA-132

Re: Review Request 19611: Debian packaging

2014-03-25 Thread David Stendardi
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/19611/ --- (Updated March 25, 2014, 1:09 p.m.) Review request for kafka. Bugs: KAFKA-132

Review Request 19611: Debian packaging

2014-03-25 Thread David Stendardi
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/19611/ --- Review request for kafka. Bugs: KAFKA-1324 https://issues.apache.org/jira/b

[jira] [Commented] (KAFKA-1028) per topic configuration of preference for consistency over availability

2014-03-25 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13946673#comment-13946673 ] Andrew Olson commented on KAFKA-1028: - [~jkreps]/[~nehanarkhede] Would it be possible

[jira] [Commented] (KAFKA-1028) per topic configuration of preference for consistency over availability

2014-03-25 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13946678#comment-13946678 ] Jay Kreps commented on KAFKA-1028: -- Yes, we will do another release in the next few days

[jira] [Commented] (KAFKA-1028) per topic configuration of preference for consistency over availability

2014-03-25 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13946686#comment-13946686 ] Andrew Olson commented on KAFKA-1028: - Sounds good, thanks. > per topic configuration

[jira] [Commented] (KAFKA-1028) per topic configuration of preference for consistency over availability

2014-03-25 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13946696#comment-13946696 ] Jay Kreps commented on KAFKA-1028: -- [~noslowerdna] This should theoretically make Kafka c

Re: 0.8.1.1 - rough ETA?

2014-03-25 Thread Neha Narkhede
There are currently 3 outstanding issues, all are in progress. I believe we should be able to do a release by mid April or so. Thanks, Neha On Mon, Mar 2

[jira] [Created] (KAFKA-1325) Fix inconsistent per topic log configs

2014-03-25 Thread Neha Narkhede (JIRA)
Neha Narkhede created KAFKA-1325: Summary: Fix inconsistent per topic log configs Key: KAFKA-1325 URL: https://issues.apache.org/jira/browse/KAFKA-1325 Project: Kafka Issue Type: Improvement

Re: Review Request 18299: Fix KAFKA-1253

2014-03-25 Thread Jay Kreps
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/18299/#review38500 --- 1. We need to fix the RecordAccumulator request size issue--that lim

Review Request 19626: Patch for KAFKA-1323

2014-03-25 Thread Timothy Chen
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/19626/ --- Review request for kafka. Bugs: KAFKA-1323 https://issues.apache.org/jira/b

[jira] [Commented] (KAFKA-1323) log.dirs server property no longer supports relative directories

2014-03-25 Thread Timothy Chen (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13946963#comment-13946963 ] Timothy Chen commented on KAFKA-1323: - Created reviewboard https://reviews.apache.org/

[jira] [Updated] (KAFKA-1323) log.dirs server property no longer supports relative directories

2014-03-25 Thread Timothy Chen (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timothy Chen updated KAFKA-1323: Attachment: KAFKA-1323.patch > log.dirs server property no longer supports relative directories > -

[jira] [Created] (KAFKA-1326) New consumer checklist

2014-03-25 Thread Neha Narkhede (JIRA)
Neha Narkhede created KAFKA-1326: Summary: New consumer checklist Key: KAFKA-1326 URL: https://issues.apache.org/jira/browse/KAFKA-1326 Project: Kafka Issue Type: New Feature Compon

[jira] [Updated] (KAFKA-1326) New consumer checklist

2014-03-25 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1326: - Description: We will use this JIRA to track the list of issues to resolve to get a working new c

[jira] [Created] (KAFKA-1327) Add log cleaner metrics

2014-03-25 Thread Jay Kreps (JIRA)
Jay Kreps created KAFKA-1327: Summary: Add log cleaner metrics Key: KAFKA-1327 URL: https://issues.apache.org/jira/browse/KAFKA-1327 Project: Kafka Issue Type: Improvement Reporter: J

[jira] [Created] (KAFKA-1328) Add new consumer APIs and configs

2014-03-25 Thread Neha Narkhede (JIRA)
Neha Narkhede created KAFKA-1328: Summary: Add new consumer APIs and configs Key: KAFKA-1328 URL: https://issues.apache.org/jira/browse/KAFKA-1328 Project: Kafka Issue Type: Sub-task

[jira] [Updated] (KAFKA-1316) Refactor Sender

2014-03-25 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1316: - Parent Issue: KAFKA-1326 (was: KAFKA-1239) > Refactor Sender > --- > >

[jira] [Updated] (KAFKA-1329) Add metadata fetch and refresh functionality to the consumer

2014-03-25 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1329: - Issue Type: Sub-task (was: Task) Parent: KAFKA-1326 > Add metadata fetch and refresh fun

[jira] [Created] (KAFKA-1329) Add metadata fetch and refresh functionality to the consumer

2014-03-25 Thread Neha Narkhede (JIRA)
Neha Narkhede created KAFKA-1329: Summary: Add metadata fetch and refresh functionality to the consumer Key: KAFKA-1329 URL: https://issues.apache.org/jira/browse/KAFKA-1329 Project: Kafka I

[jira] [Created] (KAFKA-1330) Implement subscribe(TopicPartition...partitions) in the new consumer

2014-03-25 Thread Neha Narkhede (JIRA)
Neha Narkhede created KAFKA-1330: Summary: Implement subscribe(TopicPartition...partitions) in the new consumer Key: KAFKA-1330 URL: https://issues.apache.org/jira/browse/KAFKA-1330 Project: Kafka

[jira] [Created] (KAFKA-1331) Add ability to commit offsets to the new consumer

2014-03-25 Thread Neha Narkhede (JIRA)
Neha Narkhede created KAFKA-1331: Summary: Add ability to commit offsets to the new consumer Key: KAFKA-1331 URL: https://issues.apache.org/jira/browse/KAFKA-1331 Project: Kafka Issue Type: S

[jira] [Commented] (KAFKA-1329) Add metadata fetch and refresh functionality to the consumer

2014-03-25 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13947101#comment-13947101 ] Neha Narkhede commented on KAFKA-1329: -- Requires refactoring of the Sender > Add met

[jira] [Commented] (KAFKA-1331) Add ability to commit offsets to the new consumer

2014-03-25 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13947104#comment-13947104 ] Neha Narkhede commented on KAFKA-1331: -- is relevant only if the consumer can fetch so

[jira] [Created] (KAFKA-1332) Add functionality to the offsetsBeforeTime() API

2014-03-25 Thread Neha Narkhede (JIRA)
Neha Narkhede created KAFKA-1332: Summary: Add functionality to the offsetsBeforeTime() API Key: KAFKA-1332 URL: https://issues.apache.org/jira/browse/KAFKA-1332 Project: Kafka Issue Type: Su

[jira] [Commented] (KAFKA-1332) Add functionality to the offsetsBeforeTime() API

2014-03-25 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13947107#comment-13947107 ] Neha Narkhede commented on KAFKA-1332: -- Will be easier to add once the metadata reque

[jira] [Updated] (KAFKA-1329) Add metadata fetch and refresh functionality to the consumer

2014-03-25 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1329: - Assignee: (was: Neha Narkhede) > Add metadata fetch and refresh functionality to the consumer

[jira] [Commented] (KAFKA-1253) Implement compression in new producer

2014-03-25 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13947117#comment-13947117 ] Guozhang Wang commented on KAFKA-1253: -- The comparison of the latest patch with trunk

[jira] [Created] (KAFKA-1333) Add consumer co-ordinator module to the server

2014-03-25 Thread Neha Narkhede (JIRA)
Neha Narkhede created KAFKA-1333: Summary: Add consumer co-ordinator module to the server Key: KAFKA-1333 URL: https://issues.apache.org/jira/browse/KAFKA-1333 Project: Kafka Issue Type: Sub-

[jira] [Comment Edited] (KAFKA-1253) Implement compression in new producer

2014-03-25 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13947117#comment-13947117 ] Guozhang Wang edited comment on KAFKA-1253 at 3/25/14 8:45 PM: -

Re: Review Request 18299: Fix KAFKA-1253

2014-03-25 Thread Guozhang Wang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/18299/ --- (Updated March 25, 2014, 8:48 p.m.) Review request for kafka. Bugs: KAFKA-125

[jira] [Commented] (KAFKA-1334) Add failure detection capability to the new consumer

2014-03-25 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13947131#comment-13947131 ] Neha Narkhede commented on KAFKA-1334: -- Ability to do failure detection is blocked on

[jira] [Created] (KAFKA-1334) Add failure detection capability to the new consumer

2014-03-25 Thread Neha Narkhede (JIRA)
Neha Narkhede created KAFKA-1334: Summary: Add failure detection capability to the new consumer Key: KAFKA-1334 URL: https://issues.apache.org/jira/browse/KAFKA-1334 Project: Kafka Issue Type

[jira] [Commented] (KAFKA-1253) Implement compression in new producer

2014-03-25 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13947129#comment-13947129 ] Guozhang Wang commented on KAFKA-1253: -- Updated reviewboard https://reviews.apache.or

[jira] [Updated] (KAFKA-1253) Implement compression in new producer

2014-03-25 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1253: - Attachment: KAFKA-1253_2014-03-25_13:47:54.patch > Implement compression in new producer > --

Re: Review Request 18299: Fix KAFKA-1253

2014-03-25 Thread Guozhang Wang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/18299/ --- (Updated March 25, 2014, 8:51 p.m.) Review request for kafka. Bugs: KAFKA-125

[jira] [Created] (KAFKA-1335) Add rebalancing logic to the server and consumer

2014-03-25 Thread Neha Narkhede (JIRA)
Neha Narkhede created KAFKA-1335: Summary: Add rebalancing logic to the server and consumer Key: KAFKA-1335 URL: https://issues.apache.org/jira/browse/KAFKA-1335 Project: Kafka Issue Type: Su

[jira] [Commented] (KAFKA-1335) Add rebalancing logic to the server and consumer

2014-03-25 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13947135#comment-13947135 ] Neha Narkhede commented on KAFKA-1335: -- Blocked on failure detection > Add rebalanci

Re: Review Request 19577: Patch for KAFKA-1317

2014-03-25 Thread Timothy Chen
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/19577/ --- (Updated March 25, 2014, 10:20 p.m.) Review request for kafka. Bugs: KAFKA-13

[jira] [Updated] (KAFKA-1317) KafkaServer 0.8.1 not responding to .shutdown() cleanly, possibly related to TopicDeletionManager or MetricsMeter state

2014-03-25 Thread Timothy Chen (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timothy Chen updated KAFKA-1317: Attachment: KAFKA-1317_2014-03-25_15:20:14.patch > KafkaServer 0.8.1 not responding to .shutdown()

[jira] [Commented] (KAFKA-1317) KafkaServer 0.8.1 not responding to .shutdown() cleanly, possibly related to TopicDeletionManager or MetricsMeter state

2014-03-25 Thread Timothy Chen (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13947253#comment-13947253 ] Timothy Chen commented on KAFKA-1317: - Updated reviewboard https://reviews.apache.org/

[jira] [Commented] (KAFKA-1253) Implement compression in new producer

2014-03-25 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13947293#comment-13947293 ] Guozhang Wang commented on KAFKA-1253: -- Just realized the old producer performance ha

Re: Review Request 19626: Patch for KAFKA-1323

2014-03-25 Thread Guozhang Wang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/19626/#review38554 --- Ship it! Ship It! - Guozhang Wang On March 25, 2014, 6:54 p.m.,

[jira] [Created] (KAFKA-1336) Create partition compaction analyzer

2014-03-25 Thread Jay Kreps (JIRA)
Jay Kreps created KAFKA-1336: Summary: Create partition compaction analyzer Key: KAFKA-1336 URL: https://issues.apache.org/jira/browse/KAFKA-1336 Project: Kafka Issue Type: New Feature

Re: Review Request 18299: Fix KAFKA-1253

2014-03-25 Thread Jay Kreps
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/18299/#review38558 --- I'm +1 on this with the one minor cleanup. Jun, let me know if you h

Re: Review Request 19388: Patch for KAFKA-1251

2014-03-25 Thread Jay Kreps
> On March 23, 2014, 11:57 p.m., Jun Rao wrote: > > Thanks for the patch. Some comments. > > > > 1. For producer level stats (ie., not node or topic level), for jmx beans, > > the package name becomes kafka.producer (since the bean name is > > kafka.producer:type=client-id). For the topic and

Re: Review Request 19388: Patch for KAFKA-1251

2014-03-25 Thread Jay Kreps
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/19388/ --- (Updated March 26, 2014, 12:07 a.m.) Review request for kafka. Bugs: KAFKA-12

[jira] [Updated] (KAFKA-1251) Add metrics to the producer

2014-03-25 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-1251: - Attachment: KAFKA-1251_2014-03-25_17:07:39.patch > Add metrics to the producer >

[jira] [Commented] (KAFKA-1251) Add metrics to the producer

2014-03-25 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13947364#comment-13947364 ] Jay Kreps commented on KAFKA-1251: -- Updated reviewboard https://reviews.apache.org/r/1938

[jira] [Commented] (KAFKA-1251) Add metrics to the producer

2014-03-25 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13947368#comment-13947368 ] Jay Kreps commented on KAFKA-1251: -- I've addressed most of the comments. Jun, two commen

[jira] [Created] (KAFKA-1337) Rationalize new producer configs

2014-03-25 Thread Jay Kreps (JIRA)
Jay Kreps created KAFKA-1337: Summary: Rationalize new producer configs Key: KAFKA-1337 URL: https://issues.apache.org/jira/browse/KAFKA-1337 Project: Kafka Issue Type: Sub-task Repor

[jira] [Created] (KAFKA-1338) Update Kafka website to point to IDE setup

2014-03-25 Thread Timothy Chen (JIRA)
Timothy Chen created KAFKA-1338: --- Summary: Update Kafka website to point to IDE setup Key: KAFKA-1338 URL: https://issues.apache.org/jira/browse/KAFKA-1338 Project: Kafka Issue Type: Improvemen

Re: Review Request 19626: Patch for KAFKA-1323

2014-03-25 Thread Neha Narkhede
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/19626/#review38565 --- My guess is that we may have to review and make a similar change in

[jira] [Updated] (KAFKA-1338) Update Kafka website to point to IDE setup

2014-03-25 Thread Timothy Chen (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timothy Chen updated KAFKA-1338: Attachment: kafka_site_code_link.diff > Update Kafka website to point to IDE setup > --

Re: Review Request 19626: Patch for KAFKA-1323

2014-03-25 Thread Timothy Chen
> On March 26, 2014, 12:55 a.m., Neha Narkhede wrote: > > core/src/test/scala/unit/kafka/server/ReplicaManagerTest.scala, line 66 > > > > > > This method can be private. > > > > This method seems to indicate th

Re: Review Request 19626: Patch for KAFKA-1323

2014-03-25 Thread Timothy Chen
> On March 26, 2014, 12:55 a.m., Neha Narkhede wrote: > > My guess is that we may have to review and make a similar change in the > > following places - > > 1. LogManager.checkpointRecoveryPointOffsets() > > 2. LogManager.nextLogDir() > > > > The unit test in ReplicaManagerTest cover checkpoint

[jira] [Created] (KAFKA-1339) Time based offset retrieval seems broken

2014-03-25 Thread Frank Varnavas (JIRA)
Frank Varnavas created KAFKA-1339: - Summary: Time based offset retrieval seems broken Key: KAFKA-1339 URL: https://issues.apache.org/jira/browse/KAFKA-1339 Project: Kafka Issue Type: Bug

[jira] [Resolved] (KAFKA-1338) Update Kafka website to point to IDE setup

2014-03-25 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps resolved KAFKA-1338. -- Resolution: Fixed Committed. > Update Kafka website to point to IDE setup > --

Re: Review Request 19577: Patch for KAFKA-1317

2014-03-25 Thread Neha Narkhede
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/19577/#review38576 --- core/src/main/scala/kafka/controller/TopicDeletionManager.scala