Re: [DISCUSS] KIP-113: Support replicas movement between log directories

2017-06-06 Thread Dong Lin
Hey Sriram, Thanks for taking time to review the KIP. Please see below my answers to your questions: >1. Could you pick a hardware/Kafka configuration and go over what is the >average disk/partition repair/restore time that we are targeting for a >typical JBOD setup? We currently don't have this

Re: Changing JIRA notifications to remove Single Email Address (dev@kafka.apache.org)

2017-06-06 Thread Jeff Widman
What about also adding "Issue Resolved" to the events that hit dev? While I don't generally care about updates on issue progress, I do want to know when issues are resolved in case undocumented behavior that I may have accidentally been relying on may have changed. With or without this suggested

Build failed in Jenkins: kafka-0.11.0-jdk7 #110

2017-06-06 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: remove ignore annotations in Streams EOS integration test -- [...truncated 953.78 KB...] kafka.controller.ControllerIntegrationTest > testP

Jenkins build is back to normal : kafka-trunk-jdk8 #1668

2017-06-06 Thread Apache Jenkins Server
See

[jira] [Assigned] (KAFKA-1044) change log4j to slf4j

2017-06-06 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava reassigned KAFKA-1044: Assignee: Viktor Somogyi (was: Ewen Cheslack-Postava) > change log4j to sl

[jira] [Assigned] (KAFKA-1044) change log4j to slf4j

2017-06-06 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava reassigned KAFKA-1044: Assignee: Ewen Cheslack-Postava > change log4j to slf4j >

[jira] [Commented] (KAFKA-1044) change log4j to slf4j

2017-06-06 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16040126#comment-16040126 ] Ewen Cheslack-Postava commented on KAFKA-1044: -- [~viktorsomogyi] I've added y

[GitHub] kafka pull request #3252: KAFKA-5385: ProducerBatch expiry should go through...

2017-06-06 Thread apurvam
GitHub user apurvam opened a pull request: https://github.com/apache/kafka/pull/3252 KAFKA-5385: ProducerBatch expiry should go through Sender.failBatch Before this patch, we would call `producerBatch.done` directly from the accumulator when expiring batches. This meant that we woul

[jira] [Commented] (KAFKA-5385) Transactional Producer allows batches to expire and commits transactions regardless

2017-06-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16040179#comment-16040179 ] ASF GitHub Bot commented on KAFKA-5385: --- GitHub user apurvam opened a pull request:

[jira] [Updated] (KAFKA-5385) Transactional Producer allows batches to expire and commits transactions regardless

2017-06-06 Thread Apurva Mehta (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apurva Mehta updated KAFKA-5385: Status: Patch Available (was: In Progress) > Transactional Producer allows batches to expire and co

[jira] [Created] (KAFKA-5395) Distributed Herder Deadlocks on Shutdown

2017-06-06 Thread Michael Jaschob (JIRA)
Michael Jaschob created KAFKA-5395: -- Summary: Distributed Herder Deadlocks on Shutdown Key: KAFKA-5395 URL: https://issues.apache.org/jira/browse/KAFKA-5395 Project: Kafka Issue Type: Bug

[jira] [Commented] (KAFKA-5395) Distributed Herder Deadlocks on Shutdown

2017-06-06 Thread Michael Jaschob (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16040257#comment-16040257 ] Michael Jaschob commented on KAFKA-5395: Probably didn't mean to synchronize the p

Re: [DISCUSS] KIP-113: Support replicas movement between log directories

2017-06-06 Thread Jay Kreps
I think Ram's point is that in place failure is pretty complicated, and this is meant to be a cost saving feature, we should construct an argument for it grounded in data. Assume an annual failure rate of 1% (reasonable, but data is available online), and assume it takes 3 days to get the drive re

[jira] [Created] (KAFKA-5396) Consumer reading from beginning of log can read the same message multiple times.

2017-06-06 Thread Apurva Mehta (JIRA)
Apurva Mehta created KAFKA-5396: --- Summary: Consumer reading from beginning of log can read the same message multiple times. Key: KAFKA-5396 URL: https://issues.apache.org/jira/browse/KAFKA-5396 Project:

[jira] [Updated] (KAFKA-5396) Consumer reading from beginning of log can read the same message multiple times.

2017-06-06 Thread Apurva Mehta (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apurva Mehta updated KAFKA-5396: Attachment: KAFKA-5396.tar.gz > Consumer reading from beginning of log can read the same message mul

[jira] [Commented] (KAFKA-5396) Consumer reading from beginning of log can read the same message multiple times.

2017-06-06 Thread Apurva Mehta (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16040297#comment-16040297 ] Apurva Mehta commented on KAFKA-5396: - The logs for the entire run (including debug br

[jira] [Commented] (KAFKA-5396) Consumer reading from beginning of log can read the same message multiple times.

2017-06-06 Thread Apurva Mehta (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16040301#comment-16040301 ] Apurva Mehta commented on KAFKA-5396: - Also, there are no aborted transactions in the

[jira] [Commented] (KAFKA-5396) Consumer reading from beginning of log can read the same message multiple times.

2017-06-06 Thread Apurva Mehta (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16040309#comment-16040309 ] Apurva Mehta commented on KAFKA-5396: - Running the following {noformat} amehta-macboo

[jira] [Commented] (KAFKA-5396) Consumer reading from beginning of log can read the same message multiple times.

2017-06-06 Thread Apurva Mehta (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16040316#comment-16040316 ] Apurva Mehta commented on KAFKA-5396: - 38012 out of 38500 duplicates were from this on

[jira] [Updated] (KAFKA-5396) Consumer reading uninterrupted from beginning of log can read the same message multiple times.

2017-06-06 Thread Apurva Mehta (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apurva Mehta updated KAFKA-5396: Summary: Consumer reading uninterrupted from beginning of log can read the same message multiple tim

<    1   2