[jira] [Commented] (KAFKA-2066) Replace FetchRequest / FetchResponse with their org.apache.kafka.common.requests equivalents

2016-01-21 Thread David Jacot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15112045#comment-15112045 ] David Jacot commented on KAFKA-2066: [~becket_qin], indeed replacing MessageSet with R

[jira] [Commented] (KAFKA-3088) 0.9.0.0 broker crash on receipt of produce request with empty client ID

2016-01-21 Thread Dave Peterson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15112001#comment-15112001 ] Dave Peterson commented on KAFKA-3088: -- I wasn't planning on submitting a patch. I w

[jira] [Commented] (KAFKA-725) Broker Exception: Attempt to read with a maximum offset less than start offset

2016-01-21 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15111990#comment-15111990 ] Jiangjie Qin commented on KAFKA-725: [~gwenshap] [~mauzhang] Not sure if it is related

Re: Pluggable Log Compaction Policy

2016-01-21 Thread Becket Qin
I agree with Guozhang that this seems better to be a separate tool. Also, I am wondering if KIP-32 can be used here. We can have a timestamp based compaction policy if needed, for example, keep any message whose timestamp is greater than (MaxTimestamp - 24 hours). Jiangjie (Becket) Qin On Thu,

[jira] [Commented] (KAFKA-3126) Weird behavior in kafkaController on Controlled shutdowns. The leaderAndIsr in zookeeper is not updated during controlled shutdown.

2016-01-21 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15111935#comment-15111935 ] Jiangjie Qin commented on KAFKA-3126: - [~mgharat] I thought you original confusion was

[jira] [Commented] (KAFKA-3088) 0.9.0.0 broker crash on receipt of produce request with empty client ID

2016-01-21 Thread Aditya Auradkar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15111924#comment-15111924 ] Aditya Auradkar commented on KAFKA-3088: I personally prefer preserving the old be

Re: KIP for extension of SASL to include additional mechanisms

2016-01-21 Thread Jun Rao
Rajini, Thanks for your interest. I just gave you the permission to Kafka wiki. Jun On Thu, Jan 21, 2016 at 5:51 AM, Rajini Sivaram < rajinisiva...@googlemail.com> wrote: > Can I have access to write up a KIP for extending the SASL implementation > in Kafka to include more mechanisms? We have t

[jira] [Commented] (KAFKA-3006) Make collection default container type for sequences in the consumer API

2016-01-21 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15111845#comment-15111845 ] Gwen Shapira commented on KAFKA-3006: - I think a short & sweet KIP, just to summarize

Build failed in Jenkins: kafka-trunk-jdk8 #304

2016-01-21 Thread Apache Jenkins Server
See Changes: [cshapi] MINOR: Remove remnants of hadoop clients from kafka-run-class.sh -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H11 (Ubun

Build failed in Jenkins: kafka-trunk-jdk7 #978

2016-01-21 Thread Apache Jenkins Server
See Changes: [cshapi] MINOR: Remove remnants of hadoop clients from kafka-run-class.sh -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H11 (Ubun

Re: Kafka cluster performance degradation (Kafka 0.8.2.1)

2016-01-21 Thread Gwen Shapira
We fixed two serious Snappy bugs for 0.8.2.2, so you may want to check that. On Thu, Jan 21, 2016 at 8:16 AM, Cliff Rhyne wrote: > Hi Leo, > > I'm not sure if this is the issue you're encountering, but this is what we > found when we went from 0.8.1.1 to 0.8.2.1. > > Snappy compression didn't wo

Build failed in Jenkins: kafka_0.9.0_jdk7 #92

2016-01-21 Thread Apache Jenkins Server
See Changes: [cshapi] MINOR: Remove remnants of hadoop clients from kafka-run-class.sh -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubuntu3 (U

[GitHub] kafka pull request: MINOR: Remove remnants of hadoop clients from ...

2016-01-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/799 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

Build failed in Jenkins: kafka-trunk-jdk7 #977

2016-01-21 Thread Apache Jenkins Server
See Changes: [me] MINOR: Vagrant AWS overrideable EC2 instance name prefix -- [...truncated 1390 lines...] kafka.log.LogCleanerIntegrationTest > cleanerTest[3] PASSED kafka.log.LogTest > testPa

[jira] [Commented] (KAFKA-3088) 0.9.0.0 broker crash on receipt of produce request with empty client ID

2016-01-21 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15111751#comment-15111751 ] Gwen Shapira commented on KAFKA-3088: - Agree with Dana that there is no requirement th

[jira] [Commented] (KAFKA-725) Broker Exception: Attempt to read with a maximum offset less than start offset

2016-01-21 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15111747#comment-15111747 ] Gwen Shapira commented on KAFKA-725: KAFKA-2477 has somewhat similar symptoms. Perhaps

Build failed in Jenkins: kafka-trunk-jdk8 #303

2016-01-21 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-2146: Fix adding partition did not find the correct startIndex. [me] MINOR: Vagrant AWS overrideable EC2 instance name prefix -- [...truncated 81 lines...] /x1/jenk

[GitHub] kafka pull request: MINOR: vagrant aws overrideable ec2 instance n...

2016-01-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/801 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Commented] (KAFKA-3129) Potential Console Producer/Consumer Issue

2016-01-21 Thread Vahid Hashemian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15111713#comment-15111713 ] Vahid Hashemian commented on KAFKA-3129: I'm afraid, it did not make much of a dif

Build failed in Jenkins: kafka-trunk-jdk7 #976

2016-01-21 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-2146: Fix adding partition did not find the correct startIndex. -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H1

Re: Pluggable Log Compaction Policy

2016-01-21 Thread Guozhang Wang
Bill, For your case since once the log is cleaned up to the given offset watermark (or threshold, whatever the name is), future cleaning with the same watermark will effectively be a no-op, so I feel your scenario will be better fit as a one-time admin tool to cleanup the logs rather than customiz

Re: newcomer

2016-01-21 Thread Guozhang Wang
Hi Gregory, Thanks! You can first take a look at the list of "newbie" tickets, it is mentioned here: http://kafka.apache.org/contributing.html (in the "Finding A Project To Work On" section). For some that is already assigned to someone, if it has been inactive for a while you can ask the assigne

[jira] [Commented] (KAFKA-725) Broker Exception: Attempt to read with a maximum offset less than start offset

2016-01-21 Thread Manu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15111680#comment-15111680 ] Manu Zhang commented on KAFKA-725: -- Is anyone still looking at this issue ? We have run in

[jira] [Commented] (KAFKA-3088) 0.9.0.0 broker crash on receipt of produce request with empty client ID

2016-01-21 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15111679#comment-15111679 ] Joel Koshy commented on KAFKA-3088: --- [~aauradkar] can chime in since this is related to

[jira] [Commented] (KAFKA-2758) Improve Offset Commit Behavior

2016-01-21 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15111675#comment-15111675 ] Joel Koshy commented on KAFKA-2758: --- Unless I'm misunderstanding I don't think we should

[jira] [Commented] (KAFKA-3129) Potential Console Producer/Consumer Issue

2016-01-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15111671#comment-15111671 ] Ismael Juma commented on KAFKA-3129: Oh, I thought you were using the new consumer, bu

[jira] [Commented] (KAFKA-2146) adding partition did not find the correct startIndex

2016-01-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15111670#comment-15111670 ] ASF GitHub Bot commented on KAFKA-2146: --- Github user asfgit closed the pull request

[GitHub] kafka pull request: KAFKA-2146. adding partition did not find the ...

2016-01-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/329 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Resolved] (KAFKA-2146) adding partition did not find the correct startIndex

2016-01-21 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-2146. -- Resolution: Fixed Fix Version/s: 0.9.1.0 Issue resolved by pull request 329 [https://gith

[GitHub] kafka pull request: MINOR: vagrant aws overrideable ec2 instance n...

2016-01-21 Thread granders
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/801 MINOR: vagrant aws overrideable ec2 instance name prefix @ewencp This small change allows users to use Vagrantfile.local to specify a custom prefix for names of ec2 instances brought up with va

[jira] [Commented] (KAFKA-3129) Potential Console Producer/Consumer Issue

2016-01-21 Thread Vahid Hashemian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15111663#comment-15111663 ] Vahid Hashemian commented on KAFKA-3129: I did run those test cases with the kafka

[GitHub] kafka pull request: MINOR: Rename KafkaStreaming to Streams

2016-01-21 Thread guozhangwang
GitHub user guozhangwang opened a pull request: https://github.com/apache/kafka/pull/800 MINOR: Rename KafkaStreaming to Streams You can merge this pull request into a Git repository by running: $ git pull https://github.com/guozhangwang/kafka KRename Alternatively you can re

[jira] [Updated] (KAFKA-3121) KStream DSL API Improvement

2016-01-21 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3121: - Description: >From some collected feedbacks, here is a list of potential improvements that >we wa

[jira] [Comment Edited] (KAFKA-3088) 0.9.0.0 broker crash on receipt of produce request with empty client ID

2016-01-21 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15111627#comment-15111627 ] Guozhang Wang edited comment on KAFKA-3088 at 1/21/16 11:49 PM:

[jira] [Commented] (KAFKA-3088) 0.9.0.0 broker crash on receipt of produce request with empty client ID

2016-01-21 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15111627#comment-15111627 ] Guozhang Wang commented on KAFKA-3088: -- Yeah, I just meant that the server today rely

[jira] [Commented] (KAFKA-3126) Weird behavior in kafkaController on Controlled shutdowns. The leaderAndIsr in zookeeper is not updated during controlled shutdown.

2016-01-21 Thread Mayuresh Gharat (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15111611#comment-15111611 ] Mayuresh Gharat commented on KAFKA-3126: Can you explain the steps in further deta

[jira] [Comment Edited] (KAFKA-3126) Weird behavior in kafkaController on Controlled shutdowns. The leaderAndIsr in zookeeper is not updated during controlled shutdown.

2016-01-21 Thread Mayuresh Gharat (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15111611#comment-15111611 ] Mayuresh Gharat edited comment on KAFKA-3126 at 1/21/16 11:36 PM: --

[jira] [Commented] (KAFKA-3129) Potential Console Producer/Consumer Issue

2016-01-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15111608#comment-15111608 ] Ismael Juma commented on KAFKA-3129: Can you please test the 0.9.0 branch? This sounds

[jira] [Updated] (KAFKA-3129) Potential Console Producer/Consumer Issue

2016-01-21 Thread Vahid Hashemian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vahid Hashemian updated KAFKA-3129: --- Description: I have been running a simple test case in which I have a text file {{messages.tx

[jira] [Created] (KAFKA-3129) Potential Console Producer/Consumer Issue

2016-01-21 Thread Vahid Hashemian (JIRA)
Vahid Hashemian created KAFKA-3129: -- Summary: Potential Console Producer/Consumer Issue Key: KAFKA-3129 URL: https://issues.apache.org/jira/browse/KAFKA-3129 Project: Kafka Issue Type: Bug

[jira] [Updated] (KAFKA-2875) Class path contains multiple SLF4J bindings warnings when using scripts under bin

2016-01-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-2875: --- Fix Version/s: (was: 0.9.0.1) 0.9.1.0 > Class path contains multiple SLF4J bind

[jira] [Updated] (KAFKA-2901) Extend ListGroups and DescribeGroup APIs to cover offsets

2016-01-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-2901: --- Fix Version/s: (was: 0.9.0.1) 0.9.1.0 > Extend ListGroups and DescribeGroup API

[jira] [Updated] (KAFKA-2806) Allow Kafka System Tests under different JDK versions

2016-01-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-2806: --- Fix Version/s: (was: 0.9.0.1) 0.9.1.0 > Allow Kafka System Tests under differen

[jira] [Updated] (KAFKA-2796) add support for reassignment partition to specified logdir

2016-01-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-2796: --- Fix Version/s: (was: 0.9.0.1) 0.9.1.0 > add support for reassignment partition

[jira] [Commented] (KAFKA-2758) Improve Offset Commit Behavior

2016-01-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15111578#comment-15111578 ] Ismael Juma commented on KAFKA-2758: [~dajac], please go ahead since this issue is not

[jira] [Updated] (KAFKA-2757) Consolidate BrokerEndPoint and EndPoint

2016-01-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-2757: --- Fix Version/s: (was: 0.9.0.1) 0.9.1.0 > Consolidate BrokerEndPoint and EndPoint

[jira] [Commented] (KAFKA-2985) Consumer group stuck in rebalancing state

2016-01-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15111575#comment-15111575 ] Ismael Juma commented on KAFKA-2985: Can we close this then? > Consumer group stuck i

[jira] [Updated] (KAFKA-3128) Add metrics for ZooKeeper events

2016-01-21 Thread Flavio Junqueira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flavio Junqueira updated KAFKA-3128: Summary: Add metrics for ZooKeeper events (was: Add metric for ZooKeeper events) > Add met

[jira] [Created] (KAFKA-3128) Add metric for ZooKeeper events

2016-01-21 Thread Flavio Junqueira (JIRA)
Flavio Junqueira created KAFKA-3128: --- Summary: Add metric for ZooKeeper events Key: KAFKA-3128 URL: https://issues.apache.org/jira/browse/KAFKA-3128 Project: Kafka Issue Type: Improvement

Build failed in Jenkins: kafka-trunk-jdk7 #975

2016-01-21 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: Upgrade note on compacted topics behaviour on receiving message -- [...truncated 7083 lines...] org.apache.kafka.connect.runtime.rest.resources.ConnectorsResourceT

[jira] [Commented] (KAFKA-3126) Weird behavior in kafkaController on Controlled shutdowns. The leaderAndIsr in zookeeper is not updated during controlled shutdown.

2016-01-21 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15111364#comment-15111364 ] Jiangjie Qin commented on KAFKA-3126: - It is because of step 4, where any ISR change i

[jira] [Commented] (KAFKA-3126) Weird behavior in kafkaController on Controlled shutdowns. The leaderAndIsr in zookeeper is not updated during controlled shutdown.

2016-01-21 Thread Mayuresh Gharat (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15111353#comment-15111353 ] Mayuresh Gharat commented on KAFKA-3126: I don't see why Controller B will see A i

Build failed in Jenkins: kafka-trunk-jdk7 #974

2016-01-21 Thread Apache Jenkins Server
See Changes: [cshapi] KAFKA-3080: Fix ConsoleConsumerTest by checking version when service is -- [...truncated 4730 lines...] org.apache.kafka.connect.runtime.WorkerTest > testStopInvalidConnecto

Build failed in Jenkins: kafka_0.9.0_jdk7 #91

2016-01-21 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: Upgrade note on compacted topics behaviour on receiving message -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on u

[GitHub] kafka pull request: MINOR: Remove remnants of hadoop clients from ...

2016-01-21 Thread granthenke
GitHub user granthenke opened a pull request: https://github.com/apache/kafka/pull/799 MINOR: Remove remnants of hadoop clients from kafka-run-class.sh You can merge this pull request into a Git repository by running: $ git pull https://github.com/granthenke/kafka hadoop-contr

Build failed in Jenkins: kafka-trunk-jdk8 #302

2016-01-21 Thread Apache Jenkins Server
See Changes: [cshapi] KAFKA-3080: Fix ConsoleConsumerTest by checking version when service is [wangguoz] MINOR: Upgrade note on compacted topics behaviour on receiving message -- [...truncated

[GitHub] kafka pull request: MINOR: Upgrade note on compacted topics behavi...

2016-01-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/798 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Resolved] (KAFKA-3080) ConsoleConsumerTest.test_version system test fails consistently

2016-01-21 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira resolved KAFKA-3080. - Resolution: Fixed Fix Version/s: 0.9.1.0 Issue resolved by pull request 770 [https://github

[jira] [Commented] (KAFKA-3080) ConsoleConsumerTest.test_version system test fails consistently

2016-01-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1531#comment-1531 ] ASF GitHub Bot commented on KAFKA-3080: --- Github user asfgit closed the pull request

[GitHub] kafka pull request: KAFKA-3080: Fix ConsoleConsumerTest by checkin...

2016-01-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/770 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Commented] (KAFKA-2066) Replace FetchRequest / FetchResponse with their org.apache.kafka.common.requests equivalents

2016-01-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1507#comment-1507 ] Ismael Juma commented on KAFKA-2066: [~becket_qin], that makes sense to me (although I

[jira] [Commented] (KAFKA-3126) Weird behavior in kafkaController on Controlled shutdowns. The leaderAndIsr in zookeeper is not updated during controlled shutdown.

2016-01-21 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15111099#comment-15111099 ] Jiangjie Qin commented on KAFKA-3126: - Currently the controlled shutdown and the state

[jira] [Assigned] (KAFKA-3126) Weird behavior in kafkaController on Controlled shutdowns. The leaderAndIsr in zookeeper is not updated during controlled shutdown.

2016-01-21 Thread Mayuresh Gharat (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayuresh Gharat reassigned KAFKA-3126: -- Assignee: Mayuresh Gharat > Weird behavior in kafkaController on Controlled shutdowns.

[jira] [Commented] (KAFKA-2066) Replace FetchRequest / FetchResponse with their org.apache.kafka.common.requests equivalents

2016-01-21 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15111034#comment-15111034 ] Jiangjie Qin commented on KAFKA-2066: - [~dajac] [~ijuma] I was thinking about this whe

Re: [VOTE] KIP-32 Add CreateTime and LogAppendTime to Kafka message.

2016-01-21 Thread Jiangjie Qin
I updated KIP-32 wiki with Anna's suggestion on ProduceResponse format change. Because it looks everyone also has a +1 on ProduceResponse format change, I take this update passed as well. KIP-32 passed with +6(binding). Thanks a lot for everyone's participation and all the comments. BTW, the pa

[jira] [Commented] (KAFKA-3088) 0.9.0.0 broker crash on receipt of produce request with empty client ID

2016-01-21 Thread Dana Powers (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15111020#comment-15111020 ] Dana Powers commented on KAFKA-3088: But client ids are not globally unique, even in t

[jira] [Commented] (KAFKA-3088) 0.9.0.0 broker crash on receipt of produce request with empty client ID

2016-01-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15110959#comment-15110959 ] Ismael Juma commented on KAFKA-3088: [~guozhang], you are talking about the Java clien

[jira] [Commented] (KAFKA-3088) 0.9.0.0 broker crash on receipt of produce request with empty client ID

2016-01-21 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15110952#comment-15110952 ] Guozhang Wang commented on KAFKA-3088: -- Right now the client-id is guaranteed not-nul

[jira] [Commented] (KAFKA-3088) 0.9.0.0 broker crash on receipt of produce request with empty client ID

2016-01-21 Thread Dave Peterson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15110864#comment-15110864 ] Dave Peterson commented on KAFKA-3088: -- Ok, gotcha ;-) Option 1 still seems preferabl

[jira] [Commented] (KAFKA-3088) 0.9.0.0 broker crash on receipt of produce request with empty client ID

2016-01-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15110850#comment-15110850 ] Ismael Juma commented on KAFKA-3088: [~dspeterson], I used the word "throw" a bit loos

[jira] [Comment Edited] (KAFKA-3088) 0.9.0.0 broker crash on receipt of produce request with empty client ID

2016-01-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15110812#comment-15110812 ] Ismael Juma edited comment on KAFKA-3088 at 1/21/16 4:20 PM: -

Re: Kafka cluster performance degradation (Kafka 0.8.2.1)

2016-01-21 Thread Cliff Rhyne
Hi Leo, I'm not sure if this is the issue you're encountering, but this is what we found when we went from 0.8.1.1 to 0.8.2.1. Snappy compression didn't work as expected. Something in the library broke compressing bundles of messages and each message was compressed individually (which for us cau

[jira] [Commented] (KAFKA-3088) 0.9.0.0 broker crash on receipt of produce request with empty client ID

2016-01-21 Thread Dave Peterson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15110837#comment-15110837 ] Dave Peterson commented on KAFKA-3088: -- Without being familiar with the code and how

newcomer

2016-01-21 Thread gregory grey
Hello guys, I'd like to become a contributor to this project. Could someone give me a little hint on what is a good thing to start working on? Thanks, Gregory -- http://ror6ax.github.io/

[jira] [Commented] (KAFKA-3088) 0.9.0.0 broker crash on receipt of produce request with empty client ID

2016-01-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15110812#comment-15110812 ] Ismael Juma commented on KAFKA-3088: Since clientId is used in quotas, logging and a f

[jira] [Commented] (KAFKA-3083) a soft failure in controller may leave a topic partition in an inconsistent state

2016-01-21 Thread Flavio Junqueira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15110748#comment-15110748 ] Flavio Junqueira commented on KAFKA-3083: - Sure, we need to transform all operatio

[jira] [Commented] (KAFKA-3083) a soft failure in controller may leave a topic partition in an inconsistent state

2016-01-21 Thread Flavio Junqueira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15110680#comment-15110680 ] Flavio Junqueira commented on KAFKA-3083: - bq. 1) We need to use a multi-op that c

[jira] [Commented] (KAFKA-3124) Update protocol wiki page to reflect latest request/response formats

2016-01-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15110632#comment-15110632 ] Ismael Juma commented on KAFKA-3124: Even better would be to move the protocol to the

[GitHub] kafka pull request: MINOR: Upgrade note on compacted topics behavi...

2016-01-21 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/798 MINOR: Upgrade note on compacted topics behaviour on receiving message without key You can merge this pull request into a Git repository by running: $ git pull https://github.com/ijuma/kafka up

[jira] [Commented] (KAFKA-3006) Make collection default container type for sequences in the consumer API

2016-01-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15110611#comment-15110611 ] Ismael Juma commented on KAFKA-3006: Yes, it looks like things got stalled as there wa

KIP for extension of SASL to include additional mechanisms

2016-01-21 Thread Rajini Sivaram
Can I have access to write up a KIP for extending the SASL implementation in Kafka to include more mechanisms? We have the implementation for SASL/PLAIN, but I think it would make sense for the KIP to cover new mechanisms in general. Thank you... Regards, Rajini

[jira] [Commented] (KAFKA-3006) Make collection default container type for sequences in the consumer API

2016-01-21 Thread Pierre-Yves Ritschard (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15110597#comment-15110597 ] Pierre-Yves Ritschard commented on KAFKA-3006: -- [~granthenke] It's ready to b

Kafka cluster performance degradation (Kafka 0.8.2.1)

2016-01-21 Thread Clelio De Souza
Hi all, We are using Kafka in production and we have been facing some performance degradation of the cluster, apparently after the cluster is a bit "old". We have our production cluster which is up and running since 31/12/2015 and performance tests on our application measuring a full round trip