[jira] [Updated] (KAFKA-3608) ZooKeeper structures are not correctly described in the document

2016-05-09 Thread Vahid Hashemian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vahid Hashemian updated KAFKA-3608: --- Resolution: Fixed Status: Resolved (was: Patch Available) > ZooKeeper structures are

[DISCUSS] KIP-59 - Proposal for a kafka broker command - kafka-brokers.sh

2016-05-09 Thread Jayesh Thakrar
Hi All, This is to start off a discussion on the above KIP at  https://cwiki.apache.org/confluence/display/KAFKA/KIP-59%3A+Proposal+for+a+kafka+broker+command The proposal is to fill the void of a command line tool/utility that can provide information on the cluster and brokers in a Kafka clust

[jira] [Commented] (KAFKA-3583) Docs on pause/resume/restart APIs.

2016-05-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277560#comment-15277560 ] ASF GitHub Bot commented on KAFKA-3583: --- GitHub user hachikuji opened a pull request

[GitHub] kafka pull request: KAFKA-3583: Add documentation for Connect stat...

2016-05-09 Thread hachikuji
GitHub user hachikuji opened a pull request: https://github.com/apache/kafka/pull/1358 KAFKA-3583: Add documentation for Connect status control APIs You can merge this pull request into a Git repository by running: $ git pull https://github.com/hachikuji/kafka KAFKA-3583 Alte

Build failed in Jenkins: kafka-trunk-jdk7 #1275

2016-05-09 Thread Apache Jenkins Server
See Changes: [cshapi] KAFKA-3608; Fix ZooKeeper structures and output format in documentation [me] KAFKA-3684: SinkConnectorConfig does not return topics in config -- [...truncated 6447 lines..

Build failed in Jenkins: kafka-trunk-jdk8 #610

2016-05-09 Thread Apache Jenkins Server
See Changes: [cshapi] MINOR: Update protocol doc link in Introduction. [me] KAFKA-3676: system tests for connector pause/resume [cshapi] KAFKA-3608; Fix ZooKeeper structures and output format in documentation [me] KAFKA-3684: SinkCon

Build failed in Jenkins: kafka-0.10.0-jdk7 #73

2016-05-09 Thread Apache Jenkins Server
See Changes: [cshapi] MINOR: Update protocol doc link in Introduction. [me] KAFKA-3676: system tests for connector pause/resume [cshapi] KAFKA-3608; Fix ZooKeeper structures and output format in documentation [me] KAFKA-3684: SinkCon

[jira] [Commented] (KAFKA-3585) Shutdown slow when there is only one broker which is controller

2016-05-09 Thread Taiyuan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277488#comment-15277488 ] Taiyuan Zhang commented on KAFKA-3585: -- No I just Ctrl+C in the console. kafka-server

[VOTE] 0.10.0.0 RC4

2016-05-09 Thread Gwen Shapira
Hello Kafka users, developers and client-developers, This is the first candidate for release of Apache Kafka 0.10.0.0. This is a major release that includes: (1) New message format including timestamps (2) client interceptor API (3) Kafka Streams. Since this is a major release, we will give people

Build failed in Jenkins: kafka-trunk-jdk7 #1274

2016-05-09 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-3421; Follow up to fix name of SourceTask method and add [ismael] KAFKA-3634; Upgrade tests for SASL authentication [cshapi] MINOR: Update protocol doc link in Introduction. [me] KAFKA-3676: system tests

Build failed in Jenkins: kafka-trunk-jdk8 #609

2016-05-09 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Add toString implementations to Subscription and Assignment [ismael] MINOR: Remove copyDependantTestLibs from jar dependencies [ismael] KAFKA-3421; Follow up to fix name of SourceTask method and add [isma

[jira] [Created] (KAFKA-3685) Auto-generate ZooKeeper data structure wiki

2016-05-09 Thread Vahid Hashemian (JIRA)
Vahid Hashemian created KAFKA-3685: -- Summary: Auto-generate ZooKeeper data structure wiki Key: KAFKA-3685 URL: https://issues.apache.org/jira/browse/KAFKA-3685 Project: Kafka Issue Type: Imp

[jira] [Commented] (KAFKA-3684) Not all SinkConnectorConfig configs are returned

2016-05-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277416#comment-15277416 ] ASF GitHub Bot commented on KAFKA-3684: --- Github user asfgit closed the pull request

[jira] [Updated] (KAFKA-3684) Not all SinkConnectorConfig configs are returned

2016-05-09 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3684: - Resolution: Fixed Fix Version/s: 0.10.1.0 Status: Resolved (was:

[GitHub] kafka pull request: KAFKA-3684: SinkConnectorConfig does not retur...

2016-05-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1356 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-2479) Add CopycatExceptions to indicate transient and permanent errors in a connector/task

2016-05-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277404#comment-15277404 ] ASF GitHub Bot commented on KAFKA-2479: --- Github user Ishiihara closed the pull reque

Re: [VOTE] KIP-47 - Add timestamp-based log deletion policy

2016-05-09 Thread Guozhang Wang
Jay, Bill: I'm thinking of one general use case of using timestamp rather than offset for log deletion, which is that for expiration handling in data replication, when the source data store decides to expire some data records based on their timestamps, today we need to configure the corresponding

[jira] [Commented] (KAFKA-3608) ZooKeeper structures are not correctly described in the document

2016-05-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277405#comment-15277405 ] ASF GitHub Bot commented on KAFKA-3608: --- Github user asfgit closed the pull request

[GitHub] kafka pull request: KAFKA-3608: Fix ZooKeeper structures and outpu...

2016-05-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1257 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] kafka pull request: KAFKA-2479: Transient exception

2016-05-09 Thread Ishiihara
Github user Ishiihara closed the pull request at: https://github.com/apache/kafka/pull/279 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is en

Build failed in Jenkins: kafka-0.10.0-jdk7 #72

2016-05-09 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Add toString implementations to Subscription and Assignment [ismael] KAFKA-3421; Follow up to fix name of SourceTask method and add [ismael] KAFKA-3634; Upgrade tests for SASL authentication -

Re: Java Consumer Issue

2016-05-09 Thread Vahid S Hashemian
Thanks Ismael. I had the same suspicion and had run the build (./gradlew jar) as you suggested. But unfortunately, that didn't resolve the issue. Regards, --Vahid Hashemian From: Ismael Juma To: dev@kafka.apache.org Date: 05/09/2016 05:05 PM Subject:Re: Java Consumer Issue

Re: Java Consumer Issue

2016-05-09 Thread Ismael Juma
Vahid, it looks like the broker is old and it doesn't include the metadata request/response changes. This could happen if you haven't done ./gradlew jar in a while. Ismael On Mon, May 9, 2016 at 11:32 PM, Vahid S Hashemian < vahidhashem...@us.ibm.com> wrote: > Hi Ismael, > > According to the ser

[jira] [Commented] (KAFKA-3676) Add system tests for connector pause/resume

2016-05-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277363#comment-15277363 ] ASF GitHub Bot commented on KAFKA-3676: --- Github user asfgit closed the pull request

[GitHub] kafka pull request: KAFKA-3676: system tests for connector pause/r...

2016-05-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1345 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Resolved] (KAFKA-3676) Add system tests for connector pause/resume

2016-05-09 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-3676. -- Resolution: Fixed Fix Version/s: 0.10.0.0 0.10.1.0 Iss

[jira] [Work started] (KAFKA-3684) Not all SinkConnectorConfig configs are returned

2016-05-09 Thread Liquan Pei (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-3684 started by Liquan Pei. - > Not all SinkConnectorConfig configs are returned > -

[jira] [Updated] (KAFKA-3684) Not all SinkConnectorConfig configs are returned

2016-05-09 Thread Liquan Pei (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liquan Pei updated KAFKA-3684: -- Status: Patch Available (was: In Progress) > Not all SinkConnectorConfig configs are returned > --

[GitHub] kafka pull request: MINOR: Update protocol doc link in Introductio...

2016-05-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1211 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Build failed in Jenkins: kafka-trunk-jdk7 #1273

2016-05-09 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Add toString implementations to Subscription and Assignment [ismael] MINOR: Remove copyDependantTestLibs from jar dependencies -- [...truncated 6446 lines...] org.

[GitHub] kafka pull request: MINOR: Use `Record` instead of `ByteBufferMess...

2016-05-09 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/1357 MINOR: Use `Record` instead of `ByteBufferMessageSet` in `ProduceRequestTest` We want to phase out `ByteBufferMessageSet` eventually, so new code should favour `Record` where possible. Also

[jira] [Created] (KAFKA-3684) Not all SinkConnectorConfig configs are returned

2016-05-09 Thread Liquan Pei (JIRA)
Liquan Pei created KAFKA-3684: - Summary: Not all SinkConnectorConfig configs are returned Key: KAFKA-3684 URL: https://issues.apache.org/jira/browse/KAFKA-3684 Project: Kafka Issue Type: Bug

[GitHub] kafka pull request: MINOR: Should return ConfigDef in SourceConnec...

2016-05-09 Thread Ishiihara
GitHub user Ishiihara opened a pull request: https://github.com/apache/kafka/pull/1356 MINOR: Should return ConfigDef in SourceConnectorConfig and SinkConnectorConfig You can merge this pull request into a Git repository by running: $ git pull https://github.com/Ishiihara/kaf

Re: reading the consumer offsets topic

2016-05-09 Thread tao xiao
You need to enable internal topic in the consumer.properties exclude.internal.topics=false On Mon, 9 May 2016 at 12:42 Cliff Rhyne wrote: > Thanks Todd and Tao. I've tried those tricks but no luck. > > Just to add more info, this is the __consumer_offsets specific config that > is shown by the

[jira] [Work started] (KAFKA-3583) Docs on pause/resume/restart APIs.

2016-05-09 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-3583 started by Jason Gustafson. -- > Docs on pause/resume/restart APIs. > -- > >

[jira] [Updated] (KAFKA-3634) Add ducktape tests for upgrade with SASL

2016-05-09 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3634: --- Fix Version/s: (was: 0.10.0.0) 0.10.0.1. > Add ducktape tests for upgrade with

[jira] [Updated] (KAFKA-3634) Add ducktape tests for upgrade with SASL

2016-05-09 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3634: --- Fix Version/s: (was: 0.10.0.1.) 0.10.0.1 > Add ducktape tests for upgrade with

[jira] [Updated] (KAFKA-3634) Add ducktape tests for upgrade with SASL

2016-05-09 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3634: --- Resolution: Fixed Fix Version/s: (was: 0.10.1.0) 0.10.0.0 Stat

[jira] [Commented] (KAFKA-3634) Add ducktape tests for upgrade with SASL

2016-05-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277230#comment-15277230 ] ASF GitHub Bot commented on KAFKA-3634: --- Github user asfgit closed the pull request

[GitHub] kafka pull request: KAFKA-3634: Upgrade tests for SASL authenticat...

2016-05-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1290 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-3421) Update docs with new connector features

2016-05-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277223#comment-15277223 ] ASF GitHub Bot commented on KAFKA-3421: --- Github user asfgit closed the pull request

[GitHub] kafka pull request: KAFKA-3421: Follow up to fix name of SourceTas...

2016-05-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1355 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] kafka pull request: MINOR: Remove copyDependantTestLibs from jar d...

2016-05-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/430 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] kafka pull request: MINOR: add toString implementations to Subscri...

2016-05-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1354 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Re: Java Consumer Issue

2016-05-09 Thread Vahid S Hashemian
Hi Ismael, According to the server logs INFO Kafka version : 0.10.0.0-SNAPSHOT (org.apache.kafka.common.utils.AppInfoParser) I am running my server in a command line session, and my consumer in my IDE (eclipse). That's when I get the exception. However, I just noticed when I also run the server

Re: Java Consumer Issue

2016-05-09 Thread Ismael Juma
Hi Vahid, What is the broker version? Ismael On Mon, May 9, 2016 at 11:09 PM, Vahid S Hashemian < vahidhashem...@us.ibm.com> wrote: > I am trying to create a very simple (new) consumer in Java using the > trunk: > > Properties props = new Properties(); > props.pu

Java Consumer Issue

2016-05-09 Thread Vahid S Hashemian
I am trying to create a very simple (new) consumer in Java using the trunk: Properties props = new Properties(); props.put("bootstrap.servers", "localhost:9092"); props.put("group.id", "group1"); props.put("key.deserializer", "org.a

[jira] [Commented] (KAFKA-3565) Producer's throughput lower with compressed data after KIP-31/32

2016-05-09 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277142#comment-15277142 ] Guozhang Wang commented on KAFKA-3565: -- You are referring to {{new Compressor(buffer,

[jira] [Commented] (KAFKA-3565) Producer's throughput lower with compressed data after KIP-31/32

2016-05-09 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277072#comment-15277072 ] Jiangjie Qin commented on KAFKA-3565: - [~guozhang] It seems that we are using the defa

[jira] [Commented] (KAFKA-3565) Producer's throughput lower with compressed data after KIP-31/32

2016-05-09 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277023#comment-15277023 ] Guozhang Wang commented on KAFKA-3565: -- Actually, in the producer's GZIP and SNAPPY c

Re: [VOTE] KIP-45: Standardize KafkaConsumer API to use Collection

2016-05-09 Thread Mark Grover
I am ok with #3 as well. On Mon, May 9, 2016 at 12:12 PM, Ismael Juma wrote: > +1 for option 3 (unfortunately all options have pros and cons, but I think > option 3 does a better job with regards to trade-offs). > > Ismael > > On Mon, May 9, 2016 at 7:56 PM, Gwen Shapira wrote: > > > We need to

Re: KIP-57: Interoperable LZ4 Framing

2016-05-09 Thread Gwen Shapira
Agree. On Fri, May 6, 2016 at 3:14 PM, Ismael Juma wrote: > On Fri, May 6, 2016 at 11:07 PM, Dana Powers wrote: > >> Updated: >> https://cwiki.apache.org/confluence/display/KAFKA/KIP-57+-+Interoperable+LZ4+Framing >> >> Should I restart the vote? >> > > I think the update is small enough that we

Build failed in Jenkins: kafka-trunk-jdk7 #1272

2016-05-09 Thread Apache Jenkins Server
See Changes: [ismael] HOTFIX: KAFKA-3160 follow-up, catch decompression errors in constructor -- [...truncated 6449 lines...] org.apache.kafka.connect.storage.MemoryStatusBackingStoreTest > de

Re: reading the consumer offsets topic

2016-05-09 Thread Cliff Rhyne
Thanks Todd and Tao. I've tried those tricks but no luck. Just to add more info, this is the __consumer_offsets specific config that is shown by the topic describe command: Configs:segment.bytes=104857600,cleanup.policy=compact,compression.type=uncompressed On Mon, May 9, 2016 at 1:16 PM, tao x

[jira] [Commented] (KAFKA-3421) Update docs with new connector features

2016-05-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15276852#comment-15276852 ] ASF GitHub Bot commented on KAFKA-3421: --- GitHub user ewencp opened a pull request:

[GitHub] kafka pull request: KAFKA-3421: Follow up to fix name of SourceTas...

2016-05-09 Thread ewencp
GitHub user ewencp opened a pull request: https://github.com/apache/kafka/pull/1355 KAFKA-3421: Follow up to fix name of SourceTask method and add documentation of connector status REST API. You can merge this pull request into a Git repository by running: $ git pull https://

Re: [VOTE] KIP-45: Standardize KafkaConsumer API to use Collection

2016-05-09 Thread Ismael Juma
+1 for option 3 (unfortunately all options have pros and cons, but I think option 3 does a better job with regards to trade-offs). Ismael On Mon, May 9, 2016 at 7:56 PM, Gwen Shapira wrote: > We need to conclude this discussion in order to unblock the release. > > If I understand correctly, we

Re: [VOTE] KIP-45: Standardize KafkaConsumer API to use Collection

2016-05-09 Thread Gwen Shapira
We need to conclude this discussion in order to unblock the release. If I understand correctly, we have 3 options on the table: 1. Add the missing APIs as "deprecated". Pros: Conceptually, the right way to get rid of an API without breaking Storm Cons: Users of the new API will get ugly warnings,

[GitHub] kafka pull request: MINOR: add toString implements to Subscription...

2016-05-09 Thread hachikuji
GitHub user hachikuji opened a pull request: https://github.com/apache/kafka/pull/1354 MINOR: add toString implements to Subscription and Assignment You can merge this pull request into a Git repository by running: $ git pull https://github.com/hachikuji/kafka minor-add-missi

Re: [VOTE] 0.10.0.0 RC3

2016-05-09 Thread Gwen Shapira
W00t! Thank you! On Fri, May 6, 2016 at 11:13 AM, Mark Grover wrote: > Thanks, Gwen. > > I was testing RC2 with Spark Streaming and found an issue that has a minor > fix. I think this issue exists with RC3 as well: > https://issues.apache.org/jira/browse/KAFKA-3669 > > On Thu, May 5, 2016 at 1:46

Build failed in Jenkins: kafka-trunk-jdk8 #608

2016-05-09 Thread Apache Jenkins Server
See Changes: [ismael] HOTFIX: KAFKA-3160 follow-up, catch decompression errors in constructor -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ub

Build failed in Jenkins: kafka-trunk-jdk8 #607

2016-05-09 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-3658: Validate retention period be longer than window size [ismael] KAFKA-3587; LogCleaner fails due to incorrect offset map computation -- [...truncated 2236 lines

Re: reading the consumer offsets topic

2016-05-09 Thread tao xiao
You can try this bin/kafka-console-consumer.sh --consumer.config config/consumer.properties --from-beginning --topic __consumer_offsets --zookeeper localhost:2181 —formatter "kafka.coordinator.GroupMetadataManager\$OffsetsMessageFormatter" On Mon, 9 May 2016 at 09:40 Todd Palino wrote: > The Gr

[jira] [Updated] (KAFKA-3665) Default ssl.endpoint.identification.algorithm should be https

2016-05-09 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3665: --- Fix Version/s: (was: 0.10.0.0) 0.10.0.1 > Default ssl.endpoint.identification.a

[jira] [Updated] (KAFKA-3660) Log exception message in ControllerBrokerRequestBatch

2016-05-09 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3660: --- Fix Version/s: (was: 0.10.0.0) 0.10.0.1 > Log exception message in ControllerBr

[jira] [Updated] (KAFKA-3565) Producer's throughput lower with compressed data after KIP-31/32

2016-05-09 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3565: --- Fix Version/s: (was: 0.10.0.0) > Producer's throughput lower with compressed data after KIP-31/32

[jira] [Commented] (KAFKA-3160) Kafka LZ4 framing code miscalculates header checksum

2016-05-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15276710#comment-15276710 ] ASF GitHub Bot commented on KAFKA-3160: --- Github user asfgit closed the pull request

[GitHub] kafka pull request: Fixup KAFKA-3160: catch decompression errors i...

2016-05-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1344 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Build failed in Jenkins: kafka-trunk-jdk8 #606

2016-05-09 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-3681; Connect doc formatting -- [...truncated 6460 lines...] org.apache.kafka.connect.runtime.distributed.DistributedHerderTest > testInconsistentConfigs PASSED org

[jira] [Commented] (KAFKA-3664) When subscription set changes on new consumer, the partitions may be removed without offset being committed.

2016-05-09 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15276663#comment-15276663 ] Jiangjie Qin commented on KAFKA-3664: - [~hachikuji] That sounds reasonable. That is a

Build failed in Jenkins: kafka-0.10.0-jdk7 #70

2016-05-09 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-3658: Validate retention period be longer than window size [ismael] KAFKA-3587; LogCleaner fails due to incorrect offset map computation -- Started by an SCM change

Build failed in Jenkins: kafka-0.10.0-jdk7 #69

2016-05-09 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-3681; Connect doc formatting -- [...truncated 6435 lines...] org.apache.kafka.connect.storage.MemoryStatusBackingStoreTest > deleteTaskStatus PASSED org.apache.kafk

[jira] [Work started] (KAFKA-3683) Add file descriptor recommendation to ops guide

2016-05-09 Thread Dustin Cote (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-3683 started by Dustin Cote. -- > Add file descriptor recommendation to ops guide > -

[jira] [Commented] (KAFKA-3683) Add file descriptor recommendation to ops guide

2016-05-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15276644#comment-15276644 ] ASF GitHub Bot commented on KAFKA-3683: --- GitHub user cotedm opened a pull request:

[jira] [Commented] (KAFKA-3664) When subscription set changes on new consumer, the partitions may be removed without offset being committed.

2016-05-09 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15276643#comment-15276643 ] Jason Gustafson commented on KAFKA-3664: I'm not sure either, but I think the curr

[GitHub] kafka pull request: KAFKA-3683: Add file descriptor recommendation...

2016-05-09 Thread cotedm
GitHub user cotedm opened a pull request: https://github.com/apache/kafka/pull/1353 KAFKA-3683: Add file descriptor recommendation to ops guide Adding sizing recommendations for file descriptors to the ops guide. You can merge this pull request into a Git repository by running:

[jira] [Resolved] (KAFKA-3587) LogCleaner fails due to incorrect offset map computation on a replica

2016-05-09 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-3587. Resolution: Fixed Issue resolved by pull request 1332 [https://github.com/apache/kafka/pull/1332] >

[jira] [Commented] (KAFKA-3587) LogCleaner fails due to incorrect offset map computation on a replica

2016-05-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15276639#comment-15276639 ] ASF GitHub Bot commented on KAFKA-3587: --- Github user asfgit closed the pull request

[GitHub] kafka pull request: KAFKA-3587: LogCleaner fails due to incorrect ...

2016-05-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1332 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Created] (KAFKA-3683) Add file descriptor recommendation to ops guide

2016-05-09 Thread Dustin Cote (JIRA)
Dustin Cote created KAFKA-3683: -- Summary: Add file descriptor recommendation to ops guide Key: KAFKA-3683 URL: https://issues.apache.org/jira/browse/KAFKA-3683 Project: Kafka Issue Type: Improve

Re: reading the consumer offsets topic

2016-05-09 Thread Todd Palino
The GroupMetadataManager one should be working for you with 0.9. I don’t have a 0.9 KCC set up at the moment, so I’m using an 0.8 version where it’s different (it’s the other class for me). The only thing I can offer now is did you put quotes around the arg to --formatter so you don’t get weird she

Build failed in Jenkins: kafka-trunk-jdk7 #1270

2016-05-09 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-3681; Connect doc formatting [wangguoz] KAFKA-3658: Validate retention period be longer than window size -- Started by an SCM change [EnvInject] - Loading node envir

[jira] [Commented] (KAFKA-3658) Incorrect validation check on maintenance period with join window size

2016-05-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15276586#comment-15276586 ] ASF GitHub Bot commented on KAFKA-3658: --- Github user asfgit closed the pull request

[jira] [Resolved] (KAFKA-3658) Incorrect validation check on maintenance period with join window size

2016-05-09 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-3658. -- Resolution: Fixed Fix Version/s: (was: 0.10.0.1) 0.10.0.0 Issue re

[GitHub] kafka pull request: KAFKA-3658: Validate retention period be longe...

2016-05-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1337 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-3658) Incorrect validation check on maintenance period with join window size

2016-05-09 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15276583#comment-15276583 ] Guozhang Wang commented on KAFKA-3658: -- Actually it is not about a policy change, we

[jira] [Comment Edited] (KAFKA-3658) Incorrect validation check on maintenance period with join window size

2016-05-09 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15276583#comment-15276583 ] Guozhang Wang edited comment on KAFKA-3658 at 5/9/16 4:30 PM: --

Build failed in Jenkins: kafka-trunk-jdk7 #1269

2016-05-09 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-3662; Fix timing issue in SocketServerTest.tooBigRequestIsRejected -- [...truncated 8365 lines...] org.apache.kafka.connect.storage.MemoryStatusBackingStoreTest >

[jira] [Commented] (KAFKA-3682) ArrayIndexOutOfBoundsException thrown by SkimpyOffsetMap.get() when full

2016-05-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15276559#comment-15276559 ] ASF GitHub Bot commented on KAFKA-3682: --- GitHub user edoardocomar opened a pull requ

[GitHub] kafka pull request: KAFKA-3682 ArrayIndexOutOfBoundsException thro...

2016-05-09 Thread edoardocomar
GitHub user edoardocomar opened a pull request: https://github.com/apache/kafka/pull/1352 KAFKA-3682 ArrayIndexOutOfBoundsException thrown by SkimpyOffsetMap.get() when full Limited number of attempts to number of map slots after the internal positionOf() goes into linea

[jira] [Commented] (KAFKA-3681) Connect Documention formatting issue

2016-05-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15276551#comment-15276551 ] ASF GitHub Bot commented on KAFKA-3681: --- Github user asfgit closed the pull request

[GitHub] kafka pull request: KAFKA-3681: connect doc formatting

2016-05-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1351 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Created] (KAFKA-3682) ArrayIndexOutOfBoundsException thrown by SkimpyOffsetMap.get() when full

2016-05-09 Thread Edoardo Comar (JIRA)
Edoardo Comar created KAFKA-3682: Summary: ArrayIndexOutOfBoundsException thrown by SkimpyOffsetMap.get() when full Key: KAFKA-3682 URL: https://issues.apache.org/jira/browse/KAFKA-3682 Project: Kafka

Build failed in Jenkins: kafka-0.10.0-jdk7 #68

2016-05-09 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-3662; Fix timing issue in SocketServerTest.tooBigRequestIsRejected -- [...truncated 6435 lines...] org.apache.kafka.connect.storage.MemoryStatusBackingStoreTest > d

Re: reading the consumer offsets topic

2016-05-09 Thread Cliff Rhyne
Thanks, Todd. It's still not working unfortunately. This results in nothing getting printed to the console and requires kill -9 in another window to stop (ctrl-c doesn't work): /kafka-console-consumer.sh --bootstrap-server localhost:9092 --zookeeper --topic __consumer_offsets --formatter kafka.

Build failed in Jenkins: kafka-trunk-jdk8 #605

2016-05-09 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-3662; Fix timing issue in SocketServerTest.tooBigRequestIsRejected -- [...truncated 2596 lines...] kafka.admin.TopicCommandTest > testConfigPreservationAcrossPartiti

[jira] [Resolved] (KAFKA-3681) Connect Documention formatting issue

2016-05-09 Thread Kaufman Ng (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaufman Ng resolved KAFKA-3681. --- Resolution: Fixed > Connect Documention formatting issue > > >

[jira] [Commented] (KAFKA-3681) Connect Documention formatting issue

2016-05-09 Thread Kaufman Ng (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15276383#comment-15276383 ] Kaufman Ng commented on KAFKA-3681: --- pull request: https://github.com/apache/kafka/pull/

[GitHub] kafka pull request: Kafka-3681: connect doc formatting

2016-05-09 Thread coughman
GitHub user coughman opened a pull request: https://github.com/apache/kafka/pull/1351 Kafka-3681: connect doc formatting You can merge this pull request into a Git repository by running: $ git pull https://github.com/coughman/kafka KAFKA-3681-connect-doc-formatting Alternati

[jira] [Commented] (KAFKA-3662) Failure in kafka.network.SocketServerTest.tooBigRequestIsRejecte

2016-05-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15276373#comment-15276373 ] ASF GitHub Bot commented on KAFKA-3662: --- Github user asfgit closed the pull request

  1   2   >