Jenkins build is back to normal : kafka-0.10.0-jdk7 #91

See

Build failed in Jenkins: kafka-trunk-jdk8 #627

See Changes: [cshapi] KAFKA-3713; Close `compressor` to fix memory leak -- [...truncated lines...] kafka.log.LogManagerTest > testCheckpointRecoveryPoints PASSED kafka.log.LogManagerTest >

[jira] [Updated] (KAFKA-3713) test_producer_throughput is failing with compression_type=snappy

[ https://issues.apache.org/jira/browse/KAFKA-3713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3713: Resolution: Fixed Fix Version/s: 0.10.1.0 Status: Resolved (was: Patch Available)

[GitHub] kafka pull request: KAFKA-3713; Close `compressor` to fix memory l...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1385 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Updated] (KAFKA-3713) test_producer_throughput is failing with compression_type=snappy

[ https://issues.apache.org/jira/browse/KAFKA-3713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3713: --- Status: Patch Available (was: In Progress) > test_producer_throughput is failing with compression_typ

[GitHub] kafka pull request: KAFKA-3713; Close `compressor` to fix memory l...

GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/1385 KAFKA-3713; Close `compressor` to fix memory leak This fixes test_producer_throughput with compression_type=snappy. You can merge this pull request into a Git repository by running: $ git pull ht

[jira] [Updated] (KAFKA-3713) test_producer_throughput is failing with compression_type=snappy

[ https://issues.apache.org/jira/browse/KAFKA-3713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3713: --- Description: The failure only happens for certain message sizes and they started after the recent ch

[jira] [Created] (KAFKA-3713) test_producer_throughput is failing with compression_type=snappy

Ismael Juma created KAFKA-3713: -- Summary: test_producer_throughput is failing with compression_type=snappy Key: KAFKA-3713 URL: https://issues.apache.org/jira/browse/KAFKA-3713 Project: Kafka I

[jira] [Updated] (KAFKA-3713) test_producer_throughput is failing with compression_type=snappy

[ https://issues.apache.org/jira/browse/KAFKA-3713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3713: --- Component/s: clients > test_producer_throughput is failing with compression_type=snappy >

[jira] [Updated] (KAFKA-3713) test_producer_throughput is failing with compression_type=snappy

[ https://issues.apache.org/jira/browse/KAFKA-3713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3713: --- Fix Version/s: 0.10.0.0 > test_producer_throughput is failing with compression_type=snappy > -

[jira] [Work started] (KAFKA-3713) test_producer_throughput is failing with compression_type=snappy

[ https://issues.apache.org/jira/browse/KAFKA-3713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-3713 started by Ismael Juma. -- > test_producer_throughput is failing with compression_type=snappy >

Build failed in Jenkins: kafka-0.10.0-jdk7 #90

See Changes: [wangguoz] Revert 51b63c421460a00884e7f00a648c41ed31eb6dd5 from 0.10.0 -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H10 (docker

Jenkins build is back to normal : kafka-0.10.0-jdk7 #89

See

Jenkins build is back to normal : kafka-trunk-jdk7 #1292

See

Re: [VOTE] 0.10.0.0 RC4

also, perhaps sharing the broker configuration? maybe this will provide some hints... On Fri, May 13, 2016 at 5:31 PM, Ismael Juma wrote: > Thanks Tom. I just wanted to share that I have been unable to reproduce > this so far. Please feel free to share whatever you information you have so > far w

Re: [VOTE] 0.10.0.0 RC4

Thanks Tom. I just wanted to share that I have been unable to reproduce this so far. Please feel free to share whatever you information you have so far when you have a chance, don't feel that you need to have all the answers. Ismael On Fri, May 13, 2016 at 7:32 PM, Tom Crayford wrote: > I've be

[GitHub] kafka pull request: KAFKA-3667:

GitHub user rnpridgeon opened a pull request: https://github.com/apache/kafka/pull/1384 KAFKA-3667: By default Kafka is configured to allow ssl communication without hostname verification. This docs has been amended to include instructions on how to set that up in the event clients

Build failed in Jenkins: kafka-trunk-jdk8 #626

See Changes: [wangguoz] MINOR: Allow Serdes subclasses to access WrapperSerde -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubuntu3 (Ubuntu ub

[GitHub] kafka pull request: MINOR: Allow Serdes subclasses to access Wrapp...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1382 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Re: [DISCUSS] KIP-48 Support for delegation tokens as an authentication mechanism

Also comments inline :) > * I want to emphasize that even though delegation tokens are a Hadoop > innovation, I feel very strongly about not adding dependency on Hadoop > when implementing delegation tokens for Kafka. The KIP doesn't imply > such dependency, but if you can clarify... > > > *No had

Re: [VOTE] 0.10.0.0 RC4

Gwen, The version we are currently running in production is the trunk on Feb 24. Which has KAFKA-3025. Our release test cluster has been running this version for about two months, I haven't seen throughput issues so far. But we are probably not running at the max capacity of the brokers. I will s

Re: [DISCUSS] KIP-48 Support for delegation tokens as an authentication mechanism

My comments are inline. * The API / RequestResponse section doesn't seem to have good description of the changes to the Kafka Protocol. Sounds like you are proposing new DelegationTokenRequest and RenewTokenRequest (and matching responses), without detailing the contents of the requests and respon

[jira] [Created] (KAFKA-3712) Kafka should support user impersonation

Sriharsha Chintalapani created KAFKA-3712: - Summary: Kafka should support user impersonation Key: KAFKA-3712 URL: https://issues.apache.org/jira/browse/KAFKA-3712 Project: Kafka Issue

[jira] [Created] (KAFKA-3711) Allow configuration of MetricsReporter subclasses

Jeff Klukas created KAFKA-3711: -- Summary: Allow configuration of MetricsReporter subclasses Key: KAFKA-3711 URL: https://issues.apache.org/jira/browse/KAFKA-3711 Project: Kafka Issue Type: Impro

[jira] [Updated] (KAFKA-3710) MemoryOffsetBackingStore creates a non-daemon thread that prevents clean shutdown

[ https://issues.apache.org/jira/browse/KAFKA-3710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Davis updated KAFKA-3710: --- Labels: easyfix newbie patch (was: easyfix newbie) > MemoryOffsetBackingStore creates a non-daemon th

[GitHub] kafka pull request: KAFKA-3710: MemoryOffsetBackingStore shutdown

GitHub user davispw opened a pull request: https://github.com/apache/kafka/pull/1383 KAFKA-3710: MemoryOffsetBackingStore shutdown ExecutorService needs to be shutdown on close, lest a zombie thread prevent clean shutdown. @ewencp You can merge this pull request into a

[jira] [Created] (KAFKA-3710) MemoryOffsetBackingStore creates a non-daemon thread that prevents clean shutdown

Peter Davis created KAFKA-3710: -- Summary: MemoryOffsetBackingStore creates a non-daemon thread that prevents clean shutdown Key: KAFKA-3710 URL: https://issues.apache.org/jira/browse/KAFKA-3710 Project:

Slides and Video from Kafka Summit are now available

Hey Kafka Community, It was great seeing so many of you at the Kafka summit last month. Hope you had fun and learned a lot. I certainly did. Looking forward to meet all of you again at the next summit :) For those of you who missed the event, or those who attended but are sorry they couldn't see

Re: [VOTE] 0.10.0.0 RC4

Becket, Did you try deploying one of the 0.10.0 candidates at LinkedIn? Did you see this issue? Gwen On Fri, May 13, 2016 at 10:30 AM, Becket Qin wrote: > Tom, > > Maybe it is mentioned and I missed. I am wondering if you see performance > degradation on the consumer side when TLS is used? This

Re: [VOTE] 0.10.0.0 RC4

Hi, We (Ismael, Magnus and Jun) are also trying to reproduce and figure it out on our side. Will keep you posted. Gwen On Fri, May 13, 2016 at 11:32 AM, Tom Crayford wrote: > I've been investigating this pretty hard since I first noticed it. Right > now I have more avenues for investigation tha

Re: [VOTE] 0.10.0.0 RC4

I've been investigating this pretty hard since I first noticed it. Right now I have more avenues for investigation than I can shake a stick at, and am also dealing with several other things in flight/on fire. I'll respond when I have more information and can confirm things. On Fri, May 13, 2016 at

Re: [VOTE] 0.10.0.0 RC4

Tom, Maybe it is mentioned and I missed. I am wondering if you see performance degradation on the consumer side when TLS is used? This could help us understand whether the issue is only producer related or TLS in general. Thanks, Jiangjie (Becket) Qin On Fri, May 13, 2016 at 6:19 AM, Tom Crayfo

[GitHub] kafka pull request: MINOR: Allow Serdes subclasses to access Wrapp...

GitHub user jklukas opened a pull request: https://github.com/apache/kafka/pull/1382 MINOR: Allow Serdes subclasses to access WrapperSerde This PR loosens access restrictions on `WrapperSerde` to `protected` so that users can define a `Serdes` subclass that provides additional custo

[GitHub] kafka-site pull request: KAFKA-3709: Create a project security pag...

Github user junrao commented on the pull request: https://github.com/apache/kafka-site/pull/12#issuecomment-219094883 Thanks for the patch. LGTM. I initiated the request to create the security mailing list for Kafka. Will update the PR when it's created. --- If your project is set up

Jenkins build is back to normal : kafka-trunk-jdk8 #625

See

Re: [VOTE] 0.10.0.0 RC4

Ismael, Thanks. I'm writing up an issue with some new findings since yesterday right now. Thanks Tom On Fri, May 13, 2016 at 1:06 PM, Ismael Juma wrote: > Hi Tom, > > That's because JIRA is in lockdown due to excessive spam. I have added you > as a contributor in JIRA and you should be able t

Jenkins build is back to normal : kafka-trunk-jdk7 #1289

See

[jira] [Commented] (KAFKA-3396) Unauthorized topics are returned to the user

[ https://issues.apache.org/jira/browse/KAFKA-3396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15282659#comment-15282659 ] Edoardo Comar commented on KAFKA-3396: -- Hi [~granthenke] I thought that if a user has

Build failed in Jenkins: kafka-0.10.0-jdk7 #88

See Changes: [ismael] KAFKA-3584; Fix synchronization issue between deleteOldSegments() and -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H10

Re: [VOTE] 0.10.0.0 RC4

Hi Tom, That's because JIRA is in lockdown due to excessive spam. I have added you as a contributor in JIRA and you should be able to file a ticket now. Thanks, Ismael On Fri, May 13, 2016 at 12:17 PM, Tom Crayford wrote: > Ok, I don't seem to be able to file a new Jira issue at all. Can someb

[jira] [Updated] (KAFKA-3584) NullPointer Exception found when Delete Topic and Log delete concurrent

[ https://issues.apache.org/jira/browse/KAFKA-3584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3584: --- Resolution: Fixed Fix Version/s: (was: 0.10.0.1) 0.10.0.0 Stat

[GitHub] kafka pull request: KAFKA-3584; Fix synchronization issue between ...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1367 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Build failed in Jenkins: kafka-0.10.0-jdk7 #87

See Changes: [ismael] KAFKA-3692; Add quotes to variables in kafka-run-class.sh -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubuntu-us1 (Ubun

Re: [VOTE] 0.10.0.0 RC4

Ok, I don't seem to be able to file a new Jira issue at all. Can somebody check my permissions on Jira? My user is `tcrayford-heroku` Tom Crayford Heroku Kafka On Fri, May 13, 2016 at 12:24 AM, Jun Rao wrote: > Tom, > > We don't have a CSV metrics reporter in the producer right now. The metrics

Build failed in Jenkins: kafka-trunk-jdk8 #624

See Changes: [ismael] KAFKA-3692; Add quotes to variables in kafka-run-class.sh -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubuntu3 (Ubuntu

[jira] [Updated] (KAFKA-3692) Wildcards in External CLASSPATH may cause it not be included in the CLASSPATH

[ https://issues.apache.org/jira/browse/KAFKA-3692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3692: --- Resolution: Fixed Status: Resolved (was: Patch Available) > Wildcards in External CLASSPATH m

[GitHub] kafka pull request: KAFKA-3692: Add quotes to variables in kafka-r...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1364 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] kafka-site pull request: KAFKA-3709: Create a project security pag...

Github user fpj commented on the pull request: https://github.com/apache/kafka-site/pull/12#issuecomment-219002026 @ijuma indentation fixed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] kafka-site pull request: KAFKA-3709: Create a project security pag...

Github user ijuma commented on the pull request: https://github.com/apache/kafka-site/pull/12#issuecomment-219001681 LGTM apart from one trivial comment. @junrao, can you please take a look as well? --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] kafka-site pull request: KAFKA-3709: Create a project security pag...

Github user ijuma commented on a diff in the pull request: https://github.com/apache/kafka-site/pull/12#discussion_r63159382 --- Diff: includes/header.html --- @@ -50,6 +50,7 @@ performance https://cwiki.apache.org/conf

[GitHub] kafka-site pull request: KAFKA-3709: Create a project security pag...

GitHub user fpj opened a pull request: https://github.com/apache/kafka-site/pull/12 KAFKA-3709: Create a project security page. You can merge this pull request into a Git repository by running: $ git pull https://github.com/fpj/kafka-site KAFKA-3709-Create-Security-Page Alter

[jira] [Resolved] (KAFKA-1201) offset in LogCleaner.awaitCleaned is not enforced

[ https://issues.apache.org/jira/browse/KAFKA-1201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar Reddy resolved KAFKA-1201. Resolution: Duplicate Assignee: (was: Jay Kreps) Fix Version/s: 0.9.0.0

[GitHub] kafka pull request: KAFKA-3709: Create project security page

Github user fpj closed the pull request at: https://github.com/apache/kafka/pull/1381 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled

[jira] [Resolved] (KAFKA-3707) Introduce a security page on the Kafka website

[ https://issues.apache.org/jira/browse/KAFKA-3707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-3707. Resolution: Duplicate Duplicate of KAFKA-3709 > Introduce a security page on the Kafka website > --

[GitHub] kafka pull request: KAFKA-3709: Create project security page

GitHub user fpj opened a pull request: https://github.com/apache/kafka/pull/1381 KAFKA-3709: Create project security page You can merge this pull request into a Git repository by running: $ git pull https://github.com/fpj/kafka KAFKA-3709-Create-Security-Page Alternatively yo

[jira] [Created] (KAFKA-3709) Create project security page

Flavio Junqueira created KAFKA-3709: --- Summary: Create project security page Key: KAFKA-3709 URL: https://issues.apache.org/jira/browse/KAFKA-3709 Project: Kafka Issue Type: Improvement

Jenkins build is back to normal : kafka-trunk-jdk8 #623

See

[jira] [Assigned] (KAFKA-3389) ReplicaStateMachine areAllReplicasForTopicDeleted check not handling well case when there are no replicas for topic

[ https://issues.apache.org/jira/browse/KAFKA-3389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar Reddy reassigned KAFKA-3389: -- Assignee: Manikumar Reddy (was: Neha Narkhede) > ReplicaStateMachine areAllReplicasFor

[jira] [Commented] (KAFKA-3389) ReplicaStateMachine areAllReplicasForTopicDeleted check not handling well case when there are no replicas for topic

[ https://issues.apache.org/jira/browse/KAFKA-3389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15282496#comment-15282496 ] Manikumar Reddy commented on KAFKA-3389: Scala map.forall(predicate) returns true

Re: [DISCUSS] KIP-48 Support for delegation tokens as an authentication mechanism

Hi Parth and Harsha, Few more comments: * The API / RequestResponse section doesn't seem to have good description of the changes to the Kafka Protocol. Sounds like you are proposing new DelegationTokenRequest and RenewTokenRequest (and matching responses), without detailing the contents of the re

Jenkins build is back to normal : kafka-0.10.0-jdk7 #86

See