[jira] [Commented] (KAFKA-2477) Replicas spuriously deleting all segments in partition

[ https://issues.apache.org/jira/browse/KAFKA-2477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723259#comment-14723259 ] Håkon Hitland commented on KAFKA-2477: -- "kafka.controller:name=UncleanLeaderElections

[jira] [Commented] (KAFKA-2145) An option to add topic owners.

[ https://issues.apache.org/jira/browse/KAFKA-2145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723515#comment-14723515 ] Jun Rao commented on KAFKA-2145: [~parth.brahmbhatt], will take a look today. > An option

[jira] [Commented] (KAFKA-2486) New consumer performance

[ https://issues.apache.org/jira/browse/KAFKA-2486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723607#comment-14723607 ] Jason Gustafson commented on KAFKA-2486: The sleep was intended to implement the f

[jira] [Commented] (KAFKA-2486) New consumer performance

[ https://issues.apache.org/jira/browse/KAFKA-2486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723615#comment-14723615 ] Jay Kreps commented on KAFKA-2486: -- I don't think we need to do anything special for the

Re: Mirror maker SSL support

Currently, MirrorMaker can run the producer with SSL. We will add the option to run the new consumer in MirrorMaker in KAFKA-2452, which will enable SSL on the consumer side too. Thanks, Jun On Fri, Aug 28, 2015 at 12:01 PM, Xiang Zhou (Samuel) wrote: > Hi, folks, > > I just want to check if a

Re: Mirror maker SSL support

Thank you for update Jun. What's the schedule to get new consumer implemented in Mirror Maker? Samuel On Mon, Aug 31, 2015 at 10:06 AM, Jun Rao wrote: > Currently, MirrorMaker can run the producer with SSL. We will add the > option to run the new consumer in MirrorMaker in KAFKA-2452, which wil

Re: Review Request 34492: Patch for KAFKA-2210

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34492/#review96909 --- Thanks for the patch. We are getting pretty close. A few more commen

[jira] [Commented] (KAFKA-2210) KafkaAuthorizer: Add all public entities, config changes and changes to KafkaAPI and kafkaServer to allow pluggable authorizer implementation.

[ https://issues.apache.org/jira/browse/KAFKA-2210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723854#comment-14723854 ] Jun Rao commented on KAFKA-2210: [~parth.brahmbhatt], thanks for the latest patch. Just re

[jira] [Commented] (KAFKA-2210) KafkaAuthorizer: Add all public entities, config changes and changes to KafkaAPI and kafkaServer to allow pluggable authorizer implementation.

[ https://issues.apache.org/jira/browse/KAFKA-2210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723866#comment-14723866 ] Parth Brahmbhatt commented on KAFKA-2210: - [~junrao] yes that is correct sequencin

Re: [DISCUSS] Client-side Assignment for New Consumer

Ewen, To be more clear about the numbers in LinkedIn including the expected growth, we have the following table (Assuming avg topic name length is 27 bytes): #TopicMirrored #MirrorMakerNodes #ConsumerPerNode #BytesPerRebalance #BytesPerMirrorMakerRollingBounce 100

[GitHub] kafka pull request: KAFKA-2475: Make Copycat only have a Converter...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/172 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Updated] (KAFKA-2475) Reduce copycat configs to only specify a converter or serializer, not both

[ https://issues.apache.org/jira/browse/KAFKA-2475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-2475: Resolution: Fixed Status: Resolved (was: Patch Available) Issue resolved by pull request 17

[jira] [Commented] (KAFKA-2475) Reduce copycat configs to only specify a converter or serializer, not both

[ https://issues.apache.org/jira/browse/KAFKA-2475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723901#comment-14723901 ] ASF GitHub Bot commented on KAFKA-2475: --- Github user asfgit closed the pull request

[jira] [Commented] (KAFKA-2486) New consumer performance

[ https://issues.apache.org/jira/browse/KAFKA-2486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723913#comment-14723913 ] ASF GitHub Bot commented on KAFKA-2486: --- GitHub user hachikuji opened a pull request

[GitHub] kafka pull request: KAFKA-2486; fix performance regression in new ...

GitHub user hachikuji opened a pull request: https://github.com/apache/kafka/pull/180 KAFKA-2486; fix performance regression in new consumer The sleep() in KafkaConsumer's poll blocked any pending IO from being completed and created a performance bottleneck. It was intended to imple

[GitHub] kafka pull request: KAFKA-2485; Allow producer performance to take...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/174 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Commented] (KAFKA-2485) Allow producer performance to take properties from a file via --producer.config command line parameter

[ https://issues.apache.org/jira/browse/KAFKA-2485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723924#comment-14723924 ] ASF GitHub Bot commented on KAFKA-2485: --- Github user asfgit closed the pull request

[jira] [Updated] (KAFKA-2485) Allow producer performance to take properties from a file via --producer.config command line parameter

[ https://issues.apache.org/jira/browse/KAFKA-2485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-2485: Resolution: Fixed Fix Version/s: 0.8.3 Status: Resolved (was: Patch Available) Is

Jenkins build is back to normal : Kafka-trunk #608

See

Re: Mirror maker SSL support

Probably within 2-3 weeks. Thanks, Jun On Mon, Aug 31, 2015 at 10:54 AM, Xiang Zhou (Samuel) wrote: > Thank you for update Jun. > What's the schedule to get new consumer implemented in Mirror Maker? > > Samuel > > On Mon, Aug 31, 2015 at 10:06 AM, Jun Rao wrote: > > > Currently, MirrorMaker c

[jira] [Resolved] (KAFKA-2486) New consumer performance

[ https://issues.apache.org/jira/browse/KAFKA-2486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira resolved KAFKA-2486. - Resolution: Fixed Issue resolved by pull request 180 [https://github.com/apache/kafka/pull/180] >

[jira] [Commented] (KAFKA-2486) New consumer performance

[ https://issues.apache.org/jira/browse/KAFKA-2486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14724070#comment-14724070 ] ASF GitHub Bot commented on KAFKA-2486: --- Github user asfgit closed the pull request

[GitHub] kafka pull request: KAFKA-2486; fix performance regression in new ...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/180 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Commented] (KAFKA-2486) New consumer performance

[ https://issues.apache.org/jira/browse/KAFKA-2486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14724079#comment-14724079 ] Jay Kreps commented on KAFKA-2486: -- Where does this leave perf for the new consumer vs ol

Build failed in Jenkins: Kafka-trunk #609

See Changes: [cshapi] KAFKA-2486; fix performance regression in new consumer -- [...truncated 1615 lines...] kafka.admin.AdminTest > testPartitionReassignmentWithLeaderInNewReplicas PASSED kafka.api.

[IMPORTANT] Questions related to AdminUtils thread safety

Hi, Could you please let me know if calls to "AdminUtils.topicExists" and "AdminUtils.createTopic" are thread-safe? Thank you, Siva.

[GitHub] kafka pull request: KAFKA-2278; JmxTool should support querying al...

GitHub user lindong28 opened a pull request: https://github.com/apache/kafka/pull/181 KAFKA-2278; JmxTool should support querying all objects when object-n… …ame is omitted You can merge this pull request into a Git repository by running: $ git pull https://github.com/lindo

[jira] [Commented] (KAFKA-2278) JmxTool should support querying all objects when object-name is omitted

[ https://issues.apache.org/jira/browse/KAFKA-2278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14724336#comment-14724336 ] ASF GitHub Bot commented on KAFKA-2278: --- GitHub user lindong28 opened a pull request

[jira] [Created] (KAFKA-2490) support new consumer in ConsumerOffsetChecker

Jun Rao created KAFKA-2490: -- Summary: support new consumer in ConsumerOffsetChecker Key: KAFKA-2490 URL: https://issues.apache.org/jira/browse/KAFKA-2490 Project: Kafka Issue Type: Sub-task

[jira] [Updated] (KAFKA-2419) Allow certain Sensors to be garbage collected after inactivity

[ https://issues.apache.org/jira/browse/KAFKA-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-2419: --- Affects Version/s: 0.8.3 > Allow certain Sensors to be garbage collected after inactivity > --

[jira] [Commented] (KAFKA-2419) Allow certain Sensors to be garbage collected after inactivity

[ https://issues.apache.org/jira/browse/KAFKA-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14724422#comment-14724422 ] Jun Rao commented on KAFKA-2419: [~aauradkar], are you working on this? We probably need t

[jira] [Assigned] (KAFKA-2490) support new consumer in ConsumerOffsetChecker

[ https://issues.apache.org/jira/browse/KAFKA-2490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish K Singh reassigned KAFKA-2490: - Assignee: Ashish K Singh > support new consumer in ConsumerOffsetChecker > --

[jira] [Commented] (KAFKA-2452) enable new consumer in mirror maker

[ https://issues.apache.org/jira/browse/KAFKA-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14724434#comment-14724434 ] Samuel Zhou commented on KAFKA-2452: It is a very important feature to enable new cons

[jira] [Commented] (KAFKA-2486) New consumer performance

[ https://issues.apache.org/jira/browse/KAFKA-2486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14724436#comment-14724436 ] Ewen Cheslack-Postava commented on KAFKA-2486: -- [~jkreps] System tests are be

[jira] [Commented] (KAFKA-2486) New consumer performance

[ https://issues.apache.org/jira/browse/KAFKA-2486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14724448#comment-14724448 ] Jay Kreps commented on KAFKA-2486: -- [~ewencp] Nightly will be awesome! I think what I am

Re: Review Request 36858: Patch for KAFKA-2120

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/36858/#review97213 --- clients/src/main/java/org/apache/kafka/clients/NetworkClient.java (

[jira] [Commented] (KAFKA-2477) Replicas spuriously deleting all segments in partition

[ https://issues.apache.org/jira/browse/KAFKA-2477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14724559#comment-14724559 ] Jun Rao commented on KAFKA-2477: Interesting, so there is nothing in broker 0's log about

How can I start writing a Copycat connector?

Hi, I'd like to write a Copycat connector. I saw on Github that the Copycat data APIs have been committed to trunk. How can I get started? I've never developed against trunk before. Do I git clone from trunk, or is there a pre-built set of jars from trunk that I can use? I see that there is a

[GitHub] kafka pull request: MINOR: Quota's equals() is buggy.

GitHub user eribeiro opened a pull request: https://github.com/apache/kafka/pull/182 MINOR: Quota's equals() is buggy. It compares upper bound with itself. You can merge this pull request into a Git repository by running: $ git pull https://github.com/eribeiro/kafka equals-bug

Re: How can I start writing a Copycat connector?

Hi James, This is so exciting :) While the APIs are still marked as @unstable, we don't have immediate plans to modify them - so now is a good time to write a connector. Just accept the possibility that few modifications may be needed before release (I'm trying to get Ewen to add mandatory connec

[jira] [Created] (KAFKA-2491) Update ErrorMapping with New Consumer Errors

Jason Gustafson created KAFKA-2491: -- Summary: Update ErrorMapping with New Consumer Errors Key: KAFKA-2491 URL: https://issues.apache.org/jira/browse/KAFKA-2491 Project: Kafka Issue Type: Su

[jira] [Commented] (KAFKA-2394) Use RollingFileAppender by default in log4j.properties

[ https://issues.apache.org/jira/browse/KAFKA-2394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14724636#comment-14724636 ] jin xing commented on KAFKA-2394: - I'm new comer for Kafka, I'm directed here by Kafka web

[GitHub] kafka pull request: MINOR: MockClient's disconnect() method has tw...

GitHub user eribeiro opened a pull request: https://github.com/apache/kafka/pull/183 MINOR: MockClient's disconnect() method has two bugs (and a prospetive refactoring) * First, it compares Strings using `==` instead of `equals()` * Second, it tries to remove a Str

Re: [IMPORTANT] Questions related to AdminUtils thread safety

topicExists simply reads ZK, so yes. createTopic should also be fine unless you try to create the same topic concurrently. AdminUtils itself does not maintain any state, just some static util functions. On Mon, Aug 31, 2015 at 3:00 PM, Sivananda Reddys Thummala Abbigari < sthumm...@salesforce.com>

no Kafka KIP meeting tomorrow

Since there are no new KIP issues for discussion, again, there is no KIP meeting tomorrow. Thanks, Jun