Re: [ANNOUNCEMENT] Apache Kafka 0.8.2.0 Released

YaY!. Thanks to Jun and everybody who contributed to this release. We have been waiting for this release for a while. Thanks, Rajasekar Elango (Salesforce.com). On Tue, Feb 3, 2015 at 8:37 PM, Jun Rao wrote: > The Apache Kafka community is pleased to announce the release for Apache >

ReplicaManager recover after losing a broker

We run 5 node kafka cluster in production with replication factor is 3. If we lose a broker for couple days and kafka-data is wiped off when it comes back online, we had to do rolling restart of all brokers to make them heathy. It recovers itself for most part, FailedFetchRequests and UnderReplica

Re: [DISCUSS] Kafka Security Specific Features

Hi Jay, Thanks for putting together a spec for security. Joe, Looks "Securing zookeeper.." part has been deleted from assumptions section. communication with zookeeper need to be secured as well to make entire kafka cluster secure. It may or may not require changes to kafka. But it's good to hav

Re: Review Request 22131: Patch for KAFKA-1477

/relango/kafka/compare/0.8-snapshot...kafka_security#diff-43) is not included in the patch (= - Rajasekar Elango On June 3, 2014, 10:53 a.m., Ivan Lyutov wrote: > > --- > This is an automatically generated e-mail. To reply, visit

Re: Review Request 22131: Patch for KAFKA-1477

ed to security. So ok with not including it. - Rajasekar Elango On June 3, 2014, 10:53 a.m., Ivan Lyutov wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.a

Re: Review Request 22131: Patch for KAFKA-1477

ed to security. So ok with not including it. - Rajasekar Elango On June 3, 2014, 10:53 a.m., Ivan Lyutov wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.a

Re: Review Request 22131: Patch for KAFKA-1477

<https://reviews.apache.org/r/22131/#comment79505> Good to see that you already added lines 644 through 656 to make it compile jdk1.7 - Rajasekar Elango On June 3, 2014, 10:53 a.m., Ivan Lyutov wrote: > > ---

Re: Review Request 22131: Patch for KAFKA-1477

131/#comment79513> Should we secure property to false to make kafka run in non-secure mode by default so it won't impact existing users. - Rajasekar Elango On June 3, 2014, 10:53 a.m., Ivan Lyutov wrote: > > --- > This

Re: [DISCUSS] Kafka Security Specific Features

Pramod, I presented secure kafka configuration and usage at last meet up. So hope this video recording would help. You can skip to about 59 min to jump to security talk. Thanks, Raja. On Wed, Jul 16, 2014 at 5:57 PM, Pramod Deshmukh wrote: > Hello Joe

Re: [DISCUSS] Kafka Security Specific Features

ng.scala:106) > > at kafka.utils.Utils$.swallowError(Utils.scala:45) > > at > > kafka.producer.async.DefaultEventHandler.handle(DefaultEventHandler.scala:67) > > at > > kafka.producer.async.ProducerSendThread.tryToHandle(ProducerSendThread.scala:104) > > at > > ka

Re: Review Request 22131: Patch for KAFKA-1477

131/#comment94187> Can we set secure property to ***false*** to make kafka run in non-secure mode by default so it won't impact existing users - Rajasekar Elango On Sept. 18, 2014, 12:43 p.m., Ivan Lyutov wrote: > > ---

Re: Review Request 22131: Patch for KAFKA-1477

tps://reviews.apache.org/r/22131/#comment94287> Can you rename **client.security.file** to **security.config.file** to be consistent with ConsoleConsumer and naming convention used across the code ? - Rajasekar Elango On Sept. 23, 2014, 11:14 a.m., Ivan Lyutov

Re: Review Request 22131: Patch for KAFKA-1477

orce's) original implementation. Our older secure client can no longer work with this newer version of secure broker. - Rajasekar Elango On Sept. 23, 2014, 11:14 a.m., Ivan Lyutov wrote: > > --- > This is an automatically gen

Re: Announcing Confluent

Congrats. Wish you all the very best and success. Thanks, Raja. On Thu, Nov 6, 2014 at 1:36 PM, Niek Sanders wrote: > Congrats! > > On Thu, Nov 6, 2014 at 10:28 AM, Jay Kreps wrote: > > Hey all, > > > > I’m happy to announce that Jun Rao, Neha Narkhede and I are creating a > > company around K

[jira] [Commented] (KAFKA-1690) new java producer needs ssl support as a client

[ https://issues.apache.org/jira/browse/KAFKA-1690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14608572#comment-14608572 ] Rajasekar Elango commented on KAFKA-1690: - [~harsha_ch] Thanks for workin

[jira] [Commented] (KAFKA-1690) new java producer needs ssl support as a client

[ https://issues.apache.org/jira/browse/KAFKA-1690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14642821#comment-14642821 ] Rajasekar Elango commented on KAFKA-1690: - [~harsha_ch] Is there

[jira] [Commented] (KAFKA-1690) new java producer needs ssl support as a client

[ https://issues.apache.org/jira/browse/KAFKA-1690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14652678#comment-14652678 ] Rajasekar Elango commented on KAFKA-1690: - [~harsha_ch] Thanks for documenta

[jira] [Commented] (KAFKA-1690) new java producer needs ssl support as a client

[ https://issues.apache.org/jira/browse/KAFKA-1690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14654142#comment-14654142 ] Rajasekar Elango commented on KAFKA-1690: - [~singhashish] I did not get

[jira] [Commented] (KAFKA-1690) Add SSL support to Kafka Broker, Producer and Consumer

[ https://issues.apache.org/jira/browse/KAFKA-1690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14711376#comment-14711376 ] Rajasekar Elango commented on KAFKA-1690: - SSLv3 was disabled since jdk ver

[jira] [Commented] (KAFKA-1477) add authentication layer and initial JKS x509 implementation for brokers, producers and consumer for network communication

[ https://issues.apache.org/jira/browse/KAFKA-1477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14027817#comment-14027817 ] Rajasekar Elango commented on KAFKA-1477: - Ivan, Looks like the patch

[jira] [Commented] (KAFKA-1477) add authentication layer and initial JKS x509 implementation for brokers, producers and consumer for network communication

[ https://issues.apache.org/jira/browse/KAFKA-1477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14042234#comment-14042234 ] Rajasekar Elango commented on KAFKA-1477: - [~lindong] It doesn't look li

[jira] [Commented] (KAFKA-1477) add authentication layer and initial JKS x509 implementation for brokers, producers and consumer for network communication

[ https://issues.apache.org/jira/browse/KAFKA-1477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078452#comment-14078452 ] Rajasekar Elango commented on KAFKA-1477: - Very Good Idea [~joestein]

[jira] [Commented] (KAFKA-1477) add authentication layer and initial JKS x509 implementation for brokers, producers and consumer for network communication

[ https://issues.apache.org/jira/browse/KAFKA-1477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14140751#comment-14140751 ] Rajasekar Elango commented on KAFKA-1477: - Thanks [~edgefox] , could you up

[jira] [Commented] (KAFKA-1477) add authentication layer and initial JKS x509 implementation for brokers, producers and consumer for network communication

[ https://issues.apache.org/jira/browse/KAFKA-1477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14143826#comment-14143826 ] Rajasekar Elango commented on KAFKA-1477: - [~lagivan] Thanks for picking thi

[jira] [Commented] (KAFKA-1477) add authentication layer and initial JKS x509 implementation for brokers, producers and consumer for network communication

[ https://issues.apache.org/jira/browse/KAFKA-1477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14145089#comment-14145089 ] Rajasekar Elango commented on KAFKA-1477: - This is great [~edgefox] . I d

[jira] [Commented] (KAFKA-1477) add authentication layer and initial JKS x509 implementation for brokers, producers and consumer for network communication

[ https://issues.apache.org/jira/browse/KAFKA-1477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14146395#comment-14146395 ] Rajasekar Elango commented on KAFKA-1477: - [~gwenshap] co

[jira] [Created] (KAFKA-1035) Add message-send-max-retries and retry-backoff-ms options to console producer

Rajasekar Elango created KAFKA-1035: --- Summary: Add message-send-max-retries and retry-backoff-ms options to console producer Key: KAFKA-1035 URL: https://issues.apache.org/jira/browse/KAFKA-1035

[jira] [Updated] (KAFKA-1035) Add message-send-max-retries and retry-backoff-ms options to console producer

[ https://issues.apache.org/jira/browse/KAFKA-1035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajasekar Elango updated KAFKA-1035: Attachment: console_producer_add_options.patch Patch for fixing this

[jira] [Updated] (KAFKA-1035) Add message-send-max-retries and retry-backoff-ms options to console producer

[ https://issues.apache.org/jira/browse/KAFKA-1035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajasekar Elango updated KAFKA-1035: Status: Patch Available (was: Open) See attachment for patch https://issues.apache.org

[jira] [Commented] (KAFKA-1035) Add message-send-max-retries and retry-backoff-ms options to console producer

[ https://issues.apache.org/jira/browse/KAFKA-1035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13754918#comment-13754918 ] Rajasekar Elango commented on KAFKA-1035: - Sure. do you want me to ch

[jira] [Commented] (KAFKA-1035) Add message-send-max-retries and retry-backoff-ms options to console producer

[ https://issues.apache.org/jira/browse/KAFKA-1035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13755130#comment-13755130 ] Rajasekar Elango commented on KAFKA-1035: - Attached patch with modi

[jira] [Updated] (KAFKA-1035) Add message-send-max-retries and retry-backoff-ms options to console producer

[ https://issues.apache.org/jira/browse/KAFKA-1035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajasekar Elango updated KAFKA-1035: Attachment: console_producer_add_options-v2.patch > Add message-send-max-retries

[jira] [Commented] (KAFKA-1035) Add message-send-max-retries and retry-backoff-ms options to console producer

[ https://issues.apache.org/jira/browse/KAFKA-1035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13755561#comment-13755561 ] Rajasekar Elango commented on KAFKA-1035: - Thanks, So could you apply patch

[jira] [Created] (KAFKA-1041) Number of file handles increases indefinitely in producer if broker host is unresolvable

Rajasekar Elango created KAFKA-1041: --- Summary: Number of file handles increases indefinitely in producer if broker host is unresolvable Key: KAFKA-1041 URL: https://issues.apache.org/jira/browse/KAFKA-1041

[jira] [Commented] (KAFKA-133) Publish kafka jar to a public maven repository

[ https://issues.apache.org/jira/browse/KAFKA-133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13560026#comment-13560026 ] Rajasekar Elango commented on KAFKA-133: [~charmalloc] Are we expecting 0

[jira] [Comment Edited] (KAFKA-133) Publish kafka jar to a public maven repository

[ https://issues.apache.org/jira/browse/KAFKA-133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13560026#comment-13560026 ] Rajasekar Elango edited comment on KAFKA-133 at 1/22/13 9:1