Re: Exposing Kafka Topic to External Parties

Hi Joe, For #2, if brokers and clients trust a certain certificate authority (CA), you should be able to just sign a new certificate with that CA (without having to explicitly share said cert with all parties). - Samuel On Fri, Jun 23, 2017 at 3:10 AM, Joe San wrote: > Dear Kafka Users, > > Wo

NotLeaderForPartitionException -- how to recover?

Hi everyone, Has anyone seen this error and/or is there a good way to recover from it? I have two brokers running, and after attempting to produce to a topic (using the library kafka-python), and they are both spitting out lots of messages that look like this: ERROR [ReplicaFetcherThread-0-1], E

Re: Log retention not working

Is it possible that your log directory is in /tmp/ and your OS is deleting that directory? I know it's happened to me before. - Samuel On Jul 27, 2016 13:43, "David Yu" wrote: > We are using Kafka 0.8.2.0 provided by CDH. Our Kafka retention is set to > default 7 days. One problem we have with

Re: Log retention not working

d, Jul 27, 2016 at 11:38 PM Manikumar Reddy < > manikumar.re...@gmail.com> > wrote: > > > also check if any value set for log.retention.bytes broker config > > > > On Wed, Jul 27, 2016 at 8:03 PM, Samuel Taylor > > wrote: > > > > > Is

Re: Reg: SSL setup

need to import all nodes > certificates to trustore on all machines? > > Can you please provide information on this, if you have worked on this. > > > Thanks, > Bharat > -- *Samuel Taylor* Data Science *Square Root, Inc. <http://square-root.com/>* <http://square-root.com/>Square-Root.com <http://square-root.com/>

Re: New Kafka Connector

Chris, I think you meant to link to https://github.com/wepay/kafka-connect-bigquery :) - Samuel On Mon, Aug 22, 2016 at 4:24 PM, Chris Egerton wrote: > Hi there, > > We've recently open-sourced a BigQuery sink connector and would like to > request that it be added to the Kafka Connector H

Re: Authorization with Topic Wildcards

m.domain.xyz.abc using the same > > user ID and group, I get NOT_AUTHORIZED error. > > > > Anything I am missing? > > > > Thanks, > > Derar > > > -- *Samuel Taylor* Data Science *Square Root, Inc. <http://square-root.com/>* <http://square-root.com/>Square-Root.com <http://square-root.com/>

Kafka Streams Python client?

a Python-specific effort either in Jira or online. Thanks, Samuel -- *Samuel Taylor* Data Science *Square Root, Inc. <http://square-root.com/>* <http://square-root.com/>Square-Root.com <http://square-root.com/>

Re: Kafka Streams Python client?

na > > On Thu, Sep 22, 2016 at 12:45 PM, Samuel Taylor > wrote: > > Hi all, > > > > Is there active development on a Kafka Streams-esque API for Python? I'm > > interested in working on such a project. > > > > Jay Kreps' article "Introdu

Re: [VOTE] Add REST Server to Apache Kafka

not. You can read more >>>> about that in this thread >>>> http://mail-archives.apache.org/mod_mbox/kafka-dev/201610.mb >>>> ox/%3CCAMVt_ >>>> aymqeudm39znsxgktpdde46sowmqhsxop-+jmbcuv7...@mail.gmail.com%3E >>>> >>>>This is a VOTE thread to check interest in the community for >>>> adding REST Server implementation in Apache Kafka. >>>> >>>> Thanks, >>>> Harsha >>>> >>>> >> > -- *Samuel Taylor* Data Science *Square Root, Inc. <http://square-root.com/>* <http://square-root.com/>Square-Root.com <http://square-root.com/>

Re: multiple consumers for a same topic in multiple copies

info from kafka and zookeeper. > > But maybe I'm wrong and it's totally possible in the current model to have > several consumers subscribe independently on a same topic, and consume then > with their own progression markers. If yes, a pointer to any documentation > / examples / disc

Re: Where can we find a compatibility matrix for the different version of kafka producers vs the different version of kafka brokers?

For future reference, new releases typically have an "upgrade" section that talks about compatibility. e.g. http://kafka.apache.org/0101/documentation.html#upgrade On Fri, Nov 18, 2016 at 2:49 PM, Zakee wrote: > No. Newer client API won’t work with older version of broker. Generally, > older cl

Re: 10.1.0 client and 10.0.1 brokers

Yup! "0.10.1.x clients only support 0.10.1.x or later brokers while 0.10.1.x brokers also support older clients" https://kafka.apache.org/documentation.html#upgrade - Samuel On Mon, Dec 12, 2016 at 1:54 PM, Aaron Niskode-Dossett < aniskodedoss...@etsy.com.invalid> wrote: > I'd just like to con

Rename consumer group?

Hi all, Is there a good way to rename a consumer group? My current plan is to stop the existing consumer and seek a new consumer to the same offsets as the existing consumer, but I'd love to hear any suggestions or experiences people have with this! Thanks, Samuel