Re: [VOTE] 0.10.2.1 RC1

2017-04-14 Thread Neha Narkhede
+1 (binding). Verified signatures, ran quickstart and tests. On Fri, Apr 14, 2017 at 3:45 PM Gwen Shapira wrote: > Verified my own signatures, ran quickstart and created few Connectors. > > +1 (binding) > > > On Wed, Apr 12, 2017 at 5:25 PM, Gwen Shapira wrote: > > Hello Kafka users, developers

Re: [VOTE] 0.10.2.1 RC1

2017-04-14 Thread Gwen Shapira
Verified my own signatures, ran quickstart and created few Connectors. +1 (binding) On Wed, Apr 12, 2017 at 5:25 PM, Gwen Shapira wrote: > Hello Kafka users, developers, client-developers, friends, romans, > citizens, etc, > > This is the second candidate for release of Apache Kafka 0.10.2.1. >

Manage offset stored in kafka 0.8.2

2017-04-14 Thread Raman Gupta
Hi, I am using kafka 0.8.2 and storing offsets in kafka. I want to reset all partition offsets to earliest.I know one way to do it using java program. Is there any other way ? Please suggest. Regards, Raman Gupta

Re: [VOTE] 0.10.2.1 RC1

2017-04-14 Thread Vahid S Hashemian
+1 (non-binding) Built from the source and ran the quickstart successfully on Ubuntu, Mac, Windows (64 bit). Thank you Gwen for running the release. --Vahid From: Gwen Shapira To: d...@kafka.apache.org, Users Cc: Alexander Ayars Date: 04/12/2017 05:25 PM Subject:[VOTE]

Re: Version compatibility and flush() in Kafka Producer

2017-04-14 Thread Matthias J. Sax
0.9 clients cannot connect to 0.8 brokers. If you want to upgrade to 0.9, you first need to upgrade your brokers to 0.9 -- your running 0.8 clients will be able to connect to 0.9 brokers. Afterwards, you can update your clients to 0.9, too. Btw: since 0.10.2, clients are backward compatible to 0.

Java stdin producer loosing logs

2017-04-14 Thread Milind Vaidya
Hi Background : I have following set up Apache server >> Apache Kafka Producer >> Apache Kafka Cluster >> Apache Storm As a normal scenario, front end boxes run the apache server and populate the log files. The requirement is to read every log and send it to kafka cluster. The java producer r

Version compatibility and flush() in Kafka Producer

2017-04-14 Thread Milind Vaidya
Is Kafka Producer 0.9.0 compatible with 0.8.* brokers ? I could not conclude to tried it out myself. I tried using that setup, which works, in the sense messages to come through on consumer side. But with new producer I was trying to user flush() call to force sending of messages from the produ

Re: Kafka on windows

2017-04-14 Thread Daniel Hinojosa
Kafka uses Linux OS page cache and flushing techniques as well as in-sync replicas to bring down latency since storing to the hard drive is likely the slowest part. It seems it would be defeating the point if you were to install it on Windows, just like everyone here mentioned. ;) Just wanted to

Re: Kafka on windows

2017-04-14 Thread David Garcia
If you want reduce maintenance headaches, I highly recommend not running brokers on windows (or in vm’s for that matter). It really isn’t supported. Kafka needs highly performant OS primitives. For example, XFS, and ext4 are recommended filesystems for reasons specific to Kafka. If this is j

Re: Python Kafka Client API to support kerberozed secure Kafka cluster?

2017-04-14 Thread Matt Howlett
confluent-kafka-python is built on librdkafka which can do kerberos security. https://github.com/confluentinc/confluent-kafka-python some notes on how to configure it are here: https://github.com/edenhill/librdkafka/wiki/Using-SASL-with-librdkafka On Thu, Apr 13, 2017 at 6:36 PM, Yuxiang Mai

Re: Kafka Streams Application does not start after 10.1 to 10.2 update if topics need to be auto-created

2017-04-14 Thread Dmitry Minkovsky
Thank you Matthias, I am using topic auto-creation just for convenience in development. My plan was to figure out which topics I needed and then create them in an initialization script in production. Auto-creation does make it easier to iterate. At least for me. Good to know this doesn't apply fo