KafkaConsumer.poll() and exceptions

2019-03-27 Thread Mark Anderson
Hi all >From reading the javadoc I've made the assumption that all exceptions thrown by KafkaConsumer.poll() are unrecoverable. What exactly does this mean with regards to the consumer instance itself? Can it be used again in any way e.g. close then call subscribe again? Or do you need to repla

Re: Kafka avro producer

2019-03-27 Thread Valentin
Hi Karishma, you can definitely use Avro without the Confluent schema registry. Just write you own serializer/ deserializer. However , you need to share the avro schema version between your producer and consumer somehow.. and also think about changes on your avro schema. Greets Valentin Von

Re: Kafka avro producer

2019-03-27 Thread Gerard Klijs
Not really possible as the producer assumes you are using the schema registry. You can use avro for the deserialisation in some other way, but you need to create (de)serializers that fit with the other way. Op wo 27 mrt. 2019 om 17:33 schreef lsroudi abdel : > It depend on your use case, you coul

Re: Kafka avro producer

2019-03-27 Thread Navneet Kumar
First ideally we need to provision our schema on cluster statically after that only the put operation can be performed. Dynamic schema provisions is supported in kafka? Not sure.. I guess no On Wed, Mar 27, 2019, 22:03 lsroudi abdel wrote: > It depend on your use case, you could push your schema

Re: Kafka avro producer

2019-03-27 Thread lsroudi abdel
It depend on your use case, you could push your schema with the first message get it on the other side Le mer. 27 mars 2019 à 17:15, KARISHMA MALIK a écrit : > On Wed 27 Mar, 2019, 11:57 AM KARISHMA MALIK, > wrote: > > > Hi Team > > Is there any possible method to use apache Kafka avro producer

Re: Kafka Streams upgrade.from config while upgrading to 2.1.0

2019-03-27 Thread Guozhang Wang
Hello Anirudh, The config `upgrade.from` is recommended for safe and smooth upgrade. In your case it is possible that when rolling bounce the instances the first upgraded instance happen to be the leader of the group and hence even without the config it can recognize other instances; but if you ar

Re: Kafka avro producer

2019-03-27 Thread KARISHMA MALIK
On Wed 27 Mar, 2019, 11:57 AM KARISHMA MALIK, wrote: > Hi Team > Is there any possible method to use apache Kafka avro producer without > using schema registry ? > > Thanks > Karishma > M:7447426338 >