Avro deserialization

2016-05-29 Thread Rick Mangi
Hello all, I’m trying to use the new schema registry to read avro encoded messages I created with kafka connect as described here: http://docs.confluent.io/3.0.0/schema-registry/docs/serializer-formatter.html The e

Test

2016-05-29 Thread Igor Kravzov
Please someone reply. Not sure if subscribed properly.

Re: Test

2016-05-29 Thread Stephen Powis
Hello! On Sun, May 29, 2016 at 1:02 PM, Igor Kravzov wrote: > Please someone reply. Not sure if subscribed properly. >

Re: Test

2016-05-29 Thread Igor Kravzov
thanks :) On Sun, May 29, 2016 at 2:09 PM, Stephen Powis wrote: > Hello! > > On Sun, May 29, 2016 at 1:02 PM, Igor Kravzov > wrote: > > > Please someone reply. Not sure if subscribed properly. > > >

Re: No more message scenario question

2016-05-29 Thread Tauzell, Dave
If you use keys it might be possible to write a "no more messages" message to each partition. Dave. > On May 29, 2016, at 01:51, David Olsen wrote: > > I understand that the reception of Kafka messages may be out of > order[1][2]. But I have a multiple producers/ consumers scenario where I > wo

Topics, partitions and keys

2016-05-29 Thread Igor Kravzov
Please help me with the subject. In Kafka documentations I found the following: *Kafka only provides a total order over messages within a partition, not between different partitions in a topic. Per-partition ordering combined with the ability to partition data by key is sufficient for most applica

Re: Topics, partitions and keys

2016-05-29 Thread Todd Palino
Answers are in-line below. -Todd On Sun, May 29, 2016 at 3:00 PM, Igor Kravzov wrote: > Please help me with the subject. > In Kafka documentations I found the following: > > *Kafka only provides a total order over messages within a partition, not > between different partitions in a topic. Per-p

Ping kafka broker for healthcheck

2016-05-29 Thread Joe San
Is there any such API on the consumer or the producer that I can use to check for the underlying connection to the kafka brokers from my producer? I need to ping Kafka broker every minute and check if there is a connection available? Any suggestions?

Re: Logs compaction

2016-05-29 Thread Gerard Klijs
Compaction works on same keys, not same messages. So at a configured time it will go through the log and delete al records but the most recent one with the same key. I guess, but I'm not entirely sure the null message get's deleted in the same pass, since it's a null message. So your example would