about Exactly-once Semantics

2017-07-01 Thread fuyou
I read the great blog about kafka Exactly-once Semantics . my question is when consumer receive msg,and process the msg result save to db(eg.MySQL),how to keep Exactly-once Semantics. I think the k

Re: kafka instalation

2017-07-01 Thread Mich Talebzadeh
Hi Elahe, Did you unzip KAFKA binaries and installed it? Have you set up $KAFKA_HOME like below cd $KAFKA_HOME /usr/lib/kafka> ls LICENSE NOTICE bin config libs logs site-docs Can you see directories? What is missing please. HTH, Dr Mich Talebzadeh LinkedIn * https://www.linkedin.c

Re: IllegalStateException with custom state store ..

2017-07-01 Thread Debasish Ghosh
Just to give some more information, the ProcessorContext that gets passed to the init method of the custom store has a null RecordContext. Gave the following debug statement .. println(context.asInstanceOf[ProcessorContextImpl].recordContext) and got null. regards. On Sat, Jul 1, 2017 at 9:41 P

Re: Local state store query for custom store

2017-07-01 Thread Debasish Ghosh
Thanks for the pointer .. I finally figured it out .. Now I am facing another issue with custom state store - sent a different mail on the forum. regards. On Fri, Jun 30, 2017 at 11:12 PM, Damian Guy wrote: > Hi Debasish, > > You can just implement the QueryableStoreType interface. You can take

IllegalStateException with custom state store ..

2017-07-01 Thread Debasish Ghosh
Hi - I have implemented a custom state store named BFStore with a change logger as follows: class BFStoreChangeLogger[K, V](val storeName: String, val context: ProcessorContext, val partition: Int, val

kafka instalation

2017-07-01 Thread Elahe Bagheri
Dear, Recently I used to install kafka on ubuntu server 16.0.4. I installed jdk8 and zookeepr successfully. there was no problem with installing kafka, except that i couldn't see the "" message. I attached the terminal shot. I would be soo appreciated if you could help me to pass it. Cheers and