Kafka Streaming Query

2017-11-06 Thread Ranjit Kumar
Hi, I am using kafka streaming and state store in my application using java but my application logic is taking more time (around 5 ms) to pick up the next packet from que, do to that data is pipe lining in topic que(mean waiting time is increasing to pick the next packet from que). Can you please

kafka streams with multiple threads and state store

2017-11-09 Thread Ranjit Kumar
Hi All, I want to use one state store in all my kafka stream threads in my application, how can i do it. 1. i created one topic (name: test2) with 3 partitions . 2. wrote kafka stream with num.stream.threads = 3 in java code 3. using state store (name: count2) in my application. But state store

Re: kafka streams with multiple threads and state store

2017-11-10 Thread Ranjit Kumar
ds which > is not protected by the library itself (by default single-thread access is > guaranteed on the state stores). > > > Guozhang > > On Thu, Nov 9, 2017 at 2:51 AM, Ranjit Kumar wrote: > > > Hi All, > > > > I want to use one state store in all my kafka str

Fwd: kafka streams with multiple threads and state store

2017-11-12 Thread Ranjit Kumar
Materialized.as(supplier); > builder.globalTable("topic", > materialized.withKeySerde(Serdes.String()).withValueSerde( > Serdes.String())); > > > On Fri, 10 Nov 2017 at 09:24 Ranjit Kumar wrote: > > > Hi Guozhang, > > > > Thanks for the information. > > > > My re

multiple threads calling kafka producer

2017-11-17 Thread Ranjit Kumar
Hi All, I am writing java program with thread pool may be 100 threads and all threads will have kafka producers (org.apache.kafka.clients.producer.ProducerRecord) for the same topic, will their be any problem ? thread-1 ProducerRecord data = new ProducerRecord<>(topic, msg); // s

Re: multiple threads calling kafka producer

2017-11-17 Thread Ranjit Kumar
also will create) Regards, Ranjit On Fri, Nov 17, 2017 at 11:47 PM, M. Manna wrote: > Are you planning to close these at any point? I'm not seeung any close() > calls. > > On 17 Nov 2017 6:09 pm, "Ranjit Kumar" wrote: > > Hi All, > > I am writing java