Re: delete topic causing spikes in fetch/metadata requests

2016-10-16 Thread sunil kalva
Hi Can you guys help me with this issue On Oct 12, 2016 10:35 PM, "sunil kalva" wrote: > > We are using kafka 0.8.2.2 (client and server), when ever we delete a > topic we see lot of errors in broker logs like below, and there is also a > spike in fetch/metadata requests.

delete topic causing spikes in fetch/metadata requests

2016-10-12 Thread sunil kalva
We are using kafka 0.8.2.2 (client and server), when ever we delete a topic we see lot of errors in broker logs like below, and there is also a spike in fetch/metadata requests. Can i correlate these errors with topic delete or its a known issue. Since there is spike in metadata requests and fetch

assigning jiras

2016-04-05 Thread sunil kalva
Hi I was trying to assign a jira to myself to start working, but looks like i don't have permission. Can someone give me access. my id: sunilkalva -- SunilKalva

Re: Messages corrupted in kafka

2016-03-29 Thread sunil kalva
re you > able to see some corrupted messages if you produce, say, 10M messages? > > On Wed, Mar 23, 2016 at 9:40 PM, sunil kalva > wrote: > > > I am using java client and kafka 0.8.2, since events are corrupted in > > kafka broker i cant read and replay them again. > &

Re: Messages corrupted in kafka

2016-03-23 Thread sunil kalva
ause the broker actually validate the CRC before it stores the messages > on to the disk. > > Is this problem reproduceable? If so, can you find out the messages that > are corrupted? Also, are you using the Java clients or some other clients? > > Jiangjie (Becket) Qin > > On We

Re: Messages corrupted in kafka

2016-03-23 Thread sunil kalva
can some one help me out here. On Wed, Mar 23, 2016 at 7:36 PM, sunil kalva wrote: > Hi > I am seeing few messages getting corrupted in kafka, It is not happening > frequently and percentage is also very very less (less than 0.1%). > > Basically i am publishing thrift event

Messages corrupted in kafka

2016-03-23 Thread sunil kalva
Hi I am seeing few messages getting corrupted in kafka, It is not happening frequently and percentage is also very very less (less than 0.1%). Basically i am publishing thrift events in byte array format to kafka topics(with out encoding like base64), and i also see more events than i publish (i c

retrieve commit time for messages

2015-12-14 Thread sunil kalva
Hi Is there any way to get the commit timestamp of the messages which are retrieved using kafka consumer API. t SunilKalva

Spooling support for kafka publishers !

2015-08-07 Thread sunil kalva
Hi What are the best practises to achieve spooling support on producer end if the kafka cluster is not reachable or degraded. We are thinking to have wrapper on kafka producer which can spool locally if the producer cant talk to kafka cluster. Problem with this approach is, all web servers which p

New (0.8.2.1) Sync Producer with Batch ?

2015-08-01 Thread sunil kalva
Can i configure new producer api with batch, and send data in batches in synchronous mode ? -- SunilKalva