Re: Detecting when all the retries are expired for a message

2016-12-07 Thread Rajini Sivaram
> > properties.put("value.serializer",StringSerializer. > > > class.getCanonicalName()); > > > > > > properties.put("acks", "-1"); > > > > > > properties.put("retries&

Re: Detecting when all the retries are expired for a message

2016-12-07 Thread Ismael Juma
uot;, 1); > > > > return new KafkaProducer<>(properties); > > > > } > > > > > > > > private BufferedReader getBufferedReader(String filePath, String > encoding) > > throws UnsupportedEncodingException, FileNotFoundExcepti

Re: Detecting when all the retries are expired for a message

2016-12-07 Thread Ismael Juma
gt; -Original Message- > > From: Mevada, Vatsal > > Sent: 02 December 2016 16:16 > > To: Kafka Users > > Subject: RE: Detecting when all the retries are expired for a message > > > > I executed the same producer code for a single record file wi

Re: Detecting when all the retries are expired for a message

2016-12-07 Thread Rajini Sivaram
t; > > private BufferedReader getBufferedReader(String filePath, String encoding) > throws UnsupportedEncodingException, FileNotFoundException { > > return new BufferedReader(new InputStreamReader(new > FileInputStream(filePath), Optional.ofNullable(encoding). > orElse("UTF-8

RE: Detecting when all the retries are expired for a message

2016-12-06 Thread Mevada, Vatsal
return new BufferedReader(new InputStreamReader(new FileInputStream(filePath), Optional.ofNullable(encoding).orElse("UTF-8"))); } Regards, Vatsal -Original Message- From: Rajini Sivaram [mailto:rajinisiva...@googlemail.com] Sent: 06 December 2016 17:27 T

Re: Detecting when all the retries are expired for a message

2016-12-06 Thread Rajini Sivaram
ng up this thread in case anyone of you have any say on this issue. > > > > Regards, > > Vatsal > > > > -Original Message- > > From: Mevada, Vatsal > > Sent: 02 December 2016 16:16 > > To: Kafka Users > > Subject: RE: Detecting when

Re: Detecting when all the retries are expired for a message

2016-12-06 Thread Asaf Mesika
issue. > > Regards, > Vatsal > > -Original Message- > From: Mevada, Vatsal > Sent: 02 December 2016 16:16 > To: Kafka Users > Subject: RE: Detecting when all the retries are expired for a message > > I executed the same producer c

RE: Detecting when all the retries are expired for a message

2016-12-06 Thread Mevada, Vatsal
Hello, Bumping up this thread in case anyone of you have any say on this issue. Regards, Vatsal -Original Message- From: Mevada, Vatsal Sent: 02 December 2016 16:16 To: Kafka Users Subject: RE: Detecting when all the retries are expired for a message I executed the same producer code

RE: Detecting when all the retries are expired for a message

2016-12-02 Thread Mevada, Vatsal
Or am I missing something in my code? My Kafka version is 0.10.0.1. Regards, Vatsal Am I missing any configuration or -Original Message- From: Ismael Juma [mailto:isma...@gmail.com] Sent: 02 December 2016 13:30 To: Kafka Users Subject: RE: Detecting when all the retries are expired for a

RE: Detecting when all the retries are expired for a message

2016-12-02 Thread Ismael Juma
So I think I should not face > the issue that you are mentioning. I mentioned documentation link of 0.9 by > mistake. > > Regards, > Vatsal > -Original Message- > From: Asaf Mesika [mailto:asaf.mes...@gmail.com] > Sent: 02 December 2016 00:32 > To: Kafka Users &g

RE: Detecting when all the retries are expired for a message

2016-12-01 Thread Mevada, Vatsal
016 00:32 To: Kafka Users Subject: Re: Detecting when all the retries are expired for a message There's a critical bug in that section that has only been fixed in 0.9.0.2 which has not been release yet. Without the fix it doesn't really retry. I forked the kafka repo, applied the fix

Re: Detecting when all the retries are expired for a message

2016-12-01 Thread Asaf Mesika
There's a critical bug in that section that has only been fixed in 0.9.0.2 which has not been release yet. Without the fix it doesn't really retry. I forked the kafka repo, applied the fix, built it and placed it in our own Nexus Maven repository until 0.9.0.2 will be released. https://github.com/

Re: Detecting when all the retries are expired for a message

2016-12-01 Thread Ismael Juma
The callback should give you what you are asking for. Has it not worked as you expect when you tried it? Ismael On Thu, Dec 1, 2016 at 1:22 PM, Mevada, Vatsal wrote: > Hi, > > > > I am reading a file and dumping each record on Kafka. Here is my producer > code: > > > > public void produce(Strin