Thanks Jagdish. I realized that Samza-911 attempted to fix this but was
unclear on the reasons for attempting 30 retries from Samza send() method
when kafka had already retried enough times. In any case that is much
better than 0.9 or 0.10 !
Although, in current master, it appears that the retry l
Heya Gaurav,
Thanks for the diligent observation and walk through. We ran into a similar
issue at LinkedIn and addressed it in SAMZA-911.
I think the 0.10.1 release had this fix.
Thanks
Jagdish
On Friday, July 29, 2016, Gaurav Agarwal wrote:
> More debugging notes and questions:
>
> In Samza
More debugging notes and questions:
In Samza 0.10, the `retries` parameter is honoured and passed to kafka;
however, Samza itself retries sending failed the message in case the
exception is an instance of RetriableException:
```
class KafkaSystemProducer
(exception, loop) => {
if(exception != n
(correction: we are using samza 0.9.0)
On Fri, Jul 29, 2016 at 12:09 PM, Gaurav Agarwal
wrote:
> Hi All,
>
> We are using Samza (0.10.0) in our system and recently ran into a problem
> where due to Kafka broker being unstable for few moments, our samza tasks
> while trying to write message to ka
Hi All,
We are using Samza (0.10.0) in our system and recently ran into a problem
where due to Kafka broker being unstable for few moments, our samza tasks
while trying to write message to kafka got exceptions. After that moment,
they went into a very long retry loop (Integer.MAX times).
The repe
