Re: Exceed max.request.size of Kafka

2017-02-23 Thread 舒琦
Hi Jagadish, The 2 methods you provided I had tried already yesterday, then I found using the wrong Exception type, since I change to SamzaException it worked. Thanks for you help and explanation! QiShu > 在 2017年2月23日,23:47,Jagadish Venkatraman 写道: > > Hi QiShu, > > 1. I see the e

Re: Exceed max.request.size of Kafka

2017-02-23 Thread Jagadish Venkatraman
Hi QiShu, 1. I see the exception occurring in your *process* method. It seems that the size of the message you are trying to send is larger than 1M (the maximum kafka message size). You can choose to catch the exception in your process method and move on. Would n't that work for you? {code} pub

Exceed max.request.size of Kafka

2017-02-23 Thread 舒琦
Hi, Sometimes there are huge size of data will occur in our flow, like 2MB, now samza will catch exception and shutdown like belowing.But what I want is I can handle such specific exception and just discard such data and the flow continues. 2017-02-23 16:17:01.949 [main] SamzaContainer