Re: Samza Throttling clarification

2016-02-05 Thread Benjamin Edwards
Recommend token bukets! Here is a solid implementation: https://github.com/bbeck/token-bucket On Fri, 5 Feb 2016 at 03:33 Jagadish Venkatraman wrote: > Hi Ramesh, > > I understand that you want to limit the calls to the destination service. > Currently, there's no framework level support for thr

Re: Samza Throttling clarification

2016-02-04 Thread Jagadish Venkatraman
Hi Ramesh, I understand that you want to limit the calls to the destination service. Currently, there's no framework level support for throttling in Samza (yet). But, since Samza is single threaded, you can trivially implement some form of throttling by calling Thread.sleep() in the StreamTask.pro

Re: Samza Throttling clarification

2016-02-04 Thread Rick Mangi
Can I ask why you’re using samza and kafka for this? > On Feb 4, 2016, at 7:41 PM, ramesh shanmugam > wrote: > > Hi Team, > > We have use case that destination system accept only 160 messages per > minute. > > Planning to use Samza with Kafka. Looking for out of box throttling feature > but

Samza Throttling clarification

2016-02-04 Thread ramesh shanmugam
Hi Team, We have use case that destination system accept only 160 messages per minute. Planning to use Samza with Kafka. Looking for out of box throttling feature but not able locate in documenttion. Can you please suggest how throttling can be achieved in Samza?. -- Thanks Ramesh