Hi Phill,

So to understand you want the ability to have a task method executed based on a 
variable timer for each  stored message?

There isn't direct support for that type of processing. One way of getting 
close may be to have your task implement WindowableTask(1) and in the window() 
method look to see if any events are at their wake-up time. It's polling rather 
than event driven but depending on the event frequency you may be able to find 
a window interval which is a good approximation.

Garry

1) http://samza.apache.org/learn/documentation/0.8/api/javadocs/

-----Original Message-----
From: Phill Tomlinson [mailto:philltomlin...@fico.com] 
Sent: 27 March 2015 10:03
To: dev@samza.apache.org
Subject: Execute a Task Periodically rather than through a stream of events

Hi,

I was wondering if it I was possible to execute a Samza task/stream on a 
periodic timer, rather than ingesting from a specific data source?

My use case is if there is a stream that deals with certain events these events 
can store some state in a tasks local database. These events that go into this 
database will be stored and may need to be awoken on a given timer thus need to 
be polled and queried on? Currently I can only envisage doing this with an 
external database and using a an app to poll the database and feed into another 
stream but as a samza has the concept of local datastore this would greatly 
reduce latency and increase throughput if it could reawaken its own events.

Thanks,
Phill

This email and any files transmitted with it are confidential, proprietary and 
intended solely for the individual or entity to whom they are addressed. If you 
have received this email in error please delete it immediately.

-----
No virus found in this message.
Checked by AVG - www.avg.com
Version: 2014.0.4800 / Virus Database: 4311/9392 - Release Date: 03/27/15

Reply via email to