Statefull system consumer

Hi guys In my samza setup I need to create a custom SystemConsumer. Basically I need to source data from some database table but due to Oracle constraints I can’t use DataBus. So I created a consumer who polls database and pushes new changes into stream by extending BlockingEnvelopMap and call

Re: lineage in Samza and tracking processed events

r job send a message to another kafka > topic when it’s done. > > Rick > > > > > On Dec 1, 2015, at 3:44 PM, Anton Polyakov > wrote: > > > > Hi > > > > I am looking at Samza to process some incoming stream of trades. > Processing pipeline is

lineage in Samza and tracking processed events

Hi I am looking at Samza to process some incoming stream of trades. Processing pipeline is a complex DAG where some nodes might create zero to many descendant events. Ultimately they got to the end sink (and now these are completely different events all originated by one source trade) I am loo