Re: Regarding my use case to explore with Samza-

2016-03-01 Thread Manohar Reddy
vent. Please find my inline comments for your question. ~~Manohar -Original Message- From: Navina Ramesh [mailto:nram...@linkedin.com.INVALID] Sent: Wednesday, March 2, 2016 12:42 PM To: dev@samza.apache.org Subject: Re: Regarding my use case to explore with Samza- Hi Manohar, On a

Re: Regarding my use case to explore with Samza-

2016-03-01 Thread Navina Ramesh
Hi Manohar, On a side note regarding your use-case, I have a question. After consuming the DML changes from the kafka topic, why do you have to query back? Are you trying to decorate the event or perform some kind of join? The point I am trying to make is that if you perform a remote lookup with e

Re: Regarding my use case to explore with Samza-

2016-03-01 Thread Jagadish Venkatraman
Please take a look at the hello-world example. You can implement your business logic in the process() callback. What kind of transformation are you doing? Are you doing a group by/count style aggregation to generate the report? If so, you could use the embedded rocksdb store in Samza and potential