Re: SystemConsumer questions

2015-12-17 Thread Yi Pan
Hi, Ivan, Sorry to reply late. Could you explain what state that you have to maintain in SystemConsumer, not in KV-store and checkpoint topics? Samza's SystemConsumer is designed as a "pump" to simply pump the messages in to Samza StreamTasks, where the main stateful process is executed. Why and w

SystemConsumer questions

2015-12-10 Thread Ivan.Antipin
Hello, 1) I need stateful SystemConsumer, similar to tasks functionality : https://samza.apache.org/learn/documentation/0.9/container/state-management.html is there some reason why it is not implemented for SystemConsumer? 2) SystemConsumer has *register* method, which receives stream o