Re: Questions about checkpointing and Kinesis

2017-02-12 Thread Renato Marroquín Mogrovejo
za.apache.org > Subject: Re: Questions about checkpointing and Kinesis > > Hi all, > > First of all I'd like to say sorry I have gone missing for such a long time > but student life hasn't been easy last year and I have neglected the work > done on this topic. > Anyways, on

Re: Questions about checkpointing and Kinesis

2017-02-10 Thread Chad Greenberg
To: dev@samza.apache.org Subject: Re: Questions about checkpointing and Kinesis Hi all, First of all I'd like to say sorry I have gone missing for such a long time but student life hasn't been easy last year and I have neglected the work done on this topic. Anyways, on [1] is the work d

Re: Questions about checkpointing and Kinesis

2017-02-08 Thread Renato Marroquín Mogrovejo
ould have missed something). What I do not see > > however, is how to retrieve those values upon start-up. Is this the role > of > > the SystemAdmin? Is there any documentation about the use of SystemAdmin? > > > > ____ > > From: Jagadish

Re: Questions about checkpointing and Kinesis

2017-02-07 Thread Boris S
o: dev@samza.apache.org > Subject: Re: Questions about checkpointing and Kinesis > > Great to hear this development on the kinesis consumer! > > Let me answer some of your questions here. > > *1. "Kinesis does not have a listener/push framework (unless I missed > something)&quo

Re: Questions about checkpointing and Kinesis

2017-02-07 Thread Chad Greenberg
SystemAdmin? From: Jagadish Venkatraman Sent: Tuesday, February 7, 2017 1:48:00 AM To: dev@samza.apache.org Subject: Re: Questions about checkpointing and Kinesis Great to hear this development on the kinesis consumer! Let me answer some of your questions here. *1

Re: Questions about checkpointing and Kinesis

2017-02-06 Thread Jagadish Venkatraman
Great to hear this development on the kinesis consumer! Let me answer some of your questions here. *1. "Kinesis does not have a listener/push framework (unless I missed something)"* Let me point out that Kinesis has both a push and a pull based model. You can choose to implement either for your

Questions about checkpointing and Kinesis

2017-02-06 Thread Chad Greenberg
Starting on an integration project between a Kinesis stream and Samza, despite have no background in either, but I am familiar with most other messaging/queuing systems. Decided to keep all state management within Samza instead of using Kinesis' client library. My plan was to use the default K