Re: seeding a stream job

2017-01-19 Thread Fabian Hueske
Hi Jared, I think both approaches should work. The source that integrates the finite batch input and the stream might be more comfortable to use. As you said, the challenge would be to identify the exact point when to switch from one input to the other. One thing to consider when reading finite b

seeding a stream job

2017-01-18 Thread Jared Stehler
I have a use case where I need to start a stream replaying historical data, and then have it continue processing on a live kafka source, and am looking for guidance / best practices for implementation. Basically, I want to start up a new “version” of the stream job, and have it process each ele