Re: Accessible and Stateful Sink

2018-02-08 Thread Charles Allen
This is very insightful, thank you. I'm going to share it around with a few other key folks to see how viable a query-able indexing process would be using idiomatic Beam stuff. Cheers, Charles Allen On Thu, Feb 8, 2018 at 6:13 PM Lukasz Cwik wrote: > Actually missed one step. For eac

Re: Accessible and Stateful Sink

2018-02-07 Thread Charles Allen
ly something needs to merge a bunch of these incremental things together into larger chunks, and such a data-optimization pass is not clear if it would work on the same framework, or have to be a different one. Thoughts? Charles Allen On Wed, Feb 7, 2018 at 9:37 AM Lukasz Cwik wrote: > There

Accessible and Stateful Sink

2018-02-07 Thread Charles Allen
e something that is desired to be a part of what Beam does, or would it be best outside of Beam? Thank you, Charles Allen

Testing, automation, and pipeline rollout in a CI/CD world

2018-01-02 Thread Charles Allen
ards compatible", or are there any Beam features that help with this? Thanks, Charles Allen