Re: [Proposal] Progress Reporting in Fn API

Hi Robert, Thanks for the amazing write up!, it definitely helps. The design is moving in a direction described in your doc, if not entirely there yet. Regards, Vikas On 22 August 2017 at 11:49, Robert Bradshaw wrote: > I put together https://docs.google.com/document/d/ > 1Dx18qBTvFWNqwLeece

Re: [Proposal] Progress Reporting in Fn API

I put together https://docs.google.com/document/d/1Dx18qBTvFWNqwLeecemOpKfleKzFyeV3Qwh71SHATvY/edit?usp=sharing which explains a bit how I think about progress and might be helpful. On Mon, Aug 21, 2017 at 10:22 AM, Vikas RK wrote: > Hi, > > I have updated the proposal >

Re: [Proposal] Progress Reporting in Fn API

Hi, I have updated the proposal based on the comments received. The major change is that the SDK no longer reports cumulative backlog, but includes more details for each transform itself. This provides a Runner more information about each tra

Re: [Proposal] Progress Reporting in Fn API

This seems really well thought-out. A useful read for anyone interested in Splittable DoFn, too. On Thu, Jul 13, 2017 at 11:34 AM, Vikas RK wrote: > Hi, > > I wanted to share a drafted proposal for Progress Reporting in Fn API. > > https://s.apache.org/beam-fn-api-progress-reporting >

[Proposal] Progress Reporting in Fn API

Hi, I wanted to share a drafted proposal for Progress Reporting in Fn API. https://s.apache.org/beam-fn-api-progress-reporting . Would like to get commen