Re: TS-4523: Add the ability to pause/resume data consumption in the CPP API

2016-06-22 Thread Brian Geffon
Another thought would be to pause via send response headers, it won't pause the incoming data but it will guarantee that the client doesn't see anything until you're done and have done a setOutputComplete() followed by a transaction.resume(). This would allow you to do any kind of long running or a

Re: TS-4523: Add the ability to pause/resume data consumption in the CPP API

2016-06-22 Thread Brian Geffon
Is this analysis some horrifically long running thing that cannot happen in the same thread? That might be the only reason I can think of for needed a pause... Brian On Wednesday, June 22, 2016, Brian Geffon wrote: > I think you might be misunderstanding certain continuation guarantees > you'll

Re: TS-4523: Add the ability to pause/resume data consumption in the CPP API

2016-06-22 Thread Brian Geffon
I think you might be misunderstanding certain continuation guarantees you'll have. First, with transformations you'll never have a content length header because the content length cannot be committed to until the final transformation is complete so it will always happen with chunked transfer encod

Re: TS-4523: Add the ability to pause/resume data consumption in the CPP API

2016-06-21 Thread David Ben Zakai
Hi guys, Thanks for your feedback James, I can expose another method - lets say *void resume(uint ms) *that will schedule it for the user, sounds good? Brian, I want to buffer to a certain limit and when the 'Content-Length' header is missing we can't know the file size, so we'll start buffering

Re: TS-4523: Add the ability to pause/resume data consumption in the CPP API

2016-06-21 Thread Brian Geffon
The thing I'm missing about this, why can't you just keep buffering to the same file while you're doing analysis? I don't see why you need to pause anything? Brian On Friday, June 17, 2016, David Ben Zakai wrote: > Hi all, > > I'd like to suggest an API change in the CPP API Transformation inte

Re: TS-4523: Add the ability to pause/resume data consumption in the CPP API

2016-06-21 Thread James Peach
> On Jun 16, 2016, at 11:43 AM, David Ben Zakai > wrote: > > Hi all, > > I'd like to suggest an API change in the CPP API Transformation interface. > > My own use case is that I'd like to be able to pause the transformation, > handle what I can from the file and release the buffered content b

TS-4523: Add the ability to pause/resume data consumption in the CPP API

2016-06-16 Thread David Ben Zakai
Hi all, I'd like to suggest an API change in the CPP API Transformation interface. My own use case is that I'd like to be able to pause the transformation, handle what I can from the file and release the buffered content before resuming and releasing the rest of the data. Basically what I'm tryin