Re: [Java] [Flight] Questions around DoGet implementations with flow control

2023-03-20 Thread David Li
Yes, that sounds about right to me. I'd like getStream to return Future or something like that, additionally. That way we could free up the RPC handler thread. Metadata would need some work, so possibly ArrowReader isn't the right interface, but something like it. (This is more a sketch of an i

RE: Re: [Java] [Flight] Questions around DoGet implementations with flow control

2023-03-19 Thread Nathaniel Jones
Hi David, Thanks so much for the fast reply, that’s really helpful context. I like the idea you mentioned where the application provides an ArrowReader. Would that story go something like the following? 1. Today in FlightService doGetCustom, a GetListener is passed to producer.getStream - this

Re: [Java] [Flight] Questions around DoGet implementations with flow control

2023-03-12 Thread David Li
Hi Nate, That sounds about right to me (it's been a while since I've dug into gRPC-Java behavior). A better server API is something I've long wanted to consider and haven't had the time to; the current APIs try to let you write blocking/procedural code as much as possible which then does not me

[Java] [Flight] Questions around DoGet implementations with flow control

2023-03-10 Thread Nathaniel Jones
Hello, I'm hoping to check my understanding around various ways to implement a DoGet handler with respect to flow control, and then inquire about potential future API changes. First, I'm aware of 3 ways to respect flow control when implementing a Java server's DoGet that have different characteri