Re: [FlightRPC] Add a "Flight SQL" extension on top of FlightRPC

Hi Tiffany, I was just curious about the status of the FlightSQL proposal. Given that the 4.0.0 development cycle will be concluding soon, it doesn't seem FlightSQL will make it, but is there interest in trying to get it into 5.0.0? Similarly, there was the related effort to expand Flight's auth

Re: [FlightRPC] Add a "Flight SQL" extension on top of FlightRPC

Hi Tiffany, Great! Thanks for the update, I'll take another look today. Best, David On Mon, Feb 8, 2021, at 20:52, Hoi Ling Tiffany Lam wrote: > HI David, > > I will be taking over the work for Flight SQL. Last week, I created a draft > PR to Arrow Main

Re: [FlightRPC] Add a "Flight SQL" extension on top of FlightRPC

HI David, I will be taking over the work for Flight SQL. Last week, I created a draft PR to Arrow Main that addresses the original comments on this PR . It would be amazing if you could take a look at the dr

Re: [FlightRPC] Add a "Flight SQL" extension on top of FlightRPC

Hi Ryan et. al., Following up here- I saw Dremio gave a presentation about this project recently, and also, over the past several months, the authentication work has been proceeding. Given that, what does the status of the Flight SQL project itself look like now? I see there are some unanswered

Re: [FlightRPC] Add a "Flight SQL" extension on top of FlightRPC

Thanks Wes, Apologies for the delay. The next steps which we were going to pursue once the authentication redesign direction was solid included a session concept. The initial proposal we would put forth would likely include these concepts via use of headers. I agree that with sessions and database

Re: [FlightRPC] Add a "Flight SQL" extension on top of FlightRPC

I just reviewed the FlightSQL.proto on https://github.com/ryannicholson/arrow/pull/2. It might be a good idea to document somewhere how some of the various SQL concepts (like sessions) are intended to be handled in Flight (which doesn't have these concepts built in). Does it make sense to have sess

Re: [FlightRPC] Add a "Flight SQL" extension on top of FlightRPC

Sure, I can look at this in the next day or two and will provide feedback. Thanks, Andy. On 9/29/20, 5:54 PM, "Ryan Nicholson" wrote: External email: Use caution opening links or attachments Hello Andy and Wes, Thanks for reaching out. Later this week I have time freeing u

Re: [FlightRPC] Add a "Flight SQL" extension on top of FlightRPC

Hello Andy and Wes, Thanks for reaching out. Later this week I have time freeing up to start on Flight-SQL. Would either of you mind examining the approach in the POC [1] as described in the "Proof of Concept" section of the proposal document [2]? I would certainly be happy to chat about this wi

Re: [FlightRPC] Add a "Flight SQL" extension on top of FlightRPC

I am also interested in helping with this effort. Andy. On Mon, Sep 28, 2020, 1:58 PM Wes McKinney wrote: > hi Ryan, > > I'm interested in enabling this effort to move forward -- is there any > part where feedback or other help could be useful? > > Thanks, > Wes > > On Wed, Sep 2, 2020 at 4:45

Re: [FlightRPC] Add a "Flight SQL" extension on top of FlightRPC

hi Ryan, I'm interested in enabling this effort to move forward -- is there any part where feedback or other help could be useful? Thanks, Wes On Wed, Sep 2, 2020 at 4:45 PM Wes McKinney wrote: > > I haven't been able to scrutinize the details greatly, but I am > supportive of this effort, othe

Re: [FlightRPC] Add a "Flight SQL" extension on top of FlightRPC

I haven't been able to scrutinize the details greatly, but I am supportive of this effort, otherwise we may end up with many database systems and vendors implementing Flight in different ways. It would be nice if there was a built-in SQL client layer that we ship in C++ (and its bindings), Java, an

Re: [FlightRPC] Add a "Flight SQL" extension on top of FlightRPC

Hello everyone, Here is a link to the slides I would like to discuss this morning. Take care, Ryan Nicholson On Tue, Sep 1, 2020 at 4:02 PM Ryan Nicholson wrote: > Thank you to all who have v

Re: [FlightRPC] Add a "Flight SQL" extension on top of FlightRPC

Thank you to all who have viewed and given feedback in the posted material so far. I am working on responses as well as preparing some material which I would like to share for discussion in the sync call tomorrow. I will post the material here ahead of time. Take care, Ryan Nicholson On Mon,

[FlightRPC] Add a "Flight SQL" extension on top of FlightRPC

Hello everyone, I would like to propose the following specification to ease adoption of SQL based clients and backends while leveraging data streams for transporting data. This specification entails a series of protobuf messages to be used in the opaque messaging framework payloads to enable brows