Providing some follow-up on this. I've opened a PR [1] in the arrow repo with the proposed protobuf changes as well as generated go code. A second implementation and integration tests will be forthcoming, but I wanted to get this out there and solicit any feedback that community members might have.
Context on certain details of the implementation can be found in the discussion [2] in the arrow-adbc repo. Thanks, Joel Lubinitsky [1] https://github.com/apache/arrow/pull/38256 [2] https://github.com/apache/arrow-adbc/issues/1107 On Tue, Sep 26, 2023 at 8:09 PM Joel Lubi <joell...@gmail.com> wrote: > Hi devs, > > I would like to open a discussion around adding support for a native > "ingest" command to the Flight SQL specification. The initial motivating > use-case for this is to be able to support ADBC ingest when using the > Flight SQL driver, which is currently not possible because the specific > UPDATE semantics cannot be generalized across all possible Flight SQL > backends. > > Specifically, I am proposing to extend the Flight SQL protobuf > specification with a "CommandStatementIngest" message type. The GH issue > [1] includes a sample message definition for this command. This command > would be included in the FlightDescriptor of a DoPut call to the server, > after which the subsequent FlightData stream could be handled as a single > bulk ingest. > > I would greatly appreciate thoughts and feedback on this proposal. > > Thank you, > Joel Lubinitsky > > [1] https://github.com/apache/arrow-adbc/issues/1107 >
