Hi,

I would like to propose ordered data support for Flight RPC.

See the following pull request and discussion for details:

* GH-34852: [C++][Go][Java][FlightRPC] Add support for ordered data
  https://github.com/apache/arrow/pull/35178

  Preview: http://crossbow.voltrondata.com/pr_docs/35178/format/Flight.html

* [DISCUSS][Format][Flight] Ordered data support
  https://lists.apache.org/thread/0q1s84p17rtdz3q81wvylckob1hsx83z

This is based on one of the following proposals:

  [DISCUSS] Flight RPC/Flight SQL/ADBC enhancements
  https://lists.apache.org/thread/247z3t06mf132nocngc1jkp3oqglz7jp

  Google Docs: (Arrow ML) Arrow Flight RPC/Flight SQL Proposals
  
https://docs.google.com/document/d/1jhPyPZSOo2iy0LqIJVUs9KWPyFULVFJXTILDfkadx2g/edit#heading=h.h2ein4otvhtq

Summary:

* Before:
    There is no ordering defined on endpoints or the data
    within.

  After:
    FlightInfo.ordered is added. If FlightInfo.ordered is
    true, this signals there is some order between data from
    different endpoints.

* Motivation: We can optimize a sorted results case by
  FlightInfo.ordered. A client needs to sort by itself even
  when a Flight RPC system returns sorted results without
  FlightInfo.ordered. Because a client can't know whether
  results are sorted or not.

* This proposal does NOT break a backward
  compatibility. Because clients can ignore
  FlightInfo.ordered.

* The pull request includes reference implementations for
  C++, Go and Java.


The vote will be open for at least 72 hours.

[ ] +1 Accept this proposal
[ ] +0
[ ] -1 Do not accept this proposal because...


Thanks,
-- 
kou

Reply via email to