[RESULT][VOTE] Flight SQL: support remarks field in xDBC column metadata

2025-05-01 Thread David Li
uf is to make > backwards-compatible changes (and add /v2/, etc. endpoints if needed), > but of course the design of Flight makes that a little harder than it > should be. Both ADBC and Flight SQL have the question of whether adding > fields to fixed schemas is really a backwards-co

Re: [VOTE] Flight SQL: support remarks field in xDBC column metadata

2025-04-29 Thread David Li
It's not versioned. Best practice with gRPC/Protobuf is to make backwards-compatible changes (and add /v2/, etc. endpoints if needed), but of course the design of Flight makes that a little harder than it should be. Both ADBC and Flight SQL have the question of whether adding fields to

Re: [VOTE] Flight SQL: support remarks field in xDBC column metadata

2025-04-29 Thread Antoine Pitrou
Hello, +1 from me (binding). Side question: is the FlightSQL spec versioned? Regards Antoine. Le 27/04/2025 à 11:45, David Li a écrit : Hello, Mateusz Rzeszutek has proposed adding a "remarks" field in xDBC column metadata in Flight SQL [1]. This better aligns Flight SQL wit

Re: [VOTE] Flight SQL: support remarks field in xDBC column metadata

2025-04-28 Thread Saurabh Singh
w.apache.org > Subject: Re: [VOTE] Flight SQL: support remarks field in xDBC column > metadata > > +1 (binding) > > On Sun, Apr 27, 2025, 5:49 AM David Li wrote: > > > Hello, > > > > Mateusz Rzeszutek has proposed adding a "remarks" field in xD

Re: [VOTE] Flight SQL: support remarks field in xDBC column metadata

2025-04-27 Thread James Duong
+1 (non-binding) Get Outlook for Android<https://aka.ms/AAb9ysg> From: Matt Topol Sent: Sunday, April 27, 2025 6:21:33 AM To: dev@arrow.apache.org Subject: Re: [VOTE] Flight SQL: support remarks field in xDBC column metadata +1 (binding) On Sun, Apr 27

Re: [VOTE] Flight SQL: support remarks field in xDBC column metadata

2025-04-27 Thread Matt Topol
+1 (binding) On Sun, Apr 27, 2025, 5:49 AM David Li wrote: > Hello, > > Mateusz Rzeszutek has proposed adding a "remarks" field in xDBC column > metadata in Flight SQL [1]. This better aligns Flight SQL with existing > APIs including JDBC and ODBC. > >

[VOTE] Flight SQL: support remarks field in xDBC column metadata

2025-04-27 Thread David Li
Hello, Mateusz Rzeszutek has proposed adding a "remarks" field in xDBC column metadata in Flight SQL [1]. This better aligns Flight SQL with existing APIs including JDBC and ODBC. Mateusz has provided reference implementations and modified the integration test for C++ [2], Go [3]

Re: Query of Arrow Flight SQL with S3 as a storage for parquet files

2024-11-18 Thread David Li
ers, > > We went ahead with duckdb, i have a very basic query, with this setup can > we use Arrow ADBC, to interact with the flight sql server which internally > is a wrapper on top of DuckDB to query the data from s3 and stream back to > client > > For every client request the crede

Re: Query of Arrow Flight SQL with S3 as a storage for parquet files

2024-11-17 Thread Susmit Sarkar
Hi Community Members, We went ahead with duckdb, i have a very basic query, with this setup can we use Arrow ADBC, to interact with the flight sql server which internally is a wrapper on top of DuckDB to query the data from s3 and stream back to client For every client request the credentials i

Re: Query of Arrow Flight SQL with S3 as a storage for parquet files

2024-10-16 Thread Susmit Sarkar
:25 PM Felipe Oliveira Carvalho < > > felipe...@gmail.com> wrote: > > > > > Hi Susmit, > > > > > > For an example of what David Li is proposing, you can take a look at > this > > > project (https://github.com/voltrondata/sqlflite). It'

Re: Query of Arrow Flight SQL with S3 as a storage for parquet files

2024-10-16 Thread Weston Pace
Susmit > > On Wed, Oct 16, 2024 at 8:25 PM Felipe Oliveira Carvalho < > felipe...@gmail.com> wrote: > > > Hi Susmit, > > > > For an example of what David Li is proposing, you can take a look at this > > project (https://github.com/voltrondata/sqlflite

Re: Query of Arrow Flight SQL with S3 as a storage for parquet files

2024-10-16 Thread Susmit Sarkar
wrote: > Hi Susmit, > > For an example of what David Li is proposing, you can take a look at this > project (https://github.com/voltrondata/sqlflite). It's a Flight SQL > server > (in C++ though) that can forward queries to either SQLite or DuckDB. > > -- > Felip

Re: Query of Arrow Flight SQL with S3 as a storage for parquet files

2024-10-16 Thread Felipe Oliveira Carvalho
Hi Susmit, For an example of what David Li is proposing, you can take a look at this project (https://github.com/voltrondata/sqlflite). It's a Flight SQL server (in C++ though) that can forward queries to either SQLite or DuckDB. -- Felipe On Wed, Oct 16, 2024 at 10:22 AM David Li wrote:

Re: Query of Arrow Flight SQL with S3 as a storage for parquet files

2024-10-16 Thread David Li
wrapping both these projects in Flight SQL floating around.) On Wed, Oct 16, 2024, at 21:38, Susmit Sarkar wrote: > Hi Community Members > > > We are planning to build an Arrow flight server on top of data lying in s3. > > > *Detailed Use Case:* > > > The requiremen

Query of Arrow Flight SQL with S3 as a storage for parquet files

2024-10-16 Thread Susmit Sarkar
Hi Community Members We are planning to build an Arrow flight server on top of data lying in s3. *Detailed Use Case:* The requirement is we need to sync data from HDFS to a short term storage S3 is our case. Basically a DataSync Service between cloud storages I have already built the servic

[RESULT][VOTE] Bulk ingestion support for Flight SQL (vote #2)

2024-04-08 Thread David Li
The vote passes with 3 binding, 4 non-binding +1 votes. Thanks Joel! On Sat, Apr 6, 2024, at 17:56, Andrew Lamb wrote: > +1 > > On Sat, Apr 6, 2024 at 3:48 AM wish maple wrote: > >> +1 (non binding) >> >> Best, >> Xuwei Fu >> ulk ingestion support for

Re: [VOTE] Bulk ingestion support for Flight SQL (vote #2)

2024-04-06 Thread Andrew Lamb
+1 On Sat, Apr 6, 2024 at 3:48 AM wish maple wrote: > +1 (non binding) > > Best, > Xuwei Fu > ulk ingestion support for Flight SQL > > David Li 于2024年4月5日周五 16:38写道: > > > Hello, > > > > Joel Lubinitsky has proposed adding bulk ingestion support to A

Re: [VOTE] Bulk ingestion support for Flight SQL (vote #2)

2024-04-06 Thread wish maple
+1 (non binding) Best, Xuwei Fu ulk ingestion support for Flight SQL David Li 于2024年4月5日周五 16:38写道: > Hello, > > Joel Lubinitsky has proposed adding bulk ingestion support to Arrow Flight > SQL [1]. This provides a path for uploading an Arrow dataset to a Flight > SQL serv

Re: [VOTE] Bulk ingestion support for Flight SQL (vote #2)

2024-04-05 Thread Jacob Wujciak
+1 (non-binding) Am Sa., 6. Apr. 2024 um 01:40 Uhr schrieb Sutou Kouhei : > +1 > > In <883d16f7-6221-4e93-a19a-df6d2204c...@app.fastmail.com> > "[VOTE] Bulk ingestion support for Flight SQL (vote #2)" on Fri, 05 Apr > 2024 17:37:57 +0900, > "Davi

Re: [VOTE] Bulk ingestion support for Flight SQL (vote #2)

2024-04-05 Thread Sutou Kouhei
+1 In <883d16f7-6221-4e93-a19a-df6d2204c...@app.fastmail.com> "[VOTE] Bulk ingestion support for Flight SQL (vote #2)" on Fri, 05 Apr 2024 17:37:57 +0900, "David Li" wrote: > Hello, > > Joel Lubinitsky has proposed adding bulk ingestion support to Arrow

Re: [VOTE] Bulk ingestion support for Flight SQL (vote #2)

2024-04-05 Thread Jean-Baptiste Onofré
+1 (non binding) Regards JB On Fri, Apr 5, 2024 at 10:37 AM David Li wrote: > > Hello, > > Joel Lubinitsky has proposed adding bulk ingestion support to Arrow Flight > SQL [1]. This provides a path for uploading an Arrow dataset to a Flight SQL > server to create or append t

Re: [VOTE] Bulk ingestion support for Flight SQL (vote #2)

2024-04-05 Thread Matt Topol
ub.com/apache/arrow/pull/38385 > > Thanks, > Joel > > On Fri, Apr 5, 2024 at 4:38 AM David Li wrote: > > > Hello, > > > > Joel Lubinitsky has proposed adding bulk ingestion support to Arrow > Flight > > SQL [1]. This provides a path for uploading an Ar

Re: [VOTE] Bulk ingestion support for Flight SQL (vote #2)

2024-04-05 Thread Joel Lubinitsky
llo, > > Joel Lubinitsky has proposed adding bulk ingestion support to Arrow Flight > SQL [1]. This provides a path for uploading an Arrow dataset to a Flight > SQL server to create or append to a table, without having to know the > specifics of the SQL or Substrait support

[VOTE] Bulk ingestion support for Flight SQL (vote #2)

2024-04-05 Thread David Li
Hello, Joel Lubinitsky has proposed adding bulk ingestion support to Arrow Flight SQL [1]. This provides a path for uploading an Arrow dataset to a Flight SQL server to create or append to a table, without having to know the specifics of the SQL or Substrait support on the server. The

Re: [Discussion][C++][FlightRPC] What stage to submit a PR for Flight SQL ODBC driver

2024-04-02 Thread Jean-Baptiste Onofré
> > > > and will get back to the community afterwards. > > > > > > > > Regarding paperwork for the Dremio code, thank you Laurent for offering > > > > your help. Please do let us know if there's anything we can do to help > > > > as w

Re: [DISCUSS] Flight SQL Experimental status in docs

2024-03-21 Thread David Li
There's a ticket for it already if anyone would like to help On Thu, Mar 21, 2024, at 12:02, James Duong wrote: > Hi, > > We fairly recently merged a PR to remove the experimental status for > Flight SQL from maven: https://github.com/apache/arrow/pull/39040 > > However o

[DISCUSS] Flight SQL Experimental status in docs

2024-03-21 Thread James Duong
Hi, We fairly recently merged a PR to remove the experimental status for Flight SQL from maven: https://github.com/apache/arrow/pull/39040 However our public documentation still has a warning saying Flight SQL is experimental: https://arrow.apache.org/docs/format/FlightSql.html “Flight SQL is

Re: [Discussion][C++][FlightRPC] What stage to submit a PR for Flight SQL ODBC driver

2024-02-28 Thread Jean-Baptiste Onofré
t; > > > Regarding paperwork for the Dremio code, thank you Laurent for offering > > > your help. Please do let us know if there's anything we can do to help as > > > well. > > > > > > [1]: https://github.com/apache/ignite/tree/master/modules/platforms/cpp > >

Re: [Discussion][C++][FlightRPC] What stage to submit a PR for Flight SQL ODBC driver

2024-02-16 Thread Jean-Baptiste Onofré
l discussing this internally >> > > and will get back to the community afterwards. >> > > >> > > Regarding paperwork for the Dremio code, thank you Laurent for offering >> > > your help. Please do let us know if there's anything we can do to help >> > > as

Re: [Discussion][C++][FlightRPC] What stage to submit a PR for Flight SQL ODBC driver

2024-02-16 Thread Andrew Lamb
the Dremio code, thank you Laurent for > offering your help. Please do let us know if there's anything we can do to > help as well. > > > > > > [1]: > https://github.com/apache/ignite/tree/master/modules/platforms/cpp > > > > >

Re: [Discussion][C++][FlightRPC] What stage to submit a PR for Flight SQL ODBC driver

2024-02-13 Thread Jean-Baptiste Onofré
> > From: Laurent Goujon > > Sent: Friday, December 8, 2023 11:01 AM > > To: dev@arrow.apache.org > > Subject: Re: [Discussion][C++][FlightRPC] What stage to submit a PR for > > Flight SQL ODBC driver > > > > Am I reading the ticket cor

Re: [Discussion][C++][FlightRPC] What stage to submit a PR for Flight SQL ODBC driver

2024-02-07 Thread Jean-Baptiste Onofré
re's anything we can do to help as well. > > [1]: https://github.com/apache/ignite/tree/master/modules/platforms/cpp > > From: Laurent Goujon > Sent: Friday, December 8, 2023 11:01 AM > To: dev@arrow.apache.org > Subject: Re: [Discussion][C++][Flight

Re: [Discussion][C++][FlightRPC] What stage to submit a PR for Flight SQL ODBC driver

2024-01-17 Thread Jean-Baptiste Onofré
Hi David Thanks, I'm preparing the PR and checking legal/ASF aspects in the meantime. I will keep you posted asap. Sorry for the delay, I was busy with a couple of other PRs on Iceberg ;) Regards JB On Wed, Jan 10, 2024 at 4:19 PM David Li wrote: > > I've closed the PMC vote. Once I see the PR

Re: [Discussion][C++][FlightRPC] What stage to submit a PR for Flight SQL ODBC driver

2024-01-10 Thread David Li
I've closed the PMC vote. Once I see the PR to apache/arrow with the license headers attached, I will start the incubator vote to finalize this. On Sat, Jan 6, 2024, at 01:25, Jean-Baptiste Onofré wrote: > Correct. > > Regards > JB > > On Fri, Jan 5, 2024 at 8:02 PM David Li wrote: >> >> My unde

Re: [Discussion][C++][FlightRPC] What stage to submit a PR for Flight SQL ODBC driver

2024-01-05 Thread Jean-Baptiste Onofré
Correct. Regards JB On Fri, Jan 5, 2024 at 8:02 PM David Li wrote: > > My understanding is that if the employment contract for all developers > involved stated that Dremio holds the rights, then only Dremio needs to grant > rights to the ASF. Laurent pointed out that this is how Gandiva was do

Re: [Discussion][C++][FlightRPC] What stage to submit a PR for Flight SQL ODBC driver

2024-01-05 Thread Alina Li
Understood. Thanks for your explanation. Best, Alina

Re: [Discussion][C++][FlightRPC] What stage to submit a PR for Flight SQL ODBC driver

2024-01-05 Thread David Li
My understanding is that if the employment contract for all developers involved stated that Dremio holds the rights, then only Dremio needs to grant rights to the ASF. Laurent pointed out that this is how Gandiva was donated [1]. [1]: https://incubator.apache.org/ip-clearance/arrow-gandiva.html

Re: [Discussion][C++][FlightRPC] What stage to submit a PR for Flight SQL ODBC driver

2024-01-05 Thread Alina Li
Thank you for the update, David. JB / his colleagues would be working on the PR to import the code to Arrow. Regarding ICLAs, I believe Joy and Alex have filled out the ICLA already. Just to confirm, since no individuals hold copyright over the code, ICLAs are no longer required from the contri

Re: [Discussion][C++][FlightRPC] What stage to submit a PR for Flight SQL ODBC driver

2024-01-05 Thread Jean-Baptiste Onofré
Hi I can also help on the PR for code donation (checking some legal aspects at the meantime). Thanks ! Regards JB On Fri, Jan 5, 2024 at 4:42 PM David Li wrote: > > (Apologies if this gets delivered twice; I used the wrong email the first > time around and I _think_ it didn't send as a result.

Re: [Discussion][C++][FlightRPC] What stage to submit a PR for Flight SQL ODBC driver

2024-01-05 Thread David Li
(Apologies if this gets delivered twice; I used the wrong email the first time around and I _think_ it didn't send as a result.) I have updated the IP clearance form. Dremio has informed me that no individuals hold copyright over the code. The Software Grant has been filed. I will start a vote

Re: [Discussion][C++][FlightRPC] What stage to submit a PR for Flight SQL ODBC driver

2023-12-19 Thread Alina Li
Thank you both David and Jean-B, I had informed the contributors to put "arrow" in the notify project field. Please update this thread after you're notified regarding the receival of ICLAs. Thanks, Alina

Re: [Discussion][C++][FlightRPC] What stage to submit a PR for Flight SQL ODBC driver

2023-12-19 Thread Jean-Baptiste Onofré
Hi Arrow should be used (not arrow-pmc). Regards JB On Mon, Dec 18, 2023 at 6:38 PM Alina Li wrote: > > Thanks for the confirmation, David. So, the only optional field they need to > fill in on the ICLA form is the notify project field, and they need to put > "arrow-pmc" in it?

Re: [Discussion][C++][FlightRPC] What stage to submit a PR for Flight SQL ODBC driver

2023-12-18 Thread David Li
Yes, but just "arrow" should be fine. On Mon, Dec 18, 2023, at 12:38, Alina Li wrote: > Thanks for the confirmation, David. So, the only optional field they > need to fill in on the ICLA form is the notify project field, and they > need to put "arrow-pmc" in it?

Re: [Discussion][C++][FlightRPC] What stage to submit a PR for Flight SQL ODBC driver

2023-12-18 Thread Alina Li
Thanks for the confirmation, David. So, the only optional field they need to fill in on the ICLA form is the notify project field, and they need to put "arrow-pmc" in it?

Re: [Discussion][C++][FlightRPC] What stage to submit a PR for Flight SQL ODBC driver

2023-12-15 Thread David Li
You would omit the Apache ID. That is for new committers. On Fri, Dec 15, 2023, at 12:59, Alina Li wrote: > Hi David, thanks for the heads up. I'm still learning about the ICLA > process, so I have some questions. According to Contributor agreements > page [1], I see that an apache id is also ne

Re: [Discussion][C++][FlightRPC] What stage to submit a PR for Flight SQL ODBC driver

2023-12-15 Thread Alina Li
Hi David, thanks for the heads up. I'm still learning about the ICLA process, so I have some questions. According to Contributor agreements page [1], I see that an apache id is also needed if a contributor is submitting ICLA in response to an invitation from a PMC. So, in order for the contribut

Re: [Discussion][C++][FlightRPC] What stage to submit a PR for Flight SQL ODBC driver

2023-12-15 Thread David Li
: >> > > - Alex McRae >> > > - João Victor Huguenin >> > > - "joyc-bq" (I was unable to identify them) >> > > >> > > *it's possible they already have done this, please let me know if that's >> > > the case. &

Re: [Discussion][C++][FlightRPC] What stage to submit a PR for Flight SQL ODBC driver

2023-12-15 Thread Jean-Baptiste Onofré
done this, please let me know if that's > > > the case. > > > > > > These people already have filed an ICLA, either as committers or when we > > > did the JDBC driver donation: > > > - James Duong > > > - Jay Ho > > > - Jose Almeida

Re: [Discussion][C++][FlightRPC] What stage to submit a PR for Flight SQL ODBC driver

2023-12-15 Thread Jean-Baptiste Onofré
> > > > These people already have filed an ICLA, either as committers or when we > > did the JDBC driver donation: > > - James Duong > > - Jay Ho > > - Jose Almeida > > - Rafael Telles > > > > [1]: > > https://svn.apache.org/repos/asf/incubator

Re: [Discussion][C++][FlightRPC] What stage to submit a PR for Flight SQL ODBC driver

2023-12-14 Thread David Li
t;> - James Duong >> - Jay Ho >> - Jose Almeida >> - Rafael Telles >> >> [1]: >> https://svn.apache.org/repos/asf/incubator/public/trunk/content/ip-clearance/arrow-flight-sql-odbc.xml >> [2]: https://www.apache.org/licenses/contributor-agreements.htm

Re: [Discussion][C++][FlightRPC] What stage to submit a PR for Flight SQL ODBC driver

2023-12-14 Thread Laurent Goujon
- Jay Ho > - Jose Almeida > - Rafael Telles > > [1]: > https://svn.apache.org/repos/asf/incubator/public/trunk/content/ip-clearance/arrow-flight-sql-odbc.xml > [2]: https://www.apache.org/licenses/contributor-agreements.html#grants > [3]: https://www.apache.org/licenses/contri

Re: [Discussion][C++][FlightRPC] What stage to submit a PR for Flight SQL ODBC driver

2023-12-14 Thread Alina Li
14, 2023 8:23 AM To: dev@arrow.apache.org Subject: Re: [Discussion][C++][FlightRPC] What stage to submit a PR for Flight SQL ODBC driver Ok, I've started to fill out the paperwork [1]. Dremio will need to fill out a Software Grant [2]. When submitting, please make a note to notify the Ap

Re: [Discussion][C++][FlightRPC] What stage to submit a PR for Flight SQL ODBC driver

2023-12-14 Thread David Li
meida - Rafael Telles [1]: https://svn.apache.org/repos/asf/incubator/public/trunk/content/ip-clearance/arrow-flight-sql-odbc.xml [2]: https://www.apache.org/licenses/contributor-agreements.html#grants [3]: https://www.apache.org/licenses/contributor-agreements.html#clas On Wed, Dec 13, 2023,

Re: [Discussion][C++][FlightRPC] What stage to submit a PR for Flight SQL ODBC driver

2023-12-13 Thread David Li
we can do to help as >> well. >> >> [1]: https://github.com/apache/ignite/tree/master/modules/platforms/cpp >> >> From: Laurent Goujon >> Sent: Friday, December 8, 2023 11:01 AM >> To: dev@arrow.apache.org >> Subject: Re: [Discussion][C++][

Re: [Discussion][C++][FlightRPC] What stage to submit a PR for Flight SQL ODBC driver

2023-12-13 Thread Laurent Goujon
v@arrow.apache.org > Subject: Re: [Discussion][C++][FlightRPC] What stage to submit a PR for > Flight SQL ODBC driver > > Am I reading the ticket correctly that this is also about importing some of > the Dremio code into Arrow project (namely > https://github.com/dremio/flightsql-od

Re: [Discussion][C++][FlightRPC] What stage to submit a PR for Flight SQL ODBC driver

2023-12-12 Thread Alina Li
m/apache/ignite/tree/master/modules/platforms/cpp From: Laurent Goujon Sent: Friday, December 8, 2023 11:01 AM To: dev@arrow.apache.org Subject: Re: [Discussion][C++][FlightRPC] What stage to submit a PR for Flight SQL ODBC driver Am I reading the ticket correct

[VOTE][RESULT] Flight SQL as experimental

2023-12-12 Thread David Li
gt; >> In <5e1c3154-a9f1-499d-be39-82685fefd...@app.fastmail.com> >> "[VOTE] Flight SQL as experimental" on Fri, 08 Dec 2023 14:42:09 -0500, >> "David Li" wrote: >> >> > Let's start a formal vote just so we're on the same page no

Re: [DISCUSS] Flight SQL as experimental

2023-12-11 Thread Daniël Heres
r of the initial pull request which triggered the > discussion. > > > I was focusing first on the comment in Maven pom.xml files which show > up in > > > Maven Central and other places, and which got some people confused > about > > > the state of the drive

Re: [DISCUSS] Flight SQL as experimental

2023-12-11 Thread Jean-Baptiste Onofré
up in > > Maven Central and other places, and which got some people confused about > > the state of the driver/code. IMHO this would apply to the current > > Flight/Flight SQL protocol and code as it is today. Protocol extensions > > should be still deemed experimental if s

Re: [DISCUSS] Flight SQL as experimental

2023-12-11 Thread Jean-Baptiste Onofré
+1 I think Flight SQL is not experimental anymore as it's actually used in production on several players :) Thanks for bringing this, Regards JB On Wed, Dec 6, 2023 at 6:59 PM David Li wrote: > > Flight SQL has been marked 'experimental' since the beginning. Given that

Re: [VOTE] Flight SQL as experimental

2023-12-11 Thread vin jake
+1 (binding) On Sat, Dec 9, 2023 at 7:18 AM Sutou Kouhei wrote: > +1 > > In <5e1c3154-a9f1-499d-be39-82685fefd...@app.fastmail.com> > "[VOTE] Flight SQL as experimental" on Fri, 08 Dec 2023 14:42:09 -0500, > "David Li" wrote: > > > Let&#x

Re: [VOTE] Flight SQL as experimental

2023-12-08 Thread Weston Pace
vote just so we're on the same page now that > we've discussed a few things. > > > > > > I would like to propose we remove 'experimental' from Flight SQL and > make it stable: > > > > > > - Remove the 'experimental' option from

Re: [VOTE] Flight SQL as experimental

2023-12-08 Thread L. C. Hsieh
; > I would like to propose we remove 'experimental' from Flight SQL and make > > it stable: > > > > - Remove the 'experimental' option from the Protobuf definitions (but leave > > the option definition for future additions) > > - Update specific

Re: [VOTE] Flight SQL as experimental

2023-12-08 Thread Andrew Lamb
> On Fri, Dec 8, 2023 at 2:43 PM David Li wrote: > > > > > Let's start a formal vote just so we're on the same page now that we've > > > discussed a few things. > > > > > > I would like to propose we remove 'experimental' from

Re: [VOTE] Flight SQL as experimental

2023-12-08 Thread Sutou Kouhei
+1 In <5e1c3154-a9f1-499d-be39-82685fefd...@app.fastmail.com> "[VOTE] Flight SQL as experimental" on Fri, 08 Dec 2023 14:42:09 -0500, "David Li" wrote: > Let's start a formal vote just so we're on the same page now that we've > discussed a few

Re: [VOTE] Flight SQL as experimental

2023-12-08 Thread Joel Lubinitsky
t; > Let's start a formal vote just so we're on the same page now that we've > > discussed a few things. > > > > I would like to propose we remove 'experimental' from Flight SQL and make > > it stable: > > > > - Remove the 'experi

Re: [VOTE] Flight SQL as experimental

2023-12-08 Thread Aldrin
<<< text/html; charset=utf-8: Unrecognized >>> publicKey - octalene.dev@pm.me - 0x21969656.asc Description: application/pgp-keys signature.asc Description: OpenPGP digital signature

Re: [VOTE] Flight SQL as experimental

2023-12-08 Thread Antoine Pitrou
+1 (binding) Le 08/12/2023 à 20:42, David Li a écrit : Let's start a formal vote just so we're on the same page now that we've discussed a few things. I would like to propose we remove 'experimental' from Flight SQL and make it stable: - Remove the 'experime

Re: [VOTE] Flight SQL as experimental

2023-12-08 Thread Andrew Lamb
start a formal vote just so we're on the same page now that we've > discussed a few things. > > I would like to propose we remove 'experimental' from Flight SQL and make > it stable: > > - Remove the 'experimental' option from the Protobuf definitions (

[VOTE] Flight SQL as experimental

2023-12-08 Thread David Li
Let's start a formal vote just so we're on the same page now that we've discussed a few things. I would like to propose we remove 'experimental' from Flight SQL and make it stable: - Remove the 'experimental' option from the Protobuf definitions (but leav

Re: [Discussion][C++][FlightRPC] What stage to submit a PR for Flight SQL ODBC driver

2023-12-08 Thread Laurent Goujon
t; > [6]: > > > https://github.com/awslabs/amazon-timestream-odbc-driver/blob/main/src/odbc/include/timestream/odbc.h > > > > From: David Li > > Sent: Wednesday, December 6, 2023 6:09 AM > > To: dev@arrow.apache.org > > Subject: Re: [Discussion][C++][F

Re: [DISCUSS] Flight SQL as experimental

2023-12-08 Thread Weston Pace
ote: > > > > > > > >> This applies to mostly existing APIs (e.g. recent additions are > still > > > >> experimental)? Or would it apply to everything going forward? > > > >> > > > >> Thanks, > > > >> Micah &

Re: [DISCUSS] Flight SQL as experimental

2023-12-08 Thread Micah Kornfield
> > discussion. > > > I was focusing first on the comment in Maven pom.xml files which show > up > > in > > > Maven Central and other places, and which got some people confused > about > > > the state of the driver/code. IMHO this would apply to the curr

Re: [DISCUSS] Flight SQL as experimental

2023-12-08 Thread Andrew Lamb
ch got some people confused about > > the state of the driver/code. IMHO this would apply to the current > > Flight/Flight SQL protocol and code as it is today. Protocol extensions > > should be still deemed experimental if still in their incubating phase? > > > > Laur

Re: [Discussion][C++][FlightRPC] What stage to submit a PR for Flight SQL ODBC driver

2023-12-08 Thread David Li
___ > From: David Li > Sent: Wednesday, December 6, 2023 6:09 AM > To: dev@arrow.apache.org > Subject: Re: [Discussion][C++][FlightRPC] What stage to submit a PR for > Flight SQL ODBC driver > > Thanks for the update, Alina. This sounds good, my only question

Re: [DISCUSS] Flight SQL as experimental

2023-12-08 Thread David Li
> I was focusing first on the comment in Maven pom.xml files which show up in > Maven Central and other places, and which got some people confused about > the state of the driver/code. IMHO this would apply to the current > Flight/Flight SQL protocol and code as it is today. Protocol ex

Re: [DISCUSS] Flight SQL as experimental

2023-12-08 Thread Laurent Goujon
light/Flight SQL protocol and code as it is today. Protocol extensions should be still deemed experimental if still in their incubating phase? Laurent On Thu, Dec 7, 2023 at 4:54 PM Micah Kornfield wrote: > This applies to mostly existing APIs (e.g. recent additions are still > experimental

Re: [DISCUSS] Flight SQL as experimental

2023-12-07 Thread Micah Kornfield
This applies to mostly existing APIs (e.g. recent additions are still experimental)? Or would it apply to everything going forward? Thanks, Micah On Thu, Dec 7, 2023 at 2:25 PM David Li wrote: > Yes, we'd update the docs, the Protobuf definitions, and anything else > referring to Fl

Re: [DISCUSS] Flight SQL as experimental

2023-12-07 Thread David Li
Yes, we'd update the docs, the Protobuf definitions, and anything else referring to Flight SQL as experimental. On Thu, Dec 7, 2023, at 17:14, Joel Lubinitsky wrote: > The message types defined in FlightSql.proto are all marked experimental as > well. Would this include changes to a

Re: [DISCUSS] Flight SQL as experimental

2023-12-07 Thread Joel Lubinitsky
databases now. > > > > > > Get Outlook for Android<https://aka.ms/AAb9ysg> > > > > > > From: David Li > > > Sent: Wednesday, December 6, 2023 9:59:54 AM > > > To: dev@arrow.apache.org > > > Subject: [DISCUSS] Flight S

Re: [DISCUSS] Flight SQL as experimental

2023-12-07 Thread Laurent Goujon
s used in a good number of databases now. > > > > Get Outlook for Android<https://aka.ms/AAb9ysg> > > > > From: David Li > > Sent: Wednesday, December 6, 2023 9:59:54 AM > > To: dev@arrow.apache.org > > Subjec

Re: [Discussion][C++][FlightRPC] What stage to submit a PR for Flight SQL ODBC driver

2023-12-07 Thread Alina Li
submit a PR for Flight SQL ODBC driver Thanks for the update, Alina. This sounds good, my only question for the broader community is whether there is enough imported code that we should go through the IP clearance process [1]. It's never been clear to me what exactly the threshold for this i

Re: [DISCUSS] Flight SQL as experimental

2023-12-06 Thread Matt Topol
, December 6, 2023 9:59:54 AM > To: dev@arrow.apache.org > Subject: [DISCUSS] Flight SQL as experimental > > Flight SQL has been marked 'experimental' since the beginning. Given that > it's now used by a few systems for a few years now, should we remove this > qual

Re: [DISCUSS] Flight SQL as experimental

2023-12-06 Thread James Duong
+1 from me. It's used in a good number of databases now. Get Outlook for Android<https://aka.ms/AAb9ysg> From: David Li Sent: Wednesday, December 6, 2023 9:59:54 AM To: dev@arrow.apache.org Subject: [DISCUSS] Flight SQL as experimental Flight S

Re: [DISCUSS] Flight SQL as experimental

2023-12-06 Thread Diego Fernandez
At this point we depend on it heavily :) +1 On Wed, Dec 6, 2023 at 4:06 PM Sutou Kouhei wrote: > +1 > > In <0336b0fb-87d1-4c68-b6dd-727678fe5...@app.fastmail.com> > "[DISCUSS] Flight SQL as experimental" on Wed, 06 Dec 2023 12:59:54 > -0500, > "Davi

Re: [DISCUSS] Flight SQL as experimental

2023-12-06 Thread Sutou Kouhei
+1 In <0336b0fb-87d1-4c68-b6dd-727678fe5...@app.fastmail.com> "[DISCUSS] Flight SQL as experimental" on Wed, 06 Dec 2023 12:59:54 -0500, "David Li" wrote: > Flight SQL has been marked 'experimental' since the beginning. Given that > it'

[DISCUSS] Flight SQL as experimental

2023-12-06 Thread David Li
Flight SQL has been marked 'experimental' since the beginning. Given that it's now used by a few systems for a few years now, should we remove this qualifier? I don't expect us to be making breaking changes anymore. This came up in a GitHub PR: https://github.com/apache/arrow/pull/39040 -David

Re: [Discussion][C++][FlightRPC] What stage to submit a PR for Flight SQL ODBC driver

2023-12-06 Thread David Li
y, > > I wanted to start a discussion regarding the development of Flight SQL > ODBC driver. Regarding the seed usage to my previous email, our initial > plan is that flightsql-odbc will be mostly used as-is other than > changes to conforming to Arrow coding guidelines, and for Amaz

[Discussion][C++][FlightRPC] What stage to submit a PR for Flight SQL ODBC driver

2023-12-05 Thread Alina Li
Hi community, I wanted to start a discussion regarding the development of Flight SQL ODBC driver. Regarding the seed usage to my previous email, our initial plan is that flightsql-odbc will be mostly used as-is other than changes to conforming to Arrow coding guidelines, and for Amazon

Re: [VOTE][FORMAT] Bulk ingestion support for Flight SQL

2023-11-15 Thread David Li
rote: >> > > > For the record, the correct PR link seems to be >> > > > https://github.com/apache/arrow/pull/38385 >> > > > >> > > > >> > > > Le 08/11/2023 à 21:49, David Li a écrit : >> > > >> Hello, >> >

Re: [VOTE][FORMAT] Bulk ingestion support for Flight SQL

2023-11-15 Thread Micah Kornfield
ou wrote: > > > > For the record, the correct PR link seems to be > > > > https://github.com/apache/arrow/pull/38385 > > > > > > > > > > > > Le 08/11/2023 à 21:49, David Li a écrit : > > > >> Hello, > > > >>

Re: [VOTE][FORMAT] Bulk ingestion support for Flight SQL

2023-11-15 Thread Matt Topol
Nov 9, 2023, at 04:36, Antoine Pitrou wrote: > > > For the record, the correct PR link seems to be > > > https://github.com/apache/arrow/pull/38385 > > > > > > > > > Le 08/11/2023 à 21:49, David Li a écrit : > > >> Hello, > > >> &

Re: [VOTE][FORMAT] Bulk ingestion support for Flight SQL

2023-11-15 Thread Jean-Baptiste Onofré
//github.com/apache/arrow/pull/38385 > > > > > > Le 08/11/2023 à 21:49, David Li a écrit : > >> Hello, > >> > >> Joel Lubi has proposed adding bulk ingestion support to Arrow Flight SQL > >> [1]. This provides a path for uploading an Arrow dataset

Re: [VOTE][FORMAT] Bulk ingestion support for Flight SQL

2023-11-15 Thread David Li
>> Joel Lubi has proposed adding bulk ingestion support to Arrow Flight SQL >> [1]. This provides a path for uploading an Arrow dataset to a Flight SQL >> server to create or append to a table, without having to know the specifics >> of the SQL or Substrait support

Re: [VOTE][FORMAT] Bulk ingestion support for Flight SQL

2023-11-09 Thread Antoine Pitrou
For the record, the correct PR link seems to be https://github.com/apache/arrow/pull/38385 Le 08/11/2023 à 21:49, David Li a écrit : Hello, Joel Lubi has proposed adding bulk ingestion support to Arrow Flight SQL [1]. This provides a path for uploading an Arrow dataset to a Flight SQL

[VOTE][FORMAT] Bulk ingestion support for Flight SQL

2023-11-08 Thread David Li
Hello, Joel Lubi has proposed adding bulk ingestion support to Arrow Flight SQL [1]. This provides a path for uploading an Arrow dataset to a Flight SQL server to create or append to a table, without having to know the specifics of the SQL or Substrait support on the server. The functionality

Re: [DISCUSS][Flight SQL] Adding Ingest Support for Flight SQL

2023-10-15 Thread Joel Lubinitsky
Hi devs, > > I would like to open a discussion around adding support for a native > "ingest" command to the Flight SQL specification. The initial motivating > use-case for this is to be able to support ADBC ingest when using the > Flight SQL driver, which is currently

[DISCUSS][Flight SQL] Adding Ingest Support for Flight SQL

2023-09-26 Thread Joel Lubi
Hi devs, I would like to open a discussion around adding support for a native "ingest" command to the Flight SQL specification. The initial motivating use-case for this is to be able to support ADBC ingest when using the Flight SQL driver, which is currently not possible because th

Re: [VOTE] Release Apache Arrow Flight SQL adapter for PostgreSQL 0.1.0 - RC6

2023-09-14 Thread Sutou Kouhei
Hi JB, No problem! Thanks for joining the release vote! It's helpful! Thanks, -- kou In "Re: [VOTE] Release Apache Arrow Flight SQL adapter for PostgreSQL 0.1.0 - RC6" on Thu, 14 Sep 2023 10:50:11 +0200, Jean-Baptiste Onofré wrote: > +1 (non binding) > > Sorr

Re: [VOTE] Release Apache Arrow Flight SQL adapter for PostgreSQL 0.1.0 - RC6

2023-09-14 Thread Jean-Baptiste Onofré
+1 (non binding) Sorry for the late reply (it took me time to review the release). Regards JB On Tue, Sep 12, 2023 at 2:53 AM Sutou Kouhei wrote: > > Hi, > > I would like to propose the following release candidate (RC6) of > Apache Arrow Flight SQL adapter for PostgreSQ

  1   2   3   >