Re: [DISCUSS] Parquet/Iceberg adding new interval types & Arrow compatibility

2025-06-21 Thread David Li
months component? > > On Sat, Jun 21, 2025 at 12:58 PM David Li wrote: > >> Hello Arrow devs, >> >> There's an ongoing discussion in Iceberg [1] and Parquet [2] to define and >> standardize new interval types. Of course, it would be ideal if these new >>

[DISCUSS] Parquet/Iceberg adding new interval types & Arrow compatibility

2025-06-21 Thread David Li
Hello Arrow devs, There's an ongoing discussion in Iceberg [1] and Parquet [2] to define and standardize new interval types. Of course, it would be ideal if these new types had a canonical representation in Arrow. While YEAR_MONTH is the same as Arrow's month interval, however, DAY_TIME is actu

Re: [DISCUSS] Monorepo maintenance - closing stale issues and PRs

2025-06-21 Thread David Li
Thanks for working on this Nic! Does it make sense to have a 'never stale' label too? For instance for the JSON schema format request, I think it reoccurs periodically and I don't want people to get the impression that we've forbidden it just because it got auto-closed after some inactivity, it

Re: [DISCUSS] Monorepo maintenance - closing stale issues and PRs

2025-06-21 Thread David Li
; this. > > > > On Sat, 21 Jun 2025 at 12:33, David Li wrote: > >> Thanks for working on this Nic! >> >> Does it make sense to have a 'never stale' label too? For instance for the >> JSON schema format request, I think it reoccurs periodically and I d

Re: [VOTE][Go] Release Apache Arrow Go 18.3.1 RC0

2025-06-17 Thread David Li
+1 (binding) Tested on Ubuntu 25.04/amd64 On Wed, Jun 18, 2025, at 06:17, Matt Topol wrote: > Hi, > > As requested by a community member[1], I would like to propose the > following release candidate (RC0) of Apache Arrow Go version 18.3.1. > > This release candidate is based on commit: > a9420414

Re: [VOTE][Java] Release Apache Arrow Java 18.3.0 RC2

2025-05-10 Thread David Li
+1 (binding) Tested on Ubuntu 25.04/Java 24 On Sat, May 10, 2025, at 21:49, Gang Wu wrote: > Hi, > > I would like to propose the following release candidate (RC2) of > Apache Arrow Java version 18.3.0. > > This release candidate is based on commit: > 8e84e4c8bbe041f362690e4ea54280ec682dbb1f [1] >

Re: [VOTE] Split JS implementation and Release Process

2025-05-07 Thread David Li
+1 (binding) On Wed, May 7, 2025, at 18:08, Antoine Pitrou wrote: > +1 (binding) > > > Le 07/05/2025 à 10:48, Raúl Cumplido a écrit : >> Hi, >> >> I would like to propose splitting the JS implementation and the >> corresponding release process to its own repository. >> >> Motivation: >> >> * We

Re: Query on stuck Arrow Flight Client while interacting from local workstation (mac)

2025-05-07 Thread David Li
hen the client runs on a local machine irrespective > of the OS (both windows and Mac). We don't see the issue if the same client > code runs in a VM server pointing to the Arrow flight server in another VM > Thanks, > Susmit > > On Sat, May 3, 2025 at 12:17 PM David Li w

Re: [VOTE][Go] Release Apache Arrow Go 18.3.0 RC0

2025-05-06 Thread David Li
+1 (binding) Tested on Ubuntu 25.04/amd64 On Wed, May 7, 2025, at 02:36, Matt Topol wrote: > Hi, > > I would like to propose the following release candidate (RC0) of > Apache Arrow Go version 18.3.0. > > This release candidate is based on commit: > 436b24d6b6a68217984c51adda312bf0af2666cf [1] > >

[ANNOUNCE] Apache Arrow ADBC 18 Released

2025-05-05 Thread David Li
The Apache Arrow community is pleased to announce the a new release of the Apache Arrow ADBC libraries. It includes 28 resolved GitHub issues ([1]). Individual components are versioned separately: some packages are on version 1.6.0 and others are now version 0.18.0, with the release as a whole on v

Re: [RESULT][VOTE] Release Apache Arrow ADBC 18 - RC0

2025-05-05 Thread David Li
36 [4]: Waiting until APT/YUM packages are uploaded. [5]: https://github.com/apache/arrow-adbc/pull/2784 [6]: https://github.com/apache/arrow-site/pull/647 On Tue, May 6, 2025, at 09:36, David Li wrote: > The vote passes with 5 binding +1 votes. Thanks all! > > Binding votes: > - Dewey Dun

[RESULT][VOTE] Release Apache Arrow ADBC 18 - RC0

2025-05-05 Thread David Li
The vote passes with 5 binding +1 votes. Thanks all! Binding votes: - Dewey Dunnington - Jacob Wujciak - Raúl Cumplido - Sutou Kouhei - David Li I will start on the post-release tasks. On Tue, May 6, 2025, at 02:58, Jacob Wujciak wrote: > + 1 (binding) > > I found a minor issue with

Re: [VOTE] Release Apache Arrow ADBC 18 - RC0

2025-05-04 Thread David Li
> > Thanks, > -- > kou > > In <327b44d0-74ee-4c52-9a68-0597d2c7b...@app.fastmail.com> > "[VOTE] Release Apache Arrow ADBC 18 - RC0" on Fri, 02 May 2025 > 20:01:44 +0900, > "David Li" wrote: > >> Hello, >> >> I would like

Re: Query on stuck Arrow Flight Client while interacting from local workstation (mac)

2025-05-02 Thread David Li
ze is None or not isinstance(batch_size, int): > batch_size = 10 > > if isinstance(parquet_data, ds.Dataset): > # If it's a dataset (multiple files), stream dataset > batches using `int_batch_size` > logging.info(

[VOTE] Release Apache Arrow ADBC 18 - RC0

2025-05-02 Thread David Li
Hello, I would like to propose the following release candidate (RC0) of Apache Arrow ADBC version 18. This is a release consisting of 28 resolved GitHub issues [1]. The subcomponents are versioned independently: - C/C++/GLib/Go/Python/Ruby: 1.6.0 - C#: 0.18.0 - Java: 0.18.0 - R: 0.18.0 - Rust:

[RESULT][VOTE] Flight SQL: support remarks field in xDBC column metadata

2025-05-01 Thread David Li
The vote passes with 3 binding +1 votes, 2 non-binding +1 votes. Thanks all! Binding votes: - Antoine Pitrou - Matt Toptol - David Li Non-binding votes: - James Duong - Saurabh Singh On Tue, Apr 29, 2025, at 19:15, David Li wrote: > It's not versioned. Best practice with gRPC/Protob

Re: [VOTE][Format] Extend Flight Location URI Semantics

2025-05-01 Thread David Li
+1 (binding) On Fri, May 2, 2025, at 08:00, Joel Lubinitsky wrote: > +1 (non-binding) > > Thanks for putting this together Matt. > > Joel > > On Thu, May 1, 2025 at 1:39 PM Matt Topol wrote: > >> Hey All, >> >> I would like to propose extending the semantics for Flight RPC >> Location URI message

Re: Query on stuck Arrow Flight Client while interacting from local workstation (mac)

2025-04-30 Thread David Li
This is not specific to Flight; use jstack or your favorite instrumentation tool (VisualVM etc.) On Wed, Apr 30, 2025, at 15:41, NIKHIL RANJAN wrote: > Hi David, > > How to enable thread dump logs for both client and server code. > > As of now, I don't see any error on either client side or serve

Re: [VOTE] Flight SQL: support remarks field in xDBC column metadata

2025-04-29 Thread David Li
fixed schemas is really a backwards-compatible change, too. My vote: +1 (binding) On Tue, Apr 29, 2025, at 17:30, Antoine Pitrou wrote: > Hello, > > +1 from me (binding). > > Side question: is the FlightSQL spec versioned? > > Regards > > Antoine. > > > Le 27/04/

[VOTE] Flight SQL: support remarks field in xDBC column metadata

2025-04-27 Thread David Li
Hello, Mateusz Rzeszutek has proposed adding a "remarks" field in xDBC column metadata in Flight SQL [1]. This better aligns Flight SQL with existing APIs including JDBC and ODBC. Mateusz has provided reference implementations and modified the integration test for C++ [2], Go [3], and Java [4

Re: Query on stuck Arrow Flight Client while interacting from local workstation (mac)

2025-04-24 Thread David Li
Hi Susmit, I don't think I see anything immediately wrong. Do you have a thread dump (server+client) and/or a reproduction that you could share? -David On Thu, Apr 24, 2025, at 18:09, Susmit Sarkar wrote: > Hi Team, > > We are using this below code snippet in Scala to query the flight server,

Re: [PROPOSAL] Apache Arrow Java 19.0.0 release ?

2025-04-19 Thread David Li
+1 Should we call it 18.3 or 19.0? If we’re not tied to the C++ release process anymore I’d like to follow semver if possible On Sun, Apr 20, 2025, at 14:42, Jean-Baptiste Onofré wrote: > Hi folks, > > I propose to submit a new Arrow Java release to vote. > > As discussed previously, I would li

Re: [DISCUSS] Arrow Flight Predicate Pushdown

2025-03-28 Thread David Li
ion in C++ specifically has a lot of downsides. Python service developers are certainly stuck in a rough spot, though. On Fri, Mar 28, 2025, at 18:28, Rusty Conover wrote: > On Thu, Mar 27, 2025 at 12:01 PM David Li wrote: > >> It's not clear to me why (4) doesn't work. Can you spea

Re: [DISCUSS] Arrow Flight Predicate Pushdown

2025-03-27 Thread David Li
It's not clear to me why (4) doesn't work. Can you speak more about the flow of requests here? Putting a ticket inside a FlightDescriptor makes me think something more complicated is going on. Alternatively...just create your own gRPC service, and return whatever payload you need. There's no ne

Re: [ANNOUNCE] New Arrow committer: Matthijs Brobbel (mbrobbel)

2025-03-21 Thread David Li
Congrats Matthijs! On Sat, Mar 22, 2025, at 06:20, Rok Mihevc wrote: > Congratulations Matthijs! > > On Fri, Mar 21, 2025 at 10:06 PM Jacob Wujciak > wrote: > >> Congratulations! 🎉 >> >> Andrew Lamb schrieb am Fr., 21. März 2025, 21:51: >> >> > Hi, >> > >> > On behalf of the Arrow PMC, I'm happy

Re: [VOTE] Enable GitHub Discussions for apache/arrow-*

2025-03-20 Thread David Li
+1 (binding) On Fri, Mar 21, 2025, at 13:55, Sutou Kouhei wrote: > +1 > > In <20250321.134928.178441379595792@clear-code.com> > "[VOTE] Enable GitHub Discussions for apache/arrow-*" on Fri, 21 Mar > 2025 13:49:28 +0900 (JST), > Sutou Kouhei wrote: > >> Hi, >> >> I would like to prop

Re: [ANNOUNCE] New Arrow PMC member: Ian Cook

2025-03-20 Thread David Li
Congrats Ian! On Thu, Mar 20, 2025, at 17:42, Raúl Cumplido wrote: > Congratulations Ian > > El jue, 20 mar 2025, 9:28, Gang Wu escribió: > >> Congrats Ian! >> >> On Thu, Mar 20, 2025 at 4:10 PM Ruoxi Sun wrote: >> >> > Congrats Ian! >> > >> > And my special appreciation for your consistently wo

Re: [ANNOUNCE] New Arrow PMC member: Rok Mihevc

2025-03-19 Thread David Li
Congrats Rok! On Thu, Mar 20, 2025, at 06:09, Fokko Driesprong wrote: > Congrats Rok! > > Op wo 19 mrt 2025 om 22:08 schreef Adam Reeve > >> Congratulations Rok! >> >> On Thu, 20 Mar 2025 at 09:35, Krisztián Szűcs >> wrote: >> >> > Congrats Rok! >> > >> > > On 2025. Mar 19., at 21:32, Jacob Wujc

Re: [DISCUSS] Do we want to enable GitHub Discussions for apache/arrow?

2025-03-17 Thread David Li
I think we could try it for both -java and -adbc. On Tue, Mar 18, 2025, at 15:34, Jean-Baptiste Onofré wrote: > +1 > > Do we want to enable Discussions and Projects on other Arrow repos too > (e.g. arrow-java, etc) ? > > Regards > JB > > On Thu, Mar 13, 2025 at 4:05 AM Sutou Kouhei wrote: >> >> H

Re: [ANNOUNCE] New Arrow PMC member: Jacob Wujciak

2025-03-16 Thread David Li
Congrats Jacob! On Mon, Mar 17, 2025, at 14:39, Ruoxi Sun wrote: > Congratulations Jacob! > > *Regards,* > *Rossi SUN* > > > On Mon, Mar 17, 2025 at 1:26 PM Gang Wu wrote: > >> Congrats Jacob! >> >> On Mon, Mar 17, 2025 at 1:23 PM Sutou Kouhei wrote: >> >> > The Project Management Committee (PMC

Re: [VOTE][Go] Release Apache Arrow Go 18.2.0 RC1

2025-03-13 Thread David Li
+1 (binding) On Thu, Mar 13, 2025, at 18:29, Sutou Kouhei wrote: > +1 (binding) > > I ran the following on Debian GNU/Linux sid: > > dev/release/verify_rc.sh 18.2.0 1 > > with: > > * go version go1.24.0 linux/amd64 > > > Thanks, > -- > kou > > In > "[VOTE][Go] Release Apache Arrow Go 18.2.

Re: [DISCUSS] Arrow Java: add RelWithDebInfo builds support

2025-03-12 Thread David Li
That makes sense to me. 500MB is a bit excessive (well, 94MB also sounds excessive but I suppose that's LLVM). Maybe we can host the separated debug symbols as part of the GitHub release instead? re: runner space, something like this should work [1]. [1]: https://github.com/apache/arrow-adbc/

Re: [VOTE][Go] Release Apache Arrow Go 18.2.0 RC0

2025-03-11 Thread David Li
+1 (binding) Tested on Ubuntu 22.04/x86_64 On Wed, Mar 12, 2025, at 13:09, Dewey Dunnington wrote: > +1 (binding) > > I ran dev/release/verify_rc.sh 18.2.0 0 on go version go1.24.1 darwin/arm64 > > On Tue, Mar 11, 2025 at 3:38 AM Jean-Baptiste Onofré > wrote: > >> +1 (non binding) >> >> Regards

Re: [ANNOUNCE] New Arrow committer: Jean-Baptiste Onofré

2025-03-10 Thread David Li
Congrats JB! Your help has been much appreciated. On Mon, Mar 10, 2025, at 15:03, Sutou Kouhei wrote: > Hi, > > On behalf of the Arrow PMC, I'm happy to announce that > Jean-Baptiste Onofré has accepted an invitation to become a > committer on Apache Arrow. Welcome, and thank you for your > contri

[ANNOUNCE] Apache Arrow ADBC 17 Released

2025-03-07 Thread David Li
The Apache Arrow community is pleased to announce the a new release of the Apache Arrow ADBC libraries. It includes 18 resolved GitHub issues ([1]). Individual components are versioned separately: some packages are on version 1.5.0 and others are now version 0.17.0, with the release as a whole on v

Re: [RESULT][VOTE] Release Apache Arrow ADBC 17 - RC0

2025-03-06 Thread David Li
/pull/35 [3]: https://github.com/apache/arrow-adbc/pull/2583 [4]: https://github.com/apache/arrow-site/pull/615 On Fri, Mar 7, 2025, at 09:49, David Li wrote: > The vote passes with 8 +1 votes (6 binding, 2 non-binding) and no -1 > votes. Thanks all! > > Binding votes: Bryce Mecum, Dewe

[RESULT][VOTE] Release Apache Arrow ADBC 17 - RC0

2025-03-06 Thread David Li
The vote passes with 8 +1 votes (6 binding, 2 non-binding) and no -1 votes. Thanks all! Binding votes: Bryce Mecum, Dewey Dunnington, Matt Topol, Sutou Kouhei, Raúl Cumplido, David Li Non-binding votes: Jacob Wujciak, JB Onofré I'll start on the release tasks. On Wed, Mar 5, 2025, at

Re: [VOTE] Release Apache Arrow ADBC 17 - RC0

2025-03-04 Thread David Li
pi=true"` added to the meson setup build command >> >> On Sun, Mar 2, 2025 at 8:55 PM David Li wrote: >> > >> > Hello, >> > >> > I would like to propose the following release candidate (RC0) of Apache >> Arrow ADBC version 17. This is a relea

[VOTE] Release Apache Arrow ADBC 17 - RC0

2025-03-02 Thread David Li
Hello, I would like to propose the following release candidate (RC0) of Apache Arrow ADBC version 17. This is a release consisting of 18 resolved GitHub issues [1]. The subcomponents are versioned independently: - C/C++/GLib/Go/Python/Ruby: 1.5.0 - C#: 0.17.0 - Java: 0.17.0 - R: 0.17.0 - Rust:

Re: [PROPOSAL] Arrow Java quarter release pace

2025-02-24 Thread David Li
This sounds good to me. We may want to start adding other subprojects there as well? (Nanoarrow, Go, Rust, Julia, ADBC, etc.) On Mon, Feb 24, 2025, at 19:02, Jean-Baptiste Onofré wrote: > Hi folks, > > Following the first 18.2.0 release on arrow-java repository, I would > like to start a discussi

Re: [DISCUSS][Java] Will arrow support overall compression at the FieldVector level in the future, rather than separately compressing each ArrowBuffer within the FieldVector

2025-02-20 Thread David Li
Hi Yunhong, This isn't a Java issue. The spec for Arrow IPC only supports per-buffer compression [1]. It does mention other designs as a potential future improvement there. If you think it might be useful, it could be helpful to sketch a proposal and/or bring some benchmarks? Note that most ve

Re: [VOTE][Java] Release Apache Arrow Java 18.2.0 RC5

2025-02-06 Thread David Li
+1 (binding) Tested on macOS 14/M1 On Fri, Feb 7, 2025, at 09:59, Sutou Kouhei wrote: > +1 (binding) > > I ran the followings on Debian GNU/Linux sid: > > dev/release/verify_rc.sh 18.2.0 5 > > with: > > * openjdk version "21.0.6-ea" 2025-01-21 > > I also verified signature and checksums of bi

Re: [ANNOUNCE] New Arrow PMC member: Bryce Mecum

2025-02-05 Thread David Li
Congrats Bryce!! On Thu, Feb 6, 2025, at 07:58, Rok Mihevc wrote: > Congrats Bryce! > > On Wed, Feb 5, 2025 at 11:10 PM Matt Topol wrote: > >> Congrats Bryce! Well deserved! >> >> On Wed, Feb 5, 2025, 11:04 PM Felipe Oliveira Carvalho < >> felipe...@gmail.com> >> wrote: >> >> > Great news! Congra

Re: [INFO] Arrow 19.0.1 Release Plan

2025-02-01 Thread David Li
AFAIK this should not affect arrow-java since the repos are split and have independent release schedules. On Sat, Feb 1, 2025, at 15:56, Jean-Baptiste Onofré wrote: > Hi Bryce, > > I'm doing a pass on arrow-java (fixing some "legal" issues). > > Regards > JB > > On Fri, Jan 31, 2025 at 10:05 PM

Re: Inquiry on Using RecordBatchStreamWriter/RecordBatchStreamReader for Network Transmission

2025-01-31 Thread David Li
> David - Although it is mentioned that the Arrow Format major version has > not changed till now (how will the upgrade work whenever this change > happens). A *major* version change is extremely unlikely at this point and I don't think we can say how it would work. It would almost certainly be

Re: [ANNOUNCE] New Arrow committer: Ed Seidl (etseidl)

2025-01-29 Thread David Li
Congrats Ed! On Thu, Jan 30, 2025, at 00:29, Ian Cook wrote: > Congratulations Ed! > > On Wed, Jan 29, 2025 at 10:10 AM Rok Mihevc wrote: > >> Congrats Ed! >> >> On Wed, Jan 29, 2025 at 3:11 PM Matt Topol wrote: >> >> > Congrats!! >> > >> > On Wed, Jan 29, 2025, 8:59 AM wish maple wrote: >> > >

Re: [RESULT][VOTE] Release Apache Arrow ADBC 16 - RC3

2025-01-22 Thread David Li
Thank you Dewey! On Thu, Jan 23, 2025, at 00:14, Dewey Dunnington wrote: > Apologies for missing the vote! I submitted all the R packages this morning > :) > > [x] Update R packages > > On Mon, Jan 20, 2025 at 8:31 PM David Li wrote: > >> Post-release tasks: >>

Re: Inquiry on Using RecordBatchStreamWriter/RecordBatchStreamReader for Network Transmission

2025-01-21 Thread David Li
See apache/arrow-experiments [1] where there are many examples in multiple languages of doing just that, and more complicated examples of things like mixing Arrow and JSON data in a stream. (1): Yes, that's the intent of Arrow IPC! (2): I don't think there's anything glaring off the top of my he

Re: [RESULT][VOTE] Release Apache Arrow ADBC 16 - RC3

2025-01-20 Thread David Li
versions [2] [IN PROGRESS] Publish release blog post [3] [1]: https://github.com/conda-forge/arrow-adbc-split-feedstock/pull/32 [2]: https://github.com/apache/arrow-adbc/pull/2470 [3]: https://github.com/apache/arrow-site/pull/581 On Tue, Jan 21, 2025, at 10:16, David Li wrote: > The vote passes wit

[ANNOUNCE] Apache Arrow ADBC 16 Release

2025-01-20 Thread David Li
The Apache Arrow community is pleased to announce the a new release of the Apache Arrow ADBC libraries. It includes 15 resolved GitHub issues ([1]). Individual components are versioned separately: some packages are on version 1.4.0 and others are now version 0.16.0, with the release as a whole on v

[RESULT][VOTE] Release Apache Arrow ADBC 16 - RC3

2025-01-20 Thread David Li
The vote passes with 3 binding +1 votes: Matt Topol, Sutou Kouhei, David Li. Thanks all! I will work on the release tasks next. On Mon, Jan 20, 2025, at 09:52, Sutou Kouhei wrote: > +1 (binding) > > I ran the following on Debian GNU/Linux sid: > > TEST_DEFAULT=0 \ >

Re: [VOTE] Release Apache Arrow ADBC 16 - RC3

2025-01-19 Thread David Li
My vote: +1 (binding) Tested with Conda on Debian 12. On Sat, Jan 18, 2025, at 02:50, Matt Topol wrote: > +1 (binding) > > I ran USE_CONDA=1 ./dev/release/verify-release-candidate.sh 16 3 on Ubuntu > 24.04 > > On Fri, Jan 17, 2025 at 7:07 AM David Li wrote: > >>

[VOTE] Release Apache Arrow ADBC 16 - RC3

2025-01-17 Thread David Li
Hello, Let's try this again... I would like to propose the following release candidate (RC3) of Apache Arrow ADBC version 16. This is a release consisting of 15 resolved GitHub issues [1]. The subcomponents are versioned independently: - C/C++/GLib/Go/Python/Ruby: 1.4.0 - C#: 0.16.0 - Java: 0.

Re: [VOTE] Release Apache Arrow ADBC 16 - RC2

2025-01-16 Thread David Li
roblem I had >> with the previous RC. >> >> El jue, 16 ene 2025 a las 2:31, David Li () escribió: >> >> > Hello, >> > >> > I would like to propose the following release candidate (RC2) of Apache >> > Arrow ADBC version 16. This is a releas

[VOTE] Release Apache Arrow ADBC 16 - RC2

2025-01-15 Thread David Li
Hello, I would like to propose the following release candidate (RC2) of Apache Arrow ADBC version 16. This is a release consisting of 12 resolved GitHub issues [1]. The subcomponents are versioned independently: - C/C++/GLib/Go/Python/Ruby: 1.4.0 - C#: 0.16.0 - Java: 0.16.0 - R: 0.16.0 - Rust:

Re: [VOTE] Release Apache Arrow 19.0.0 - RC0

2025-01-13 Thread David Li
images | grep amazonlinux > amazonlinux2023 > f91c528e6bcb 4 days ago 146MB > > Thanks, > -- > kou > > In <28f68cbd-a598-4835-b245-dd1fcc9ce...@app.fastmail.com> > "Re: [VOTE] Release Apache Arrow 19.0.0 - R

Re: [VOTE] Release Apache Arrow 19.0.0 - RC0

2025-01-13 Thread David Li
I am having some trouble with binary verification [1]: /usr/bin/ld: /usr/lib/gcc/x86_64-amazon-linux/11/../../../../lib64/libarrow-glib.so: undefined reference to `g_once_init_enter_pointer' I didn't save the error, but Ruby/GLib source verification also had some issue with "ruby_errinfo" be

Re: [VOTE] Release Apache Arrow ADBC 16 - RC1

2025-01-12 Thread David Li
gt; > > Thanks, > -- > kou > > In > "[VOTE] Release Apache Arrow ADBC 16 - RC1" on Fri, 10 Jan 2025 > 08:28:15 +0900, > "David Li" wrote: > >> Hello, >> >> I would like to propose the following release candidate (RC1)

Re: [VOTE] Release Apache Arrow ADBC 16 - RC1

2025-01-09 Thread David Li
other RC isn't needed as you can update the asf-site branch > manually. But depending on how easy RCs for adbc are that might be > more work then another RC xD > > Am Fr., 10. Jan. 2025 um 03:55 Uhr schrieb David Li : >> >> Sorry...@eitsupi reminded me there was a depl

Re: [VOTE] Release Apache Arrow ADBC 16 - RC1

2025-01-09 Thread David Li
Sorry...@eitsupi reminded me there was a deployment issue with the R docs that wasn't fixed (BigQuery wasn't being built). The fix for that is now on main; should I cut RC2 so that the fix is included? On Fri, Jan 10, 2025, at 08:28, David Li wrote: > Hello, > > I would

Re: [VOTE][Go] Release Apache Arrow Go 18.1.0 RC0

2025-01-09 Thread David Li
+1 (binding) Tested on Debian 12, x86_64 I had to initialize submodules in my clone (as Matt pointed out to me) before running the script. On Fri, Jan 10, 2025, at 05:37, Matt Topol wrote: > Hi, > > I would like to propose the following release candidate (RC0) of > Apache Arrow Go version 18.1.

[VOTE] Release Apache Arrow ADBC 16 - RC1

2025-01-09 Thread David Li
Hello, I would like to propose the following release candidate (RC1) of Apache Arrow ADBC version 16. This is a release consisting of 7 resolved GitHub issues [1]. The subcomponents are versioned independently: - C/C++/GLib/Go/Python/Ruby: 1.4.0 - C#: 0.16.0 - Java: 0.16.0 - R: 0.16.0 - Rust: 0

Re: [VOTE] Release Apache Arrow ADBC 16 - RC0

2025-01-08 Thread David Li
/2424 > > I'm not sure whether this is a blocker or not... > > > Thanks, > -- > kou > > In <48e0293f-0d76-4efc-b66c-436b40444...@app.fastmail.com> > "[VOTE] Release Apache Arrow ADBC 16 - RC0" on Wed, 08 Jan 2025 > 12:53:30 +0900, > &quo

[VOTE] Release Apache Arrow ADBC 16 - RC0

2025-01-07 Thread David Li
Hello, I would like to propose the following release candidate (RC0) of Apache Arrow ADBC version 16. This is a release consisting of 7 resolved GitHub issues [1]. The subcomponents are versioned independently: - C/C++/GLib/Go/Python/Ruby: 1.4.0 - C#: 0.16.0 - Java: 0.16.0 - R: 0.16.0 - Rust: 0

Re: [VOTE] Apache Arrow array representation of statistics

2024-12-24 Thread David Li
+1 (binding) On Wed, Dec 25, 2024, at 07:21, L. C. Hsieh wrote: > +1 (binding) > > It looks like a useful feature for query systems, especially for the > ones that integrate native, JVM (e.g., Comet) and require statistics > passed across runtimes. > > Thank you. > > On Tue, Dec 24, 2024 at 5:52 A

Re: [DISCUSS] Arrow array representation of statistics

2024-12-11 Thread David Li
I think the feedback is more along the lines of: we can just standardize a representation of statistics, without referencing where it's used (C Data Interface or otherwise). So people are free to use it wherever they want, whether C Data Interface or IPC or somewhere else. At the same time, we a

Re: [VOTE][Julia] Release Apache Arrow Julia 2.8.0 RC2

2024-12-04 Thread David Li
+1 (binding) Tested on Debian 12/x86_64 On Thu, Dec 5, 2024, at 10:05, Sutou Kouhei wrote: > +1 (binding) > > I ran the following command line on Debian GNU/Linux sid: > > VERIFY_FORCE_USE_JULIA_BINARY=1 dev/release/verify_rc.sh 2.8.0 2 > > > Thanks, > -- > kou > > In <20241205.091349.22572094

Re: [ANNOUNCE] New Arrow PMC member: Gang Wu

2024-12-03 Thread David Li
Congrats! On Wed, Dec 4, 2024, at 07:38, Rok Mihevc wrote: > Congrats Wang! > > On Tue, Dec 3, 2024 at 11:22 PM Jacob Wujciak-Jens wrote: > >> Congrats! >> >> Am Di., 3. Dez. 2024 um 23:02 Uhr schrieb Wes McKinney < >> wesmck...@gmail.com>: >> > >> > Congrats! >> > >> > On Tue, Dec 3, 2024 at 3:5

Re: [VOTE][Julia] Release Apache Arrow Julia 2.8.0 RC1

2024-12-03 Thread David Li
+1 (binding) Tested on Debian 12/x86_64 On Tue, Dec 3, 2024, at 16:19, Sutou Kouhei wrote: > Hi, > > I would like to propose the following release candidate (RC1) of > Apache Arrow Julia version 2.8.0. > > This release candidate is based on commit: > 0d3c98c1bd048f42f3666e040c2f363a7dc893c3 [1] >

Re: [RESULT][VOTE] Split Java release process

2024-11-25 Thread David Li
an work on this. :-) >>> >>> >>> Thanks, >>> -- >>> kou >>> >>> >>> In <20241125.113725.1976970563322639422@clear-code.com> >>> "[RESULT][VOTE] Split Java release process" on Mon, 25 No

[ANNOUNCE] New Arrow committer: Laurent Goujon

2024-11-25 Thread David Li
On behalf of the Arrow PMC, I'm happy to announce that Laurent Goujon has accepted an invitation to become a committer on Apache Arrow. Welcome, and thank you for your contributions! -- David

Re: [VOTE] Split Java release process

2024-11-21 Thread David Li
+1 (binding) On Fri, Nov 22, 2024, at 10:47, Sutou Kouhei wrote: > +1 (binding) > > (I replied to wrong thread...) > > In <20241122.103131.536851636597346186@clear-code.com> > "[VOTE] Split Java release process" on Fri, 22 Nov 2024 10:31:31 +0900 > (JST), > Sutou Kouhei wrote: > >> Hi, >

Re: [VOTE] Release Apache Arrow 18.1.0 - RC2

2024-11-20 Thread David Li
+1 (binding) Tested sources on Debian 12/Conda/x86_64 On Wed, Nov 20, 2024, at 22:10, Nic Crane wrote: > +1 (binding) > > On Wed, 20 Nov 2024, 09:46 Raúl Cumplido, wrote: > >> Hi, >> >> Can we get a third PMC to vote on the release to close the vote? >> Please, :) >> >> Thanks, >> Raúl >> >> El

Re: [ANNOUNCE] New Arrow committer: Adam Reeve

2024-11-18 Thread David Li
Welcome & congrats Adam! On Tue, Nov 19, 2024, at 10:21, Ruoxi Sun wrote: > Congratulations Adam! > > *Regards,* > *Rossi SUN* > > > On Tue, Nov 19, 2024 at 9:20 AM Gang Wu wrote: > >> Congrats Adam! >> >> On Tue, Nov 19, 2024 at 9:11 AM Curt Hagenlocher >> wrote: >> >> > Congratulations Adam! >

Re: Query of Arrow Flight SQL with S3 as a storage for parquet files

2024-11-18 Thread David Li
l definitely try out and >>> keep >>> > you folks updated. >>> > >>> > Do you folks believe Duckdb and Datafusion (latter being similar to >>> spark >>> > sql) will be an overkill? >>> > >>> > Thanks, >

Re: [DISCUSS] Split Java release process

2024-11-18 Thread David Li
need to find more maintainers for Arrow Java, but that is true >> regardless of whether the Java implementation stays in the monorepo. >> >> (also, I don't know if David Li would like to be described as >> "Java-focused" :-)) >> >> Regards >

Re: [RESULT][VOTE] Release Apache Arrow ADBC 15 - RC1

2024-11-12 Thread David Li
10:33, David Li wrote: > The vote passes with 4 binding, 2 nonbinding +1 votes. Thanks all! > > Binding: Dewey, Kou, Raúl, David > Non-binding: Bryce, Vibhatha > > I'll begin on the post-release tasks. > > On Tue, Nov 12, 2024, at 20:38, Raúl Cumplido wrote: >> +1

[ANNOUNCE] Apache Arrow ADBC 15 Released

2024-11-12 Thread David Li
The Apache Arrow community is pleased to announce the a new release of the Apache Arrow ADBC libraries. It includes 31 resolved GitHub issues ([1]). Individual components are versioned separately: some packages are on version 1.3.0 and others are now version 0.15.0, with the release as a whole on v

[RESULT][VOTE] Release Apache Arrow ADBC 15 - RC1

2024-11-12 Thread David Li
ssibly a version conflict that only >> resolves in my environment). >> >> [1] https://github.com/apache/arrow-adbc/issues/2311 >> >> On Mon, Nov 11, 2024 at 12:48 AM David Li wrote: >> > >> > +1 (binding) >> > >> > Tested on Debian 12

Re: [VOTE] Release Apache Arrow ADBC 15 - RC1

2024-11-10 Thread David Li
: >> >> * g++ (Debian 13.3.0-2) 13.3.0 >> * go version go1.22.5 linux/amd64 >> * openjdk version "17.0.12-ea" 2024-07-16 >> * Python 3.11.9 >> * Python 3.12.4 >> * ruby 3.1.2p20 (2022-04-12 revision 4491bb740a) [x86_64-linux-gnu] >&g

[VOTE] Release Apache Arrow ADBC 15 - RC1

2024-11-07 Thread David Li
Hello, I would like to propose the following release candidate (RC1) of Apache Arrow ADBC version 15. This is a release consisting of 29 resolved GitHub issues [1]. The subcomponents are versioned independently: - C/C++/GLib/Go/Python/Ruby: 1.3.0 - C#: 0.15.0 - Java: 0.15.0 - R: 0.15.0 - Rust:

Re: Arrow Flight RPC stuck

2024-11-04 Thread David Li
Hi Susmit, Since you submitted a Github issue as well [1] maybe we can consolidate discussion there? [1]: https://github.com/apache/arrow/issues/44560 Best, David On Tue, Oct 29, 2024, at 22:08, Susmit Sarkar wrote: > Hi Team, > > We are writing polyglot sdk wrappers on top of Flight Client, w

Re: [ANNOUNCE] New Arrow PMC member: Curt Hagenlocher

2024-10-30 Thread David Li
Congrats Curt! Thanks for the help with ADBC! On Thu, Oct 31, 2024, at 08:26, Jacob Wujciak-Jens wrote: > Congratulations! > > Am Do., 31. Okt. 2024 um 00:06 Uhr schrieb Neal Richardson < > neal.p.richard...@gmail.com>: > >> Congratulations! >> >> On Wed, Oct 30, 2024 at 6:20 PM Ian Cook wrote: >

Re: [C++][Flight] Status of the ODBC driver PR

2024-10-28 Thread David Li
Thanks for the update JB, that sounds reasonable to me (and then we can finally close out the code donation form). On Mon, Oct 28, 2024, at 23:10, Jean-Baptiste Onofré wrote: > Hi everyone, > > I did a sync-up with James about the Arrow Flight ODBC driver PR > (https://github.com/apache/arrow/pul

Re: [VOTE] Add Async C Data Interface

2024-10-28 Thread David Li
+1 (binding) for me On Sat, Oct 26, 2024, at 10:39, Ian Cook wrote: > Oh ok, thanks Matt, I understand. > > In that case I am +1 on the proposal but I would like to see notes added to > the documentation to make this clearer to readers. I created an issue for > this: https://github.com/apache/arro

Re: Suggestions on deploying Arrow Flight gRPC Server

2024-10-27 Thread David Li
I think that's a bit broad of a question to answer. In general, you are best off following advice meant for gRPC and your particular environment (Kubernetes or otherwise); Flight does not change that aspect of gRPC. If you have specific questions about gRPC vis-a-vis Flight (e.g. how to enable a

Re: [VOTE] Release Apache Arrow 18.0.0 - RC0

2024-10-23 Thread David Li
+1 (binding) I'm having some issue with wheels, but I believe this is just a verification script issue [1]: + python -c 'import pyarrow._s3fs' Traceback (most recent call last): File "", line 1, in ImportError: /tmp/arrow-test/miniforge/envs/conda-wheel-3.9-manylinux_2_28_x86_64/lib/python3.

Re: [ANNOUNCE] New Arrow committer: Rossi Sun

2024-10-22 Thread David Li
Welcome Rossi! On Wed, Oct 23, 2024, at 11:41, wish maple wrote: > Congrats Ruoxi! > > Best, > Xuwei Fu > > Felipe Oliveira Carvalho 于2024年10月23日周三 08:18写道: > >> Great news! Congratulations. >> >> — >> Felipe >> >> On Tue, 22 Oct 2024 at 16:03 Weston Pace wrote: >> >> > On behalf of the Arrow PM

Re: [VOTE][Go] Release Apache Arrow Go 18.0.0 RC0

2024-10-16 Thread David Li
+1 (binding) Tested on Debian bookworm/x86_64 On Thu, Oct 17, 2024, at 10:58, Dewey Dunnington wrote: > +1! (binding) > > I ran `dev/release/verify_rc.sh 18.0.0 0` on MacOS 14.6 (go 1.23.2) > > Cheers, > > -dewey > > On Wed, Oct 16, 2024 at 7:13 PM Sutou Kouhei wrote: >> >> +1 (binding) >> >> I

Re: Query of Arrow Flight SQL with S3 as a storage for parquet files

2024-10-16 Thread David Li
If your clients are sending full SQL queries to be executed, and you need to execute them against S3 on the server, why not consider something like Apache DataFusion or DuckDB to implement that part instead of building the query parser/engine yourself? (There are probably already examples of wra

Re: [VOTE] Release Apache Arrow nanoarrow 0.6.0

2024-10-08 Thread David Li
+1 (binding) Tested with conda-forge, Debian 12, x86_64 On Wed, Oct 9, 2024, at 11:30, Dewey Dunnington wrote: > Hello, > > I would like to propose the following release candidate (rc0) of > Apache Arrow nanoarrow [0] version 0.6.0. This release consists of 114 > resolved GitHub issues from 10 co

Re: [ANNOUNCE] New Arrow committer: Will Ayd

2024-10-05 Thread David Li
Welcome, Will! On Wed, Oct 2, 2024, at 23:25, Gang Wu wrote: > Congrats and welcome! > > Best regards, > Gang > > On Wed, Oct 2, 2024 at 10:16 PM Vibhatha Abeykoon > wrote: > >> Congratulations, Will! >> >> On Wed, Oct 2, 2024 at 3:18 PM Joris Van den Bossche < >> jorisvandenboss...@gmail.com> wr

Re: [EXTERNAL] Re: How to return auth token back to client?

2024-09-16 Thread David Li
row/flight/FlightClient.java#L197 On Tue, Sep 17, 2024, at 10:18, Zhao, Chuan wrote: > Yes, so what’s the easiest way to send user/password to arrow flight > server then get the token back using Java? > > From: David Li > Date: Monday, September 16, 2024 at 5:07 PM > To: Chuan Zhao , dev@

Re: [EXTERNAL] Re: How to return auth token back to client?

2024-09-16 Thread David Li
I think something is getting mixed up here. You are already sending the token back to the client, but it sounds like the actual question is how to extract the token from the client? I don't believe the JDBC driver offers any way to do this currently. On Tue, Sep 17, 2024, at 08:35, Zhao, Chuan

Re: [RESULT][VOTE] Release Apache Arrow ADBC 14 - RC0

2024-09-05 Thread David Li
] Publish release blog post [4] [1]: Rust upload was done by hand this time around [2]: https://github.com/conda-forge/arrow-adbc-split-feedstock/pull/27 [3]: https://github.com/apache/arrow-adbc/pull/2125 [4]: https://github.com/apache/arrow-site/pull/540 On Thu, Sep 5, 2024, at 10:28, David Li wrote

[RESULT][VOTE] Release Apache Arrow ADBC 14 - RC0

2024-09-04 Thread David Li
The vote passes with 4 binding +1 votes, no other votes. Binding votes: - Matt Topol - Raúl Cumplido - Sutou Kouhei - David Li I will begin on the release tasks next. On Thu, Sep 5, 2024, at 03:41, Matt Topol wrote: > My vote: +1 (binding) > > On Mon, Sep 2, 2024 at 10:42 PM Sutou Kouh

Re: [VOTE] Release Apache Arrow ADBC 14 - RC0

2024-09-02 Thread David Li
My vote: +1 (binding) On Fri, Aug 30, 2024, at 19:44, Raúl Cumplido wrote: > +1 (binding) > > Successfully validated release candidate with: > $ USE_CONDA=1 ./dev/release/verify-release-candidate.sh 14 0 > > On Ubuntu 22.04 > > Raúl > > El vie, 30 ago 2024 a

[VOTE] Release Apache Arrow ADBC 14 - RC0

2024-08-29 Thread David Li
Hello, I would like to propose the following release candidate (RC0) of Apache Arrow ADBC version 14. This is a release consisting of 27 resolved GitHub issues [1]. The subcomponents are versioned independently: - C/C++/GLib/Go/Python/Ruby: 1.2.0 - C#: 0.14.0 - Java: 0.14.0 - R: 0.14.0 - Rust:

Re: [VOTE][Julia] Release Apache Arrow Julia 2.7.3 RC1

2024-08-28 Thread David Li
+1 (binding) Tested on Debian Bookworm On Thu, Aug 29, 2024, at 09:15, Sutou Kouhei wrote: > +1 (binding) > > I ran the following command line on Debian GNU/Linux sid: > > VERIFY_FORCE_USE_JULIA_BINARY=1 dev/release/verify_rc.sh 2.7.3 1 > > > Thanks, > -- > kou > > In <20240829.085933.65207404

Re: [VOTE] Split Go release process

2024-08-25 Thread David Li
+1 (binding) On Mon, Aug 26, 2024, at 11:49, Sutou Kouhei wrote: > +1 (binding) > > In <20240826.113702.1496714896073155680@clear-code.com> > "[VOTE] Split Go release process" on Mon, 26 Aug 2024 11:37:02 +0900 (JST), > Sutou Kouhei wrote: > >> Hi, >> >> I would like to propose splitting

  1   2   3   4   5   6   7   8   9   10   >