Re: [VOTE][Go] Release Apache Arrow Go 18.0.0 RC0

2024-10-16 Thread David Li
+1 (binding) Tested on Debian bookworm/x86_64 On Thu, Oct 17, 2024, at 10:58, Dewey Dunnington wrote: > +1! (binding) > > I ran `dev/release/verify_rc.sh 18.0.0 0` on MacOS 14.6 (go 1.23.2) > > Cheers, > > -dewey > > On Wed, Oct 16, 2024 at 7:13 PM Sutou Kouhei wrote: >> >> +1 (binding) >> >> I

Re: [VOTE][Go] Release Apache Arrow Go 18.0.0 RC0

2024-10-16 Thread Dewey Dunnington
+1! (binding) I ran `dev/release/verify_rc.sh 18.0.0 0` on MacOS 14.6 (go 1.23.2) Cheers, -dewey On Wed, Oct 16, 2024 at 7:13 PM Sutou Kouhei wrote: > > +1 (binding) > > I ran the following on Debian GNU/Linux sid: > > dev/release/verify_rc.sh 18.0.0 0 > > with: > > * go version go1.23.1 l

Re: [VOTE][Go] Release Apache Arrow Go 18.0.0 RC0

2024-10-16 Thread Sutou Kouhei
+1 (binding) I ran the following on Debian GNU/Linux sid: dev/release/verify_rc.sh 18.0.0 0 with: * go version go1.23.1 linux/amd64 Thanks, -- kou In "[VOTE][Go] Release Apache Arrow Go 18.0.0 RC0" on Wed, 16 Oct 2024 13:09:11 -0600, Matt Topol wrote: > Hi, > > I would like to

Re: [VOTE][Go] Release Apache Arrow Go 18.0.0 RC0

2024-10-16 Thread Bryce Mecum
+1 (non-binding) Verified on macOS 14.7 aarch64 On Wed, Oct 16, 2024 at 12:10 PM Matt Topol wrote: > > Hi, > > I would like to propose the following release candidate (RC0) of > Apache Arrow Go version 18.0.0. > > This release candidate is based on commit: > c124ae4449d8cb249bb870cd7a3c533f6ca17

[VOTE][Go] Release Apache Arrow Go 18.0.0 RC0

2024-10-16 Thread Matt Topol
Hi, I would like to propose the following release candidate (RC0) of Apache Arrow Go version 18.0.0. This release candidate is based on commit: c124ae4449d8cb249bb870cd7a3c533f6ca17434 [1] The source release rc0 is hosted at [2]. Please download, verify checksums and signatures, run the unit te

Re: Query of Arrow Flight SQL with S3 as a storage for parquet files

2024-10-16 Thread Susmit Sarkar
Thank you, will keep posted in the same thread Regards, Susmit On Wed, Oct 16, 2024 at 9:45 PM Weston Pace wrote: > > Do you folks believe Duckdb and Datafusion (latter being similar to spark > sql) will be an overkill? > > No, I don't believe it would be overkill. > > I also wouldn't compare e

Re: Query of Arrow Flight SQL with S3 as a storage for parquet files

2024-10-16 Thread Weston Pace
> Do you folks believe Duckdb and Datafusion (latter being similar to spark sql) will be an overkill? No, I don't believe it would be overkill. I also wouldn't compare either one to Spark SQL. Spark SQL is meant to be a distributed query engine that typically requires a cluster of some sort to o

Re: Query of Arrow Flight SQL with S3 as a storage for parquet files

2024-10-16 Thread Susmit Sarkar
Thanks David and Felipe for your help, I will definitely try out and keep you folks updated. Do you folks believe Duckdb and Datafusion (latter being similar to spark sql) will be an overkill? Thanks, Susmit On Wed, Oct 16, 2024 at 8:25 PM Felipe Oliveira Carvalho < felipe...@gmail.com> wrote:

Re: Query of Arrow Flight SQL with S3 as a storage for parquet files

2024-10-16 Thread Felipe Oliveira Carvalho
Hi Susmit, For an example of what David Li is proposing, you can take a look at this project (https://github.com/voltrondata/sqlflite). It's a Flight SQL server (in C++ though) that can forward queries to either SQLite or DuckDB. -- Felipe On Wed, Oct 16, 2024 at 10:22 AM David Li wrote: > If

Re: Query of Arrow Flight SQL with S3 as a storage for parquet files

2024-10-16 Thread David Li
If your clients are sending full SQL queries to be executed, and you need to execute them against S3 on the server, why not consider something like Apache DataFusion or DuckDB to implement that part instead of building the query parser/engine yourself? (There are probably already examples of wra

Query of Arrow Flight SQL with S3 as a storage for parquet files

2024-10-16 Thread Susmit Sarkar
Hi Community Members We are planning to build an Arrow flight server on top of data lying in s3. *Detailed Use Case:* The requirement is we need to sync data from HDFS to a short term storage S3 is our case. Basically a DataSync Service between cloud storages I have already built the servic

Re: [VOTE][RUST] Release Apache Arrow Rust Object Store 0.11.1 RC1

2024-10-16 Thread Raphael Taylor-Davies
+1 (binding) Verified on x86_64 GNU/Linux On 15/10/2024 22:40, L. C. Hsieh wrote: +1 (binding) Verified on M3 Mac. Thanks Andrew. On Tue, Oct 15, 2024 at 2:06 PM Andrew Lamb wrote: Hi, I would like to propose a release of Apache Arrow Rust Object Store Implementation, version 0.11.1. Thi