Re: Java Arrow Flight Compression

2023-08-24 Thread David Li
I think it may be possible with some upstream work but I don't think you can enable compression for Flight in Java out of the box. If you are interested in just seeing whether compression might help, I'd actually try enabling it at the gRPC layer first [1]. (I haven't tested this, though.) That

Java Arrow Flight Compression

2023-08-24 Thread Nathaniel Jones
Hello, I have a couple questions about using compression in Java Arrow Flight. I'll break it down into 2 parts: whether it's possible and whether it's useful. *1) Is it possible to do in current Java APIs?* * I see that an ArrowMessage has a bodyCompression field that it derives from an ArrowReco

Re: [Discuss][C++] A framework for contextual/implicit/ambient vars

2023-08-24 Thread Weston Pace
In other languages I have seen this called "async local"[1][2][3]. I'm not sure of any C++ implementations. Folly's fibers claim to have fiber-local variables[4] but I can't find the actual code to use them. I can't seem to find reference to the concept in boost's asio or cppcoro. I've also see

[RESULT][VOTE][RUST] Release Apache Arrow Rust 46.0.0 RC1

2023-08-24 Thread Raphael Taylor-Davies
With 3 +1 votes (3 binding) the release is approved The release is available here: https://dist.apache.org/repos/dist/release/arrow/arrow-rs-46.0.0/ It has also been released to crates.io Thank you to everyone who helped verify this release On 21/08/2023 16:40, Raphael Taylor-Davies wrote:

Re: ADBC support for the Rust ecosystem

2023-08-24 Thread Roman Shaposhnik
On Wed, Aug 23, 2023 at 6:31 PM Will Jones wrote: > > Hi Roman, > > Yes, it is still a work in progress and not ready for release. I haven't > had time recently to finish it, so I've left the in-progress PRs there. These are the ones David pointed out, correct? > IIRC they were mostly complete,

Re: [VOTE] Release Apache Arrow ADBC 0.6.0 - RC0

2023-08-24 Thread David Li
My vote: +1 Tested sources, binaries on macOS 13.5/AArch64 On Thu, Aug 24, 2023, at 07:02, Raúl Cumplido wrote: > +1 non-binding > > I did run: > USE_CONDA=1 dev/release/verify-release-candidate.sh 0.6.0 0 > > on Ubuntu 22.04. > > Thanks, > Raúl > > El jue, 24 ago 2023 a las 8:13, Sutou Kouhei ()

Re: [VOTE][Format] Add Utf8View Arrays to Arrow Format

2023-08-24 Thread Antoine Pitrou
+1 on the format additions The implementations will probably need a bit more review back-and-forth. Regards Antoine. Le 28/06/2023 à 21:34, Benjamin Kietzman a écrit : Hello, I'd like to propose adding Utf8View arrays to the arrow format. Previous discussion in [1], columnar format descri

[Discuss][C++] A framework for contextual/implicit/ambient vars

2023-08-24 Thread Antoine Pitrou
Hello, Arrow C++ comes with execution facilities (such as thread pools, async generators...) meant to unlock higher performance by hiding IO latencies and exploiting several CPU cores. These execution facilities also obscure the context in which a task is executed: you cannot simply use loc

Re: [VOTE] Release Apache Arrow ADBC 0.6.0 - RC0

2023-08-24 Thread Raúl Cumplido
+1 non-binding I did run: USE_CONDA=1 dev/release/verify-release-candidate.sh 0.6.0 0 on Ubuntu 22.04. Thanks, Raúl El jue, 24 ago 2023 a las 8:13, Sutou Kouhei () escribió: > > +1 > > I ran the following on Debian GNU/Linux sid: > > JAVA_HOME=/usr/lib/jvm/default-java \ > TEST_PYTHON=0 \

[DataFusion] What should the Python / High Level Interface Look Like?

2023-08-24 Thread Josh Magarick
Ahoy! Recently, there was a request to find people to take a more active role in defining and building a Python interface to DataFusion here: https://github.com/apache/arrow-datafusion-python/issues/440 In response, I've filed the following to get a sense of what's important to people: https://git

Arrow R Package Development Sync Call

2023-08-24 Thread Nic Crane
The fortnightly Arrow R package dev community call is on Thursday 24th August at 16:30 UTC (12:30 ET). Joining instructions are below. Video call link: https://meet.google.com/dbm-ybmv-evb Phone numbers: https://tel.meet/dbm-ybmv-evb?pin=9199558189233 The meeting notes can be found here; please