I'll also add that you can write R level code that processes files
lazily chunk-by-chunk
using arrow::open_dataset() |> arrow::map_batches(), and that you can
write
C level code that processes batches chunk-by-chunk using
arrow::open_dataset() |>
nanoarrow::as_nanoarrow_array_stream(), which wi
libarrow (Tomas Kalibera)
--
Message: 1
Date: Tue, 26 Nov 2024 12:10:47 +0100
From: Tomas Kalibera
To: r-package-devel@r-project.org
Subject: Re: [R-pkg-devel] libarrow
Message-ID: <1989b439-df81-4f7e-aee8-718124441...@gmail.com>
Content-Type: text/plain; charset=&qu
The work in progress to add libarrow to MXE is located at [1]. I don't
think it's complete but I'm sharing it here in case it's a useful
starting point for someone. Continuing this work would be welcome.
Thang: Feel free to file an issue on the Arrow issue tracker [2] or
email the user@ mailing li
On 11/26/24 11:18, Pham, T.V. via R-package-devel wrote:
Dear all,
I am planning to use libarrow for reading parquet files, chunk by chunk. It seems that by
installing "arrow", one gets the libarrow library too (at least on Windows).
On Windows, to properly use Apache Arrow with R, it would h
Dear all,
I am planning to use libarrow for reading parquet files, chunk by chunk. It
seems that by installing "arrow", one gets the libarrow library too (at least
on Windows).
I wonder if the C++ header files are already in some package like Rcpp. Also,
how should the link to the libarrow loo
