[DISCUSS] Big Endian support in Arrow (was: Re: [Java] Supporting Big Endian)

I'm expanding the scope of this thread since it looks like work has also started for making golang support BigEndian architectures. I think as a community we should come to a consensus on whether we want to support Big Endian architectures in general. I don't think it is a good outcome if some im

Re: Creating filesystems that read local files

Actually my workaround (extending LocalFileSystem) does not work since `open` is never called in this case and the path is not normalized to the base directory. On Tue, Aug 25, 2020 at 11:38 AM Weston Pace wrote: > > I created a RelativeFileSystem that extended FileSystem and proxied > calls to a

Creating filesystems that read local files

I created a RelativeFileSystem that extended FileSystem and proxied calls to a LocalFileSystem instance. This filesystem allowed me to specify a base directory and then all paths were resolved relative to that base directory (so fs.open("foo.parquet") became self.target.open("C:\Datadir\foo.parque

Re: Upcoming JS fixes and release timeline

Hi Paul, Is there a github location where I could track this upgrade? I'm interested in using arrow JS in a project that is currently migrating to tsc 3.9, so I am definitely keen on seeing the JS version continue forward. Regards, Naveen Michaud-Agrawal On Wed, Jul 1, 2020 at 12:23 PM Paul Tay

Re: [DISCUSS] Adding a pull-style iterator API to the C data interface

I proposed an API here: https://github.com/apache/arrow/pull/8052 It is not much different from what Wes proposed earlier in the thread, except in error reporting. Comments welcome (here or on the PR). Regards Antoine. Le 16/08/2020 à 21:28, Wes McKinney a écrit : > I opened https://issues

Re: [DataFusion] Proposal to change how UDFs are called in DataFrame API

I think this is a good proposal and I support its implementation, for whatever that is worth On Sun, Aug 23, 2020 at 12:17 PM Jorge Cardoso Leitão < jorgecarlei...@gmail.com> wrote: > Hi, > > I came to a limitation that I would like to propose a resolution to. > > TL;DR; currently, users plan UDF

[NIGHTLY] Arrow Build Report for Job nightly-2020-08-25-0

Arrow Build Report for Job nightly-2020-08-25-0 All tasks: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-08-25-0 Failed Tasks: - conda-osx-clang-py36: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-08-25-0-azure-conda-osx-clang-py36 - cond