Re: TensorFlow, PyTorch, and manylinux1

I'm reposting my original reply below the current reply (below a dotted line). It was filtered out because I wasn't subscribed to the relevant mailing lists. tl;dr: manylinux2010 looks pretty promising, because CUDA supports CentOS6 (for now). In the meanwhile, I dug into what pyarrow does, and

[jira] [Created] (ARROW-4051) [Gandiva] [GLib] Add support for null literal

Yosuke Shiro created ARROW-4051: --- Summary: [Gandiva] [GLib] Add support for null literal Key: ARROW-4051 URL: https://issues.apache.org/jira/browse/ARROW-4051 Project: Apache Arrow Issue Type:

Re: C++ documentation overhaul

Hi Antoine, I've just got at some point in the documentation build (macos using conda and python 3.7) following the instructions in: arrow/docs/source/python/development.rst So far so good but I had a crash while reading the parquest file (I've opened a jira qithe details https://issues.apache.org

[jira] [Created] (ARROW-4050) core dump on reading parquet file

Antonio Cavallo created ARROW-4050: -- Summary: core dump on reading parquet file Key: ARROW-4050 URL: https://issues.apache.org/jira/browse/ARROW-4050 Project: Apache Arrow Issue Type: Bug

Re: zstd dictionary training

hi Kevin -- this is not supported specifically at the moment AFAIK. Feel free to have a look at the implementation of the zstd interface and propose extensions to expose this functionality Thanks, Wes On Wed, Dec 12, 2018 at 4:05 PM Kevin Butler wrote: > > I'm not sure if this is the right place

Re: Weird symbol resolution error with llvm JIT in gandiva jni

We might have to split up the implementation of Decimal128 into multiple compilation units based on what parts of it are LLVM IR-friendly On Sun, Dec 16, 2018 at 7:04 AM Antoine Pitrou wrote: > > > In other words, see if: > nm --defined-only libgandiva.a | grep _ZNSt8ios_base4InitC1Ev > > output

Re: TensorFlow, PyTorch, and manylinux1

Reposting since I wasn't subscribed to develop...@tensorflow.org. I also didn't see Soumith's response since it didn't come through to dev@arrow.apache.org In response to the non-conforming ABI in the TF and PyTorch wheels, we have attempted to hack around the issue with some elaborate workarounds

Re: TensorFlow, PyTorch, and manylinux1

In response to the non-conforming ABI in the TF and PyTorch wheels, we have attempted to hack around the issue with some elaborate workarounds [1] [2] that have ultimately proved to not work universally. The bottom line is that this is burdening other projects in the Python ecosystem and causing co

[jira] [Created] (ARROW-4049) [C++] Arrow never use glog even though glog is linked.

Kousuke Saruta created ARROW-4049: - Summary: [C++] Arrow never use glog even though glog is linked. Key: ARROW-4049 URL: https://issues.apache.org/jira/browse/ARROW-4049 Project: Apache Arrow

Re: Weird symbol resolution error with llvm JIT in gandiva jni

In other words, see if: nm --defined-only libgandiva.a | grep _ZNSt8ios_base4InitC1Ev outputs anything. Regards Antoine. Le 16/12/2018 à 14:03, Antoine Pitrou a écrit : > > Does the static gandiva lib bundle libstdc++? Otherwise you'll probably > need to load it explicitly in the Java pro

Re: Weird symbol resolution error with llvm JIT in gandiva jni

Does the static gandiva lib bundle libstdc++? Otherwise you'll probably need to load it explicitly in the Java process. Regards Antoine. Le 16/12/2018 à 04:53, Ravindra Pindikura a écrit : > I think this happens if any of the cpp files that are used for IR generation > (clang —emit-llvm) inc

Re: npmjs.com account to release Apache Arrow JavaScript

Hi Paul, Thanks! I've confirmed and enabled 2FA. In "Re: npmjs.com account to release Apache Arrow JavaScript" on Fri, 14 Dec 2018 15:31:33 -0800, Paul Taylor wrote: > Hi Kouhei, > > I've added you as a maintainer of the apache-arrow top level package, > as well as an owner on the @apach