[jira] [Created] (ARROW-7424) Cast Decimals to throw error on overflow

2019-12-17 Thread Praveen Kumar (Jira)
Praveen Kumar created ARROW-7424: Summary: Cast Decimals to throw error on overflow Key: ARROW-7424 URL: https://issues.apache.org/jira/browse/ARROW-7424 Project: Apache Arrow Issue Type: Imp

[jira] [Created] (ARROW-7423) Pyarrow ARM install fails from source with no clear error

2019-12-17 Thread Abishek Muthian (Jira)
Abishek Muthian created ARROW-7423: -- Summary: Pyarrow ARM install fails from source with no clear error Key: ARROW-7423 URL: https://issues.apache.org/jira/browse/ARROW-7423 Project: Apache Arrow

[jira] [Created] (ARROW-7422) Improper CPU flags failing pyarrow install in ARM devices

2019-12-17 Thread Abishek Muthian (Jira)
Abishek Muthian created ARROW-7422: -- Summary: Improper CPU flags failing pyarrow install in ARM devices Key: ARROW-7422 URL: https://issues.apache.org/jira/browse/ARROW-7422 Project: Apache Arrow

[jira] [Created] (ARROW-7421) [C++] Support creating SparseCSRMatrix and SparseCSCMatrix from 0d and 1d Tensors

2019-12-17 Thread Kenta Murata (Jira)
Kenta Murata created ARROW-7421: --- Summary: [C++] Support creating SparseCSRMatrix and SparseCSCMatrix from 0d and 1d Tensors Key: ARROW-7421 URL: https://issues.apache.org/jira/browse/ARROW-7421 Project

[jira] [Created] (ARROW-7420) [C++] Migrate internal functions of SparseTensor to Result-returning version

2019-12-17 Thread Kenta Murata (Jira)
Kenta Murata created ARROW-7420: --- Summary: [C++] Migrate internal functions of SparseTensor to Result-returning version Key: ARROW-7420 URL: https://issues.apache.org/jira/browse/ARROW-7420 Project: Apa

[jira] [Created] (ARROW-7419) [Python] Support SparseCSCMatrix

2019-12-17 Thread Kenta Murata (Jira)
Kenta Murata created ARROW-7419: --- Summary: [Python] Support SparseCSCMatrix Key: ARROW-7419 URL: https://issues.apache.org/jira/browse/ARROW-7419 Project: Apache Arrow Issue Type: New Feature

Re: [NIGHTLY] Arrow Build Report for Job nightly-2019-12-16-0

2019-12-17 Thread Sutou Kouhei
Created: https://issues.apache.org/jira/browse/ARROW-7418 In "Re: [NIGHTLY] Arrow Build Report for Job nightly-2019-12-16-0" on Mon, 16 Dec 2019 13:56:56 -0600, Wes McKinney wrote: > The Ubuntu 16.04 failure seems legitimate, is there a JIRA issue? > > https://circleci.com/gh/ursa-labs/cr

[jira] [Created] (ARROW-7418) [C++] Can't build with g++ 5.4.0 on Ubuntu 16.04

2019-12-17 Thread Kouhei Sutou (Jira)
Kouhei Sutou created ARROW-7418: --- Summary: [C++] Can't build with g++ 5.4.0 on Ubuntu 16.04 Key: ARROW-7418 URL: https://issues.apache.org/jira/browse/ARROW-7418 Project: Apache Arrow Issue Typ

[jira] [Created] (ARROW-7417) [C++] Add a docker-compose entry for CUDA 10.1

2019-12-17 Thread Kouhei Sutou (Jira)
Kouhei Sutou created ARROW-7417: --- Summary: [C++] Add a docker-compose entry for CUDA 10.1 Key: ARROW-7417 URL: https://issues.apache.org/jira/browse/ARROW-7417 Project: Apache Arrow Issue Type:

[DISCUSS] C Data Interface, take 2

2019-12-17 Thread Antoine Pitrou
Hello, Following Jacques's feedback, I drafted a new version of the C data interface spec. The spec PR is here: https://github.com/apache/arrow/pull/6040 Direct link to the RST file: https://github.com/apache/arrow/blob/5d8669d371401f9db12326b079e13c0058ba972b/docs/source/format/CDataInterface.

Re: [NIGHTLY] Arrow Build Report for Job nightly-2019-12-17-0

2019-12-17 Thread Neal Richardson
I'm working on the macos-r-autobrew failure, which is related to last week's R 3.6.2 release: https://issues.apache.org/jira/browse/ARROW-7416 On Tue, Dec 17, 2019 at 6:03 AM Crossbow wrote: > > Arrow Build Report for Job nightly-2019-12-17-0 > > All tasks: > https://github.com/ursa-labs/crossbo

[jira] [Created] (ARROW-7416) [R][Nightly] Fix macos-r-autobrew build on R 3.6.2

2019-12-17 Thread Neal Richardson (Jira)
from the failure on 3.6.2: https://dl.bintray.com/ursalabs/arrow-r/logs/bin/macosx/el-capitan/contrib/3.6/20191216-00install.out Here is the log from success on 3.6.0: https://dl.bintray.com/ursalabs/arrow-r/logs/bin/macosx/el-capitan/contrib/3.6/20191217-00install.out On 3.6.2, there’s a longer

[jira] [Created] (ARROW-7415) [C++][Dataset] Implement IpcFormat for sources composed of ipc files

2019-12-17 Thread Ben Kietzman (Jira)
Ben Kietzman created ARROW-7415: --- Summary: [C++][Dataset] Implement IpcFormat for sources composed of ipc files Key: ARROW-7415 URL: https://issues.apache.org/jira/browse/ARROW-7415 Project: Apache Arro

[jira] [Created] (ARROW-7414) [R][Dataset] Add tests for PartitionSchemeDiscovery

2019-12-17 Thread Ben Kietzman (Jira)
Ben Kietzman created ARROW-7414: --- Summary: [R][Dataset] Add tests for PartitionSchemeDiscovery Key: ARROW-7414 URL: https://issues.apache.org/jira/browse/ARROW-7414 Project: Apache Arrow Issue

[jira] [Created] (ARROW-7413) [c

2019-12-17 Thread Ben Kietzman (Jira)
Ben Kietzman created ARROW-7413: --- Summary: [c Key: ARROW-7413 URL: https://issues.apache.org/jira/browse/ARROW-7413 Project: Apache Arrow Issue Type: Improvement Reporter: Ben Kietz

[jira] [Created] (ARROW-7412) [C++][Dataset] Ensure that dataset code is robust to schemas with duplicate field names

2019-12-17 Thread Neal Richardson (Jira)
Neal Richardson created ARROW-7412: -- Summary: [C++][Dataset] Ensure that dataset code is robust to schemas with duplicate field names Key: ARROW-7412 URL: https://issues.apache.org/jira/browse/ARROW-7412

[jira] [Created] (ARROW-7411) [C++][Flight] Incorrect Arrow Flight benchmark output

2019-12-17 Thread Chengxin Ma (Jira)
Chengxin Ma created ARROW-7411: -- Summary: [C++][Flight] Incorrect Arrow Flight benchmark output Key: ARROW-7411 URL: https://issues.apache.org/jira/browse/ARROW-7411 Project: Apache Arrow Issue

[jira] [Created] (ARROW-7410) [C++] [Python] [Doc] Document filesystem APIs

2019-12-17 Thread Antoine Pitrou (Jira)
Antoine Pitrou created ARROW-7410: - Summary: [C++] [Python] [Doc] Document filesystem APIs Key: ARROW-7410 URL: https://issues.apache.org/jira/browse/ARROW-7410 Project: Apache Arrow Issue Ty

[NIGHTLY] Arrow Build Report for Job nightly-2019-12-17-0

2019-12-17 Thread Crossbow
Arrow Build Report for Job nightly-2019-12-17-0 All tasks: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-17-0 Failed Tasks: - conda-osx-clang-py27: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-17-0-azure-conda-osx-clang-py27 - cond

[jira] [Created] (ARROW-7409) [C++][Python] Windows link error LNK1104: cannot open file 'python37_d.lib'

2019-12-17 Thread Raul Bocanegra (Jira)
Raul Bocanegra created ARROW-7409: - Summary: [C++][Python] Windows link error LNK1104: cannot open file 'python37_d.lib' Key: ARROW-7409 URL: https://issues.apache.org/jira/browse/ARROW-7409 Project:

Re: Strategy for mixing large_string and string with chunked arrays

2019-12-17 Thread Maarten Breddels
Op wo 27 nov. 2019 om 19:37 schreef Wes McKinney : > On Tue, Nov 26, 2019 at 9:40 AM Maarten Breddels > wrote: > > > > Op di 26 nov. 2019 om 15:02 schreef Wes McKinney : > > > > > hi Maarten > > > > > > I opened https://issues.apache.org/jira/browse/ARROW-7245 in part > based > > > on this. > > >

[jira] [Created] (ARROW-7408) [C++] Reference benchmarks fail compiling

2019-12-17 Thread Antoine Pitrou (Jira)
Antoine Pitrou created ARROW-7408: - Summary: [C++] Reference benchmarks fail compiling Key: ARROW-7408 URL: https://issues.apache.org/jira/browse/ARROW-7408 Project: Apache Arrow Issue Type:

Re: Non-chunked large files / hdf5 support

2019-12-17 Thread Maarten Breddels
Hi, I had to catch up a bit with the arrow documentation before I could respond properly. My fear was that Arrow demanded that the in-memory representation was always 'packed', or 'flat'. After going through the docs, it seems that only when doing IPC or stream writing, it is written in this form.

Re: [Python] Exposing compute kernels

2019-12-17 Thread Maarten Breddels
Hi Uwe, Having it in a separate package/module/namespace makes it easier to make it an optional install in the future, might that happen. Also, it would be more tab completion friendly. Cheers, Maarten > On 17 Dec 2019, at 10:24, Uwe L. Korn wrote: > > Hello all, > > we have developed quit

[Python] Exposing compute kernels

2019-12-17 Thread Uwe L. Korn
Hello all, we have developed quite some compute kernels in C++ nowadays and I would like to call them from Python. We could expose the kernels on the Array/ChunkedArray classes themselves or as standalone functions (or as both). What would be the preferred way? Also exposing them as standalone