[jira] [Created] (ARROW-4075) [Rust] Reuse buffer builder and array builder after calling finish()

2018-12-18 Thread Chao Sun (JIRA)
Chao Sun created ARROW-4075: --- Summary: [Rust] Reuse buffer builder and array builder after calling finish() Key: ARROW-4075 URL: https://issues.apache.org/jira/browse/ARROW-4075 Project: Apache Arrow

Re: TensorFlow, PyTorch, and manylinux1

2018-12-18 Thread Robert Nishihara
Thanks Soumith and Martin for the detailed thoughts. Jean-Marc would you be able to chime in or perhaps cc the relevant people? It'd be really great to hear from someone at NVIDIA, since NVIDIA seems best positioned to make manlinux2010 work out and will probably need to be part of a plan for many

Re: Reviewing PRs (was: Re: Arrow sync call)

2018-12-18 Thread Wes McKinney
Some projects have a REVIEWERS.md file https://github.com/apache/parquet-mr/blob/master/parquet-common/REVIEWERS.md We could do the same, or keep the file on the project wiki so it's lighter-weight to change (no pull request required) https://cwiki.apache.org/confluence/display/ARROW +1 for add

[jira] [Created] (ARROW-4074) [Python] test_get_library_dirs_win32 fails if libraries installed someplace different from conda or wheel packages

2018-12-18 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-4074: --- Summary: [Python] test_get_library_dirs_win32 fails if libraries installed someplace different from conda or wheel packages Key: ARROW-4074 URL: https://issues.apache.org/jira/brows

[jira] [Created] (ARROW-4073) [Python] Parquet test failures on AppVeyor

2018-12-18 Thread Antoine Pitrou (JIRA)
Antoine Pitrou created ARROW-4073: - Summary: [Python] Parquet test failures on AppVeyor Key: ARROW-4073 URL: https://issues.apache.org/jira/browse/ARROW-4073 Project: Apache Arrow Issue Type:

Re: How to append to parquet file periodically and read intermediate data - pyarrow.lib.ArrowIOError: Invalid parquet file. Corrupt footer.

2018-12-18 Thread Darren Gallagher
> [Cross posted from https://github.com/apache/arrow/issues/3203] > > I'm adding new data to a parquet file every 60 seconds using this code: > > import os > import json > import time > import requests > import pandas as pd > import numpy as np > import pyarrow as pa > import pyarrow.parquet as pq

[jira] [Created] (ARROW-4072) [Rust] Set default value for PARQUET_TEST_DATA

2018-12-18 Thread Paddy Horan (JIRA)
Paddy Horan created ARROW-4072: -- Summary: [Rust] Set default value for PARQUET_TEST_DATA Key: ARROW-4072 URL: https://issues.apache.org/jira/browse/ARROW-4072 Project: Apache Arrow Issue Type: T

[jira] [Created] (ARROW-4071) [Rust] Add rustfmt as a pre-commit hook

2018-12-18 Thread Paddy Horan (JIRA)
Paddy Horan created ARROW-4071: -- Summary: [Rust] Add rustfmt as a pre-commit hook Key: ARROW-4071 URL: https://issues.apache.org/jira/browse/ARROW-4071 Project: Apache Arrow Issue Type: Task

[jira] [Created] (ARROW-4070) [C++] ARROW_BOOST_VENDORED doesn't work properly with ninja build

2018-12-18 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-4070: --- Summary: [C++] ARROW_BOOST_VENDORED doesn't work properly with ninja build Key: ARROW-4070 URL: https://issues.apache.org/jira/browse/ARROW-4070 Project: Apache Arrow

[jira] [Created] (ARROW-4069) [Python] Add tests for casting from binary to utf8

2018-12-18 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-4069: --- Summary: [Python] Add tests for casting from binary to utf8 Key: ARROW-4069 URL: https://issues.apache.org/jira/browse/ARROW-4069 Project: Apache Arrow Issue T

[jira] [Created] (ARROW-4068) [Gandiva] Support building with Xcode 6.4

2018-12-18 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-4068: --- Summary: [Gandiva] Support building with Xcode 6.4 Key: ARROW-4068 URL: https://issues.apache.org/jira/browse/ARROW-4068 Project: Apache Arrow Issue Type: Impr

[jira] [Created] (ARROW-4067) [C++] RFC: standardize ArrayBuilder subclasses

2018-12-18 Thread Benjamin Kietzman (JIRA)
Benjamin Kietzman created ARROW-4067: Summary: [C++] RFC: standardize ArrayBuilder subclasses Key: ARROW-4067 URL: https://issues.apache.org/jira/browse/ARROW-4067 Project: Apache Arrow I

[jira] [Created] (ARROW-4066) Instructions to create Sphinx documentation

2018-12-18 Thread Antonio Cavallo (JIRA)
Antonio Cavallo created ARROW-4066: -- Summary: Instructions to create Sphinx documentation Key: ARROW-4066 URL: https://issues.apache.org/jira/browse/ARROW-4066 Project: Apache Arrow Issue Ty

Re: C++ documentation overhaul

2018-12-18 Thread Antoine Pitrou
Le 18/12/2018 à 02:44, Antonio Cavallo a écrit : > Mmm, done that #1, #2 and #3 > It looks when I do a make html I receive thid: > > /Users/antonio/Projects/cav71.arrow/arrow/docs/source/python/api.rst:30:toctree > references unknown document 'python/generated/pyarrow.field' I don't get this er

[jira] [Created] (ARROW-4065) arrowTargets.cmake is broken

2018-12-18 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created ARROW-4065: - Summary: arrowTargets.cmake is broken Key: ARROW-4065 URL: https://issues.apache.org/jira/browse/ARROW-4065 Project: Apache Arrow Issue Type: Bug