[jira] [Created] (ARROW-1988) [C++] Extend flavor=spark in Parquet writing to handle INT types

2018-01-11 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-1988: -- Summary: [C++] Extend flavor=spark in Parquet writing to handle INT types Key: ARROW-1988 URL: https://issues.apache.org/jira/browse/ARROW-1988 Project: Apache Arrow

[jira] [Created] (ARROW-1989) [Python] Better UX on timestamp conversion to Pandas

2018-01-11 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-1989: -- Summary: [Python] Better UX on timestamp conversion to Pandas Key: ARROW-1989 URL: https://issues.apache.org/jira/browse/ARROW-1989 Project: Apache Arrow Issue T

[jira] [Created] (ARROW-1990) [JS] Add "DataFrame" object

2018-01-11 Thread Brian Hulette (JIRA)
Brian Hulette created ARROW-1990: Summary: [JS] Add "DataFrame" object Key: ARROW-1990 URL: https://issues.apache.org/jira/browse/ARROW-1990 Project: Apache Arrow Issue Type: New Feature

[DISCUSS] Union Vector

2018-01-11 Thread Li Jin
Hi All, Here is a summary of the state and issue of union vector (to the best of my knowledge). I have summarized some possible solutions based on the discussion so far. However, this is not a proposal as there are still a lot of things that are not clear at this moment. I'd like to share this a

Re: [DISCUSS] Union Vector

2018-01-11 Thread Wes McKinney
hi all, So one of the conflicts that keeps coming up re: unions is the following two notions: * A union as a "variant of primitives" type. Here, values are constrained to be one of Arrow's primitive types (integer, floating point, string, boolean, etc.). The value types are statically declared an

Re: Trying to build to build pyarrow for python 2.7

2018-01-11 Thread Wes McKinney
hi Simba -- when you say "virtual env", I want to be sure you are talking about a conda environment and not a virtualenv. Using these together will cause all kinds of problems -- occasionally mixing pip and conda installs can break conda environments, too. The ones I linked to are the generated ve

Re: Trying to build to build pyarrow for python 2.7

2018-01-11 Thread simba nyatsanga
Hi Wes, Apologies for the ambiguity there. To clarify, I used the conda instructions only to create a conda environment. So I did this conda create -y -q -n pyarrow-dev \ python=2.7 numpy six setuptools cython pandas pytest \ cmake flatbuffers rapidjson boost-cpp thrift-cpp snappy zli

[jira] [Created] (ARROW-1991) [GLib] Docker-based documentation build is broken

2018-01-11 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-1991: --- Summary: [GLib] Docker-based documentation build is broken Key: ARROW-1991 URL: https://issues.apache.org/jira/browse/ARROW-1991 Project: Apache Arrow Issue Ty

Re: arrow read/write examples in Java

2018-01-11 Thread Wes McKinney
I'm working on getting all the docs updated for 0.8.0 -- there are some issues blocking a more automated update, so I may update them piecemeal until this is resolved: https://github.com/apache/arrow/pull/1472 On Tue, Jan 2, 2018 at 10:41 AM, Wes McKinney wrote: > I'll take a look at updating th

[jira] [Created] (ARROW-1992) to_pandas crashes when using strings_to_categoricals on empty string cols on 0.8.0

2018-01-11 Thread Victor Uriarte (JIRA)
Victor Uriarte created ARROW-1992: - Summary: to_pandas crashes when using strings_to_categoricals on empty string cols on 0.8.0 Key: ARROW-1992 URL: https://issues.apache.org/jira/browse/ARROW-1992 Pr