Re: Coordinating Arrow 0.8.0 end-game

2017-12-06 Thread Bryan Cutler
Thanks, Wes. The only outstanding issue on the Java side is ARROW-1864 Upgrading Netty to 4.1.x https://github.com/apache/arrow/pull/1376. The other issues have been resolved or pushed back. On Wed, Dec 6, 2017 at 5:08 AM, Tom Augspurger wrote: > I've reproduced the dask failures and am looking

[jira] [Created] (ARROW-1896) [C++] Do not allocate memory for primitive outputs in CastKernel::Call implementation

2017-12-06 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-1896: --- Summary: [C++] Do not allocate memory for primitive outputs in CastKernel::Call implementation Key: ARROW-1896 URL: https://issues.apache.org/jira/browse/ARROW-1896 Pro

Re: Java API map fields question (usage error or bug)

2017-12-06 Thread Derek Bennett
It's possible my attachment was rejected. I'm sending it again without the Java extension, and as a fail safe posting the code in line below. Also there is one JIRA from earlier this year that is still open that could be related: https://issues.apache.org/jira/browse/ARROW-522 Derek // Begin so

Re: Java API map fields question (usage error or bug)

2017-12-06 Thread Timothy Chen
Hey Derek, I don’t think you have attached your example code. Tim On Wed, Dec 6, 2017 at 1:38 PM Derek Bennett wrote: > Hello, > > I've been using the Java API to send and receive data in Arrow format. I > am having trouble in cases where the schema has map fields, and wanted to > see if this

[jira] [Created] (ARROW-1895) Add field_name to pandas index metadata

2017-12-06 Thread Phillip Cloud (JIRA)
Phillip Cloud created ARROW-1895: Summary: Add field_name to pandas index metadata Key: ARROW-1895 URL: https://issues.apache.org/jira/browse/ARROW-1895 Project: Apache Arrow Issue Type: Bug

Java API map fields question (usage error or bug)

2017-12-06 Thread Derek Bennett
Hello, I've been using the Java API to send and receive data in Arrow format. I am having trouble in cases where the schema has map fields, and wanted to see if this is a usage problem before logging an issue (most everything else is working as expected so far). I have an attached example that c

Re: Arrow Vector(Java) Rename and Consolidation Proposal

2017-12-06 Thread Li Jin
Hi All, Thanks for the feedback. There doesn't seem to be enough interests and consensus to move forward with renaming int vectors and renaming/consolidating time related vectors. So I think the only change we are going to make is adding StructVector and deprecating the existing MapVector/Nullabl

[jira] [Created] (ARROW-1894) [Python] Treat CPython memoryview or buffer objects equivalently to pyarrow.Buffer in pyarrow.serialize

2017-12-06 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-1894: --- Summary: [Python] Treat CPython memoryview or buffer objects equivalently to pyarrow.Buffer in pyarrow.serialize Key: ARROW-1894 URL: https://issues.apache.org/jira/browse/ARROW-189

Re: Arrow Vector(Java) Rename and Consolidation Proposal

2017-12-06 Thread Wes McKinney
Are there any additional changes we are going to make for 0.8.0 (it sounds like probably not)? I think Li is about to head out on vacation tomorrow or the day after, so if we can wrap up any discussions soon, we can lock down the remaining items for the release. On Sun, Dec 3, 2017 at 10:53 AM, Ja

[jira] [Created] (ARROW-1893) [Python] test_primitive_serialization fails on Python 2.7.3

2017-12-06 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-1893: -- Summary: [Python] test_primitive_serialization fails on Python 2.7.3 Key: ARROW-1893 URL: https://issues.apache.org/jira/browse/ARROW-1893 Project: Apache Arrow

Re: Apache Arrow sync tomorrow 11/29 at 17:00 UTC (12pm in New York)

2017-12-06 Thread Wes McKinney
Sorry for the delayed note. Here were the attendees for the sync call -- we mostly just discussed the 0.8.0 release and made sure we agreed on what is marked for the 0.8.0 fix version in JIRA - Jacques (Dremio) - 0.8.0 release - Wes (Two Sigma) - 0.8.0 release - JS release - Sidd (Dremio)

[jira] [Created] (ARROW-1892) [Python] Unknown list item type: binary

2017-12-06 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-1892: -- Summary: [Python] Unknown list item type: binary Key: ARROW-1892 URL: https://issues.apache.org/jira/browse/ARROW-1892 Project: Apache Arrow Issue Type: Bug

Re: Coordinating Arrow 0.8.0 end-game

2017-12-06 Thread Tom Augspurger
I've reproduced the dask failures and am looking into them now (it's around index metadata). On Wed, Dec 6, 2017 at 3:52 AM, Uwe L. Korn wrote: > Hello all, > > I'm just executing the current master locally against turbodbc and dask. > Sadly it seems that the unit tests in both projects are brea

[jira] [Created] (ARROW-1891) [Python] NaT date32 values are only converted to nulls if from_pandas is used

2017-12-06 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-1891: -- Summary: [Python] NaT date32 values are only converted to nulls if from_pandas is used Key: ARROW-1891 URL: https://issues.apache.org/jira/browse/ARROW-1891 Project: Apac

[jira] [Created] (ARROW-1890) [Python] Masking for date32 arrays not working

2017-12-06 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-1890: -- Summary: [Python] Masking for date32 arrays not working Key: ARROW-1890 URL: https://issues.apache.org/jira/browse/ARROW-1890 Project: Apache Arrow Issue Type: B

Re: Coordinating Arrow 0.8.0 end-game

2017-12-06 Thread Uwe L. Korn
Hello all, I'm just executing the current master locally against turbodbc and dask. Sadly it seems that the unit tests in both projects are breaking. I'm going to have a look at what happens in both. We should sort out these problems before the release. Uwe On Mon, Dec 4, 2017, at 08:06 PM, Wes

[jira] [Created] (ARROW-1889) [Python] --exclude is not available in older git versions

2017-12-06 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-1889: -- Summary: [Python] --exclude is not available in older git versions Key: ARROW-1889 URL: https://issues.apache.org/jira/browse/ARROW-1889 Project: Apache Arrow Is