Re: Requirements for a 0.9.1 release

2018-04-17 Thread Bryan Cutler
Sounds good Uwe. There were a couple of recent bug fixes that were blockers for me, but those are done now and looking good. I do want to run Spark integration tests before a RC is cut, so I'll try to do that tomorrow. Thanks! Bryan On Tue, Apr 17, 2018 at 3:20 PM, Antoine Pitrou wrote: > >

Re: Is there list writer in Java?

2018-04-17 Thread Teddy Choi
Siddharth, thanks for quick answer. I can work on this issue. It's a good chance for my first Arrow contribution. :) iOS? Outlook On Wed, Apr 18, 2018 at 12:54 PM +0900, "Siddharth Teotia" mailto:siddha...@dremio.com>> wrote: Hi Teddy, Yes UnionListWriter curren

Re: Is there list writer in Java?

2018-04-17 Thread Siddharth Teotia
Hi Teddy, Yes UnionListWriter currently doesn't support writing decimals into list vector. Basically we are missing APIs like UnionListWriter.decimal() which will return a DecimalWriter(we already have this) and the latter can be used to write decimals in list. I'd suggest you to go ahead and file

Is there list writer in Java?

2018-04-17 Thread Teddy Choi
Hello, all I’m new to Apache Arrow, and checking whether it supports most of data types. It seems like that there’s no implementation for list writer in UnionListWriter yet. Is there other way? Thanks. Teddy Choi.

[Py] writing 2- or 4-byte decimal columns to Parquet

2018-04-17 Thread Colin Nichols
Hi there, I know (py)arrow has the decimal128() type, and using this type it's easy to take an array of Python Decimals, convert to a pa.array, and write out to Parquet. In the absence (afaict) of decimal32 and decimal64 types, is it possible to go from an array of Decimals (with compatible preci

Fwd: REMINDER - TAC Applications closes in 2 weeks for ACNA Montréal

2018-04-17 Thread Wes McKinney
-- Forwarded message -- From: Gavin McDonald Date: Tue, Apr 17, 2018 at 8:40 PM Subject: REMINDER - TAC Applications closes in 2 weeks for ACNA Montréal To: travel-assista...@apache.org Hello PMCs. Please could you forward on the below email to your dev and user lists. Thanks

[jira] [Created] (ARROW-2468) Builder::slice_mut should take mut self

2018-04-17 Thread Bruce Mitchener (JIRA)
Bruce Mitchener created ARROW-2468: -- Summary: Builder::slice_mut should take mut self Key: ARROW-2468 URL: https://issues.apache.org/jira/browse/ARROW-2468 Project: Apache Arrow Issue Type:

Re: [JS] Arrow output from JS library?

2018-04-17 Thread Paul Taylor
Hi Naveen, I have some work in a branch on my fork, and perhaps a bit more locally, but it's not finished. Feel free to reach out if you want to collaborate. Otherwise Graphistry intends to staff it full time in the next few weeks. Best, Paul On Tue, Apr 17, 2018 at 3:33 PM, Naveen Michau

[JS] Arrow output from JS library?

2018-04-17 Thread Naveen Michaud-Agrawal
Hi, Are there any plans to be able to create arrow objects from the JS library? Naveen Michaud-Agrawal

Re: Requirements for a 0.9.1 release

2018-04-17 Thread Antoine Pitrou
This sounds good to me. Regards Antoine. Le 17/04/2018 à 17:40, Uwe L. Korn a écrit : > Hello all, > > I would like to do a 0.9.1 release as soon as possible. For this the minimum > required steps are that we have the following issues resolved: > > * https://issues.apache.org/jira/browse/AR

Re: Requirements for a 0.9.1 release

2018-04-17 Thread Jacques Nadeau
Sounds good. +1 On Tue, Apr 17, 2018 at 8:40 AM, Uwe L. Korn wrote: > Hello all, > > I would like to do a 0.9.1 release as soon as possible. For this the > minimum required steps are that we have the following issues resolved: > > * https://issues.apache.org/jira/browse/ARROW-1975 (expect the PR

Requirements for a 0.9.1 release

2018-04-17 Thread Uwe L. Korn
Hello all, I would like to do a 0.9.1 release as soon as possible. For this the minimum required steps are that we have the following issues resolved: * https://issues.apache.org/jira/browse/ARROW-1975 (expect the PR for this today or tomorrow morning) * https://issues.apache.org/jira/browse/AR

[jira] [Created] (ARROW-2467) [Rust] Implement IPC

2018-04-17 Thread Andy Grove (JIRA)
Andy Grove created ARROW-2467: - Summary: [Rust] Implement IPC Key: ARROW-2467 URL: https://issues.apache.org/jira/browse/ARROW-2467 Project: Apache Arrow Issue Type: New Feature Compone

[jira] [Created] (ARROW-2466) [C++] misleading "append" flag to FileOutputStream

2018-04-17 Thread Antoine Pitrou (JIRA)
Antoine Pitrou created ARROW-2466: - Summary: [C++] misleading "append" flag to FileOutputStream Key: ARROW-2466 URL: https://issues.apache.org/jira/browse/ARROW-2466 Project: Apache Arrow Iss

Re: C++ RecordBatchWriter/ReadRecordBatch clarification

2018-04-17 Thread Dimitri Vorona
Hi Rares, you use a different reader for the RecordBatch streams. See arrow/ipc/ipc-read-write-test.cc:569-596 for the gist. Also, the second argument to arrow::RecordBatch::Make takes the number of rows in the batch, so you have to set it to 1 in your example. See https://gist.github.com/alendi