Chunked arrays in Feather files

2017-09-15 Thread Rares Vernica
Hi, I have a question about chunks in Feather files. A TableReader can be used to read a Column. For a column, the data is in a ChunkedArray. For a Feather file, what is the chunk size? Can the chunk size be modified? Thanks! Rares

[jira] [Created] (ARROW-1545) Int64Builder should not need int64() as arg

2017-09-15 Thread Rares Vernica (JIRA)
Rares Vernica created ARROW-1545: Summary: Int64Builder should not need int64() as arg Key: ARROW-1545 URL: https://issues.apache.org/jira/browse/ARROW-1545 Project: Apache Arrow Issue Type:

[jira] [Created] (ARROW-1544) [JS] Export Vector type definitions

2017-09-15 Thread Paul Taylor (JIRA)
Paul Taylor created ARROW-1544: -- Summary: [JS] Export Vector type definitions Key: ARROW-1544 URL: https://issues.apache.org/jira/browse/ARROW-1544 Project: Apache Arrow Issue Type: Bug

Re: Java Examples Writing Flatbuffer in IPC Message

2017-09-15 Thread Andrew Pham (BLOOMBERG/ 731 LEX)
Thanks Wes. I'm going over the Java source code and I have a few questions: Do we need to define a VectorSchemaRoot every time we define an ArrowStreamWriter? In the interest of developing a simple proof of concept, for now I would just like to ferry a simple byte[] array onto the OutputStream

Re: A simple benchmark on Java implementation

2017-09-15 Thread Gonzalo Ortiz Jaureguizar
Yeah... I said "you can found it here" but forgot to add the link. My bad. You can found it here . 2017-09-15 15:33 GMT+02:00 Wes McKinney : > hi Gonzalo, > > This is interesting, thank you. Do you have code available to reproduce > these results? > > - Wes >

Re: A simple benchmark on Java implementation

2017-09-15 Thread Wes McKinney
hi Gonzalo, This is interesting, thank you. Do you have code available to reproduce these results? - Wes On Fri, Sep 15, 2017 at 9:28 AM, Gonzalo Ortiz Jaureguizar < golthir...@gmail.com> wrote: > I forgot to say that test were executed on my Ubuntu 17.04 laptop on > Oracle JDK 1.8.0_144-b01. >

Re: A simple benchmark on Java implementation

2017-09-15 Thread Gonzalo Ortiz Jaureguizar
I forgot to say that test were executed on my Ubuntu 17.04 laptop on Oracle JDK 1.8.0_144-b01. 2017-09-15 13:21 GMT+02:00 Gonzalo Ortiz Jaureguizar : > Hi there, > > I have created a little JMH test to check the Arrow performance. You can > found it here. The idea is to test an API with implement

A simple benchmark on Java implementation

2017-09-15 Thread Gonzalo Ortiz Jaureguizar
Hi there, I have created a little JMH test to check the Arrow performance. You can found it here. The idea is to test an API with implementations on heap arrays, nio buffers (that follow the arrow format) and Arrow. At this moment the API only supports nullable int buffers and contains read only m

[jira] [Created] (ARROW-1543) row_wise_conversion example doesn't correspond to ListBuilder constructor arguments

2017-09-15 Thread Johan Peltenburg (JIRA)
Johan Peltenburg created ARROW-1543: --- Summary: row_wise_conversion example doesn't correspond to ListBuilder constructor arguments Key: ARROW-1543 URL: https://issues.apache.org/jira/browse/ARROW-1543