hi Mike,
I recommend using record batches along with io::MemoryMappedFile. You
can write the table with ipc::FileWriter:
https://github.com/apache/arrow/blob/master/cpp/src/arrow/ipc/writer.h#L111
and then read it with ipc::FileReader. If you use MemoryMappedFile,
then the read will be zero-copy
Great!
What I'd like to do is create a table that can be shared among multiple
processes. I see, e.g., this in the comments where RecordBatch is defined:
// A record batch is a simpler and more rigid table data structure intended for
// use primarily in shared memory IPC. It contains a schema
Jacques Nadeau created ARROW-1005:
-
Summary: NullableDecimalVector.set(int, byte[]...) throws
UnsupportedOperationException
Key: ARROW-1005
URL: https://issues.apache.org/jira/browse/ARROW-1005
Projec
I think we opted to not create a user list yet, as using arrow is likely
going to require some willingness to poke around in the library until we
can fill out the docs and some more complete example usages. So as far as I
know this is the place to ask, what were you looking to do?
On Wed, May 10,
William Cox created ARROW-1004:
--
Summary: ArrowInvalid: Invalid: Python object of type float is not
None and is not a string, bool, or date object
Key: ARROW-1004
URL: https://issues.apache.org/jira/browse/ARROW-1004
Is there a good place for user-oriented arrow questions and discussions? (my
apologies in advance if this isn't the appropriate venue)
-Mike
DISCLAIMER: This e-mail message and any attachments are intended solely for the
use of the individual or entity to which it is addressed and may conta
Balázs Gosztonyi created ARROW-1003:
---
Summary: Hdfs and java dlls fail to load when built for Windows
with MSVC
Key: ARROW-1003
URL: https://issues.apache.org/jira/browse/ARROW-1003
Project: Apache
Wes McKinney created ARROW-1002:
---
Summary: [C++] It is not necessary to add padding after the magic
header in the FileWriter implementation
Key: ARROW-1002
URL: https://issues.apache.org/jira/browse/ARROW-1002
Kouhei Sutou created ARROW-1001:
---
Summary: [GLib] Unify writer files
Key: ARROW-1001
URL: https://issues.apache.org/jira/browse/ARROW-1001
Project: Apache Arrow
Issue Type: Improvement
Kouhei Sutou created ARROW-1000:
---
Summary: [GLib] Move install document to Website
Key: ARROW-1000
URL: https://issues.apache.org/jira/browse/ARROW-1000
Project: Apache Arrow
Issue Type: Improv
Emilio Lahr-Vivaz created ARROW-999:
---
Summary: [Java] Minor types don't account for nullable FieldType
flag
Key: ARROW-999
URL: https://issues.apache.org/jira/browse/ARROW-999
Project: Apache Arrow
Brian Hulette created ARROW-998:
---
Summary: [Doc] File format documents incorrect schema location
Key: ARROW-998
URL: https://issues.apache.org/jira/browse/ARROW-998
Project: Apache Arrow
Issue
Emilio Lahr-Vivaz created ARROW-997:
---
Summary: [Java] Implement transfer in FixedSizeListVector
Key: ARROW-997
URL: https://issues.apache.org/jira/browse/ARROW-997
Project: Apache Arrow
Iss
Kouhei Sutou created ARROW-996:
--
Summary: [Website] Add 0.3 release announce in Japanese
Key: ARROW-996
URL: https://issues.apache.org/jira/browse/ARROW-996
Project: Apache Arrow
Issue Type: Imp
Kouhei Sutou created ARROW-995:
--
Summary: [Website] Fix a typo
Key: ARROW-995
URL: https://issues.apache.org/jira/browse/ARROW-995
Project: Apache Arrow
Issue Type: Bug
Components: Web
Deng Changchun created ARROW-994:
Summary: Arrow is unable to reuse Memory chunk in the Pool.
Key: ARROW-994
URL: https://issues.apache.org/jira/browse/ARROW-994
Project: Apache Arrow
Issue T
16 matches
Mail list logo
