Wes McKinney created ARROW-1059:
-----------------------------------
Summary: [C++] Define API for embedding user-defined metadata /
Flatbuffer message types in Arrow IPC machinery
Key: ARROW-1059
URL: https://issues.apache.org/jira/browse/ARROW-1059
Project: Apache Arrow
Issue Type: New Feature
Components: C++
Reporter: Wes McKinney
Currently, the {{MessageHeader}} Flatbuffer union must be modified to serialize
new kinds of metadata:
https://github.com/apache/arrow/blob/master/format/Message.fbs#L85
It would be interesting if user metadata could be embedded within a particular
application that wishes to use the Arrow C++ libraries' zero-copy IPC machinery
for serialization of other kinds of data structures.
As one approach, the message metadata could be an application-dependent unique
identifier for the user defined type, which would internally dispatch to an
implementation of an abstract deserializer interface. So in addition to
describing the serialized representation of the user type, we also will have to
create the abstract API for the user to implement so that the code in
{{arrow/ipc}} can be configured to dispatch appropriately.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)