[
https://issues.apache.org/jira/browse/FLINK-10929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16815264#comment-16815264
]
Liya Fan commented on FLINK-10929:
----------------------------------
Hi [~fhueske], thank you for your kind reply. I agree with most points. The
changes should be incremental so as not to break other components. So I think
the first step is to provide a flag which is disabled by default, and let the
MemoryManager depend on the Arrow Buffer Allocator. With this change, all the
MemorySegment will be Arrow buffers, but this is transparent to other
components, and will break them.
I guess I will initiate a discussion on the dev mailing list.
BTW, my mail address has been kicked out from the mailing list for a couple of
days, because the dev-help claims that it receives some bouncing message. Would
you please add another email address of mine (fan_li...@aliyun.com) to the
mailing list? Thank you in advance.
> Add support for Apache Arrow
> ----------------------------
>
> Key: FLINK-10929
> URL: https://issues.apache.org/jira/browse/FLINK-10929
> Project: Flink
> Issue Type: Wish
> Components: Runtime / State Backends
> Reporter: Pedro Cardoso Silva
> Priority: Minor
> Attachments: image-2019-04-10-13-43-08-107.png
>
>
> Investigate the possibility of adding support for Apache Arrow as a
> standardized columnar, memory format for data.
> Given the activity that [https://github.com/apache/arrow] is currently
> getting and its claims objective of providing a zero-copy, standardized data
> format across platforms, I think it makes sense for Flink to look into
> supporting it.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
