Hi Yurui,
> Let’s say passed memory addresses from c++ to JVM and constructed the data
> structure in Java.
I think that you should add a method to release off heap the memory
area on the native side and call it on the Java side in this case.
In Gandiva, it seems to allocate the memory area of
hi Yurui,
I don't know if anyone has worked out a way to permanently transfer
ownership from memory allocated by the Java or C++ libraries. This is
partially what Plasma is for. I am not sure how Gandiva is currently
dealing with memory management between Java and C++ in-process. If
someone wants
Hi Wes:
Thank you for the response. Yes the examples you provided are very helpful.
But I still have a question regarding memory management. Let’s say passed
memory addresses from c++ to JVM and constructed the data structure in Java.
Since this is an off heap memory, how could I make sure the
I discussed some of these things at a high level in my talk at SciPy
2018 last week
https://www.slideshare.net/wesm/apache-arrow-crosslanguage-development-platform-for-inmemory-data-105427919
On Mon, Jul 16, 2018 at 2:08 PM, Wes McKinney wrote:
> hi Yurui,
>
> You can also share data structures
hi Yurui,
You can also share data structures through JNI without using the IPC
tools at all, which could require memory copying to produce the IPC
messages.
What you can do is obtain the memory addresses for the component
buffers of an array (or vector, as called in Java) and construct the
data s
Hey Yuri,
you can use the Arrow IPC mechanism to do this:
- https://github.com/apache/arrow/blob/master/format/IPC.md
- Python: https://arrow.apache.org/docs/python/ipc.html
- C++: https://arrow.apache.org/docs/cpp/namespacearrow_1_1ipc.html
- For Java, see the org.apache.arrow.vector.ipc namespa
