Thanks Jacek and Kazuaki, I guess got the wrong impression about the C++ API from somewhere--- I think I read it in a JIRA wish list. If the byte array is accessed through sun.misc.Unsafe, that's what I mean by off-heap. I found the Platform class, which provides access to the bytes in Unsafe in a uniform way.
Thanks for pointing me to CachedBatch (private). If I find a way to provide access by modifying Spark source, can I just submit a pull request, or do I need to be a recognized Spark developer? If so, is there a process for becoming one? -- Jim -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/How-to-access-the-off-heap-representation-of-cached-data-in-Spark-2-0-tp17701p17721.html Sent from the Apache Spark Developers List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org For additional commands, e-mail: dev-h...@spark.apache.org
