To answer Larry's question, it was simply a matter of timing and also I started the project as a way to learn JNI coding and rust's JNI crate myself so it wasn't until recently that I started to survey better alternatives. I don't really personally have a concrete use case but given enough interest in this project I believe in the future it should be moved to C-data soon, to avoid copying over data.
Thanks Gavin for the suggestion, yes maybe later I (or someone else if interested) can try that with the existing arrow-rs binding [1] [1]: https://github.com/apache/arrow-rs/blob/master/arrow/src/ffi.rs On Tue, May 17, 2022 at 12:39 AM Gavin Ray <ray.gavi...@gmail.com> wrote: > On that note, you should be able to use the "jextract" tool > from Project Panama to auto generate the glue code and types if you have C > headers > > panama-foreign/panama_jextract.md at foreign-jextract ยท > openjdk/panama-foreign (github.com) > < > https://github.com/openjdk/panama-foreign/blob/foreign-jextract/doc/panama_jextract.md#using-the-jextract-tool > > > > On Mon, May 16, 2022 at 12:24 PM Larry White <ljw1...@gmail.com> wrote: > > > Hi, > > Since this is a recent improvement, I'm curious about what motivated the > > decision to not use the c-data-interface? Was it strictly a matter of > > timing or familiarity, or is there some advantage to the approach you > took? > > > > I ask because I'm in the process of moving other JNI interfaces to > c-data. > > > > Thanks very much. > > > > On Mon, May 16, 2022 at 6:30 AM Jiayu Liu <ji...@hey.com.invalid> wrote: > > > > > Thanks for the question Atonine, > > > > > > So far the data is copied over (not IPC per-se, since it's the same > > > process), because I haven't found time (and motivation) to migrate to > > > Arrow C interface just yet. > > > > > > A next step, is to allow the project to depend on arrow-c-data [1], and > > > also optimize how .so and .dylib files are shipped: currently it's > > > packaged separately, I had doubts about shipping both into a .jar, > > > because combined they exceed > 50MB. > > > > > > [1]: > https://repo1.maven.org/maven2/org/apache/arrow/arrow-c-data/8.0.0/ > > > > > > On May 11, 2022, Jiayu Liu <ji...@hey.com> wrote: > > > > Hi dev@arrow, > > > > > > > > Recently I've created and published a Java binding[1] to > > > > datafusion[2], as part of datafusion-contrib projects[3]. I've > updated > > > > the README.md[4] so people can pick it up via maven[5] or gradle. > > > > > > > > Any feedback or contributions are welcome! > > > > > > > > [1]: https://github.com/datafusion-contrib/datafusion-java > > > > [2]: https://github.com/apache/arrow-datafusion > > > > [3]: https://github.com/datafusion-contrib > > > > [4]: https://github.com/datafusion-contrib/datafusion- > > > > java/blob/main/README.md > > > > [5]: https://repo.maven.apache.org/maven2/io/github/datafusion- > > > > contrib/datafusion-java/ > > > > > >
