Re: Arrow & plasma - java sample to store complex objects

2018-08-09 Thread Gérard Dupont
Thanks both for the prompt reply. Indeed I figured out that the current JAVA api was a "work-in-progress". Still, it is quite promising. I managed to code a workable solution with ByteArrayOutputStream and taping directly on Plasma API. Which is not particularly efficient but it works. I'll have a

Re: Arrow & plasma - java sample to store complex objects

2018-08-07 Thread Jacques Nadeau
Bleeding edge is probably an understatement. We need someone to implement https://issues.apache.org/jira/browse/ARROW-2892 before this is really feasible without copy. You could do it with Glue code today and a copy from the memory used in the current Plasma Java client to the memory used in Buffer

Re: Arrow & plasma - java sample to store complex objects

2018-08-06 Thread Wes McKinney
hi Gerard, This is the right place to ask questions. The Slack channel was closed (see prior discussions on the mailing list); few Java developers were on Slack anyway so it wouldn't have been a good place to get help. Using Java with Plasma is very bleeding edge territory. I don't know if anyone

Arrow & plasma - java sample to store complex objects

2018-08-06 Thread Gérard Dupont
Hi, Not sure this is the right channel for a "user" oriented question but the slack channel on heroku seams to be down... TL;DR: is there some hidden tutorial/java samples to store complex data objects in arrow and access (put/get) with plasma? I'm currently exploring the unit test from the java p