Re: Re: How to remove the object stored in plasma_store?

2017-12-14 Thread Philipp Moritz
I'd suggest you don't. If you have new or updated data, it is better to create a new object ID. Both arrow and plasma are designed to be immutable. Of course nobody is going to prevent you from creating a new object with an old object ID if you implement the delete functionality. But if you intend

回复:Re: How to remove the object stored in plasma_store?

2017-12-14 Thread mildwolf_jh
Dear Philipp, dear Robert,If we don’t have the functionality, how to update a cached data with the same object Id?Best RegardsJin Hai - 原始邮件 - 发件人:Philipp Moritz 收件人:dev@arrow.apache.org 主题:Re: How to remove the object stored in plasma_store? 日期:2017年12月15日 07点02分 Hey Jin, are you intere

Re: How to remove the object stored in plasma_store?

2017-12-14 Thread Philipp Moritz
Hey Jin, are you interested in implementing this functionality? I created a JIRA that describes a safe semantics for it here: https://issues.apache.org/jira/browse/ARROW-1927 I think it would be valuable to have, even though it is not strictly necessary as Robert points out. Deleting objects tha

[jira] [Created] (ARROW-1927) [Plasma] Implement delete function

2017-12-14 Thread Philipp Moritz (JIRA)
Philipp Moritz created ARROW-1927: - Summary: [Plasma] Implement delete function Key: ARROW-1927 URL: https://issues.apache.org/jira/browse/ARROW-1927 Project: Apache Arrow Issue Type: Improve

Re: How to remove the object stored in plasma_store?

2017-12-14 Thread Robert Nishihara
Currently, you don't need to evict the object. Once the plasma store is full, it will begin evicting objects that are not being used by any clients (in a least-recently-used manner). In the future we may expose the ability to give hints to the object store that certain objects can safely be deleted

Re: arrow read/write examples in Java

2017-12-14 Thread Wes McKinney
hi Animesh, I suggest you try the ArrowStreamReader/Writer or ArrowFileReader/Writer classes. See https://github.com/apache/arrow/blob/master/java/tools/src/main/java/org/apache/arrow/tools/Integration.java for example working code for this - Wes On Thu, Dec 14, 2017 at 8:30 AM, Animesh Trivedi

[jira] [Created] (ARROW-1926) [GLib] Add garrow_timestamp_data_type_get_unit()

2017-12-14 Thread Kouhei Sutou (JIRA)
Kouhei Sutou created ARROW-1926: --- Summary: [GLib] Add garrow_timestamp_data_type_get_unit() Key: ARROW-1926 URL: https://issues.apache.org/jira/browse/ARROW-1926 Project: Apache Arrow Issue Typ

[jira] [Created] (ARROW-1925) Wrapping PyArrow Table with Numpy without copy

2017-12-14 Thread Young-Jun Ko (JIRA)
Young-Jun Ko created ARROW-1925: --- Summary: Wrapping PyArrow Table with Numpy without copy Key: ARROW-1925 URL: https://issues.apache.org/jira/browse/ARROW-1925 Project: Apache Arrow Issue Type:

How to remove the object stored in plasma_store?

2017-12-14 Thread Jin Hai
Hi, I find the delete method is not implemented in Client class. Is there any method to remove the object stored in plasma store? Thank you very much! Best Regards Jin Hai

arrow read/write examples in Java

2017-12-14 Thread Animesh Trivedi
Hi all, It might be a trivial question, so please let me know if I am missing something. I am trying to write and read files in the Arrow format in Java. My data is simple flat schema with primitive types. I already have the data in Java. So my questions are: 1. Is this possible or am I fundament

Re: [VOTE] Release Apache Arrow 0.8.0 RC2

2017-12-14 Thread Uwe L. Korn
+1 (binding) * Ran verify-release-candidate.sh on macOS; verified signature, checksums, test for Java, Python, C++, C/GLib, Java/C++ integration, JS Uwe On Thu, Dec 14, 2017, at 01:01 AM, Philipp Moritz wrote: > On Ray we are currently blocked from using the 0.8 release candidate by > this issue