Andy Grove created ARROW-8287:
-
Summary: [Rust] Arrow examples should use utility to print results
Key: ARROW-8287
URL: https://issues.apache.org/jira/browse/ARROW-8287
Project: Apache Arrow
Serializing Spark DataFrame in either Java or Scala would suffice for the
use case, but there may be follow-on JIRAs to make the Arrow adapters more
accessible. pandas only needs access to flat schemas for now, for example,
so nested Spark SQL schemas could be handled in follow-up work.
Note: this
Hi Wes,
Thanks for raising the ticket. So it seems like Spark 2.0 will not have
support for Arrow.
Also does SPARK-13534 cover Arrow serialization for Spark's JAVA API, or do
we need to raise a separate ticket for that?
As of now, I only have a high-level understanding of Arrow and it's data
stru
hi Dmitriy,
I created the following JIRA
https://issues.apache.org/jira/browse/SPARK-13534 related to PySpark
which seems relevant. I would be happy to collaborate with you on
this. Since I understand that the Spark developers are exploring an
in-memory columnar layout for Spark DataFrames/Dataset
Hello everyone,
I'm just starting with Arrow. I'd like to see how good Arrow at caching
when used in conjunction with Allixio (Tachyon). The use case that I'm
going to validate involves reading data from Spark's DataFrame, storing in
Tachyon in Arrow and then reading back into DataFrame. I checked
