Wes McKinney created ARROW-288: ---------------------------------- Summary: Implement Arrow adapter for Spark Datasets Key: ARROW-288 URL: https://issues.apache.org/jira/browse/ARROW-288 Project: Apache Arrow Issue Type: Bug Components: C++, Java - Vectors Reporter: Wes McKinney
It would be valuable for applications that use Arrow to be able to * Convert between Spark DataFrames/Datasets and Java Arrow vectors * Send / Receive Arrow record batches / Arrow file format RPCs to / from Spark * Allow PySpark to use Arrow for messaging in UDF evaluation -- This message was sent by Atlassian JIRA (v6.3.4#6332)