Sounds great, thanks.
A number of people are looking at using Arrow for faster serialization
for PySpark, so now that the Java and C++ libraries are compatible
(cf: integration tests) we can make this a reality.
On Thu, Dec 15, 2016 at 4:54 PM, Julien Le Dem wrote:
> I'm happy to reach out to Ma
I'm happy to reach out to Matei.
Reynold is on this list and the Arrow PMC as well.
Wes, I can start with an email and CC you.
On Thu, Dec 15, 2016 at 11:03 AM, Mark Hamstra
wrote:
> I already made sure that Matei is aware of this thread. He seemed
> interested in talking with key Arrow devel
I already made sure that Matei is aware of this thread. He seemed
interested in talking with key Arrow developers.
On Thu, Dec 15, 2016 at 10:49 AM, Julian Hyde wrote:
> I think someone should reach out to Matei and Shoumik, and see if they
> would like to collaborate. Wes, would you like to do
The PySpark community is aware of arrow, but certainly more reaching out to
the Spark SQL devs could really be beneficial to get us all on the same
page :)
On Thu, Dec 15, 2016 at 10:49 AM Julian Hyde wrote:
> I think someone should reach out to Matei and Shoumik, and see if they
> would like to
I think someone should reach out to Matei and Shoumik, and see if they would
like to collaborate. Wes, would you like to do that?
Also, reach out to the Spark community. Are they aware of Arrow? Are they
planning to use it, or are they developing an alternative?
Julian
> On Dec 13, 2016, at
We've been developing and testing the Arrow C++ library with Clang,
but haven't done any work on LLVM or code generation with it. It would
be interesting to make it easy to create custom UDFs in LLVM and
evaluate them on Arrow data -- a bit of glue necessary to bridge the
Arrow world and the LLVM w
[
https://issues.apache.org/jira/browse/ARROW-425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wes McKinney resolved ARROW-425.
Resolution: Fixed
Issue resolved by pull request 241
[https://github.com/apache/arrow/pull/241]
> Py
[
https://issues.apache.org/jira/browse/ARROW-423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wes McKinney resolved ARROW-423.
Resolution: Fixed
Issue resolved by pull request 240
[https://github.com/apache/arrow/pull/240]
> C+
Uwe L. Korn created ARROW-426:
-
Summary: Python: Conversion from pyarrow.Array to a Python list
Key: ARROW-426
URL: https://issues.apache.org/jira/browse/ARROW-426
Project: Apache Arrow
Issue Typ
