pyarrow 0.10.0 has been released, and this is important to be tested against for the 2.4 release (esp due to memory leak problems, etc)
https://issues.apache.org/jira/browse/SPARK-23874 https://github.com/apache/spark/pull/21939 https://issues.apache.org/jira/browse/ARROW-1973 i will be putting the centos workers in to quiet mode now, prepping the upgrade and once the majority of existing builds are done, i'll kill any outliers (and retrigger them later) and perform the upgrade. expect this to take ~3 hours, max. shane -- Shane Knapp UC Berkeley EECS Research / RISELab Staff Technical Lead https://rise.cs.berkeley.edu
