On Mon, 9 Sep 2019, Wes McKinney wrote:
I'm a bit confused by the error message " Error in write_parquet_file(to_arrow(table), file) : Arrow error: IOError: Metadata contains Thrift LogicalType that is not recognized. " This error comes from https://github.com/apache/arrow/blob/master/cpp/src/parquet/types.cc#L455 This function should not be called at all during the execution of "write_parquet_file". Daniel, is it possible you changed the C++ library installed after building the "arrow" R package? The R package must generally be recompiled when the C++ library is upgraded
We are not aware of changing anything in C++. It is just as yum left it. We didn't compile the R arrow package at all, just used what yum supplied from the distribution. Are you suggesting we compile the R package ourselves, that the Scientific Linux distribution packages are inconsistent? Note that the default C++ is rather old and it would be problem to update it, since so many other packages depend on it. But we could update Arrow, I suppose.
Daniel Feenberg