In our system we are using arrow serialization as it showed excellent deserialization speed. However, seems that we made a mistake by persisting the streams into a long-term storage as the serialized data appears to be incompatible between versions. According to the release notes of 0.14.0 it appears that starting 1.0.0 binary compatibility will be maintained. My question is whether pyarrow.serialize is also guaranteed to maintain binary compatibility starting with arrow 1.0 and it would be safe to persist its output then (or maybe even starting now - 0.14)?
(from my quick test the 0.13 is not compatible with 0.12 and before, while it is compatible to 0.14) Thank you, - Yevgeni
