>From what I've found searching on the internet - Java: * ZSTD -- JNI-based library available * LZ4 -- both JNI and native Java available
- Go: ZSTD is a C binding, while there is an LZ4 native Go implementation - Rust: bindings to both C libraries available - C# wrapper libraries seem to be available, but quality would need to be evaluated - JavaScript: there is a JS-based implementation of LZ4 (quality unknown). ZSTD is available via Emscripten It seems like LZ4 would be seen as the most "compatible" option since it's been around longer and more people have had time to build libraries, while ZSTD yields better compression ratios. Feedback from the developers of the other languages would indeed be helpful On Tue, Mar 24, 2020 at 5:39 PM Micah Kornfield <emkornfi...@gmail.com> wrote: > > Thanks Wes, > It would be nice if contributors to other languages could express there > opinions on the two compression formats selected (in particular if they > represent challenges in using a suitable library for decompressing) > > -Micah > > > > > On Tue, Mar 24, 2020 at 3:08 PM Wes McKinney <wesmck...@gmail.com> wrote: > > > I just opened this pull request with the proposed format additions > > based on this discussion: > > > > https://github.com/apache/arrow/pull/6707 > > > > If there is more feedback about the details, it would be good to know > > it now. In a couple of days I would like to call a vote to see if > > there is interest in formally approving adopting this into the format. > > > > On Mon, Mar 23, 2020 at 6:44 PM Antoine Pitrou <anto...@python.org> wrote: > > > > > > > > > Le 24/03/2020 à 00:39, Wes McKinney a écrit : > > > > > > > > As far as what Micah said about having a limited number of > > > > compressors: I would be in favor of having just LZ4 and ZSTD. > > > > > > +1, exactly my thought as well. > > > > > > Regards > > > > > > Antoine. > >
