Excellent! Thank you, Klaus! It sounds like it does, but just to be clear: does S2 also replace/upgrade the snappy *streaming* format (the outer format that is different from snappy itself; e.g. https://github.com/glycerine/go-unsnap-stream )?
On Monday, August 26, 2019 at 6:29:29 AM UTC-4, Klaus Post wrote: > > Hi! > > > S2 is an extension of Snappy. It can decode Snappy content but S2 content > cannot be decoded by Snappy. S2 is aimed for high throughput, so it > features concurrent compression for bigger payloads (streams). > > Benefits over Snappy: > > - > > Better compression > - > > Concurrent stream compression - several GB/sec. > - > > Faster decompression > - > > Ability to quickly skip forward in compressed stream > - > > Compatible with Snappy compressed content > - > > Smaller max block size overhead on incompressible blocks. > - > > An alternative, more efficient, but slightly slower compression mode > available. > - > > Block concatenation. > - > > Automatic stream size padding. > > Drawbacks over Go Snappy: > > - > > Not optimized for 32 bit systems. > - > > No AMD64 assembler compression implementation yet, meaning slightly > slower compression speed on 1 core CPU. > - > > Uses slightly more memory due to larger blocks and concurrency > (configurable). > > > The decompression compatibility means S2 can be used as a one-way upgrade > to Snappy without data recompression. > > This package is aimed at replacing Snappy as a high speed compression > package. If you are mainly looking for better compression zstandard > <https://github.com/klauspost/compress/tree/master/zstd#zstd> gives > better compression, but typically at speeds slightly below "better" mode in > this package. > > Github, with more details and benchmarks: > https://github.com/klauspost/compress/tree/master/s2#s2-compression > <https://www.google.com/url?q=https%3A%2F%2Fgithub.com%2Fklauspost%2Fcompress%2Ftree%2Fmaster%2Fs2%23s2-compression&sa=D&sntz=1&usg=AFQjCNEIU8lad3StKqSz27Uf74qwoFVcjw> > > > -- You received this message because you are subscribed to the Google Groups "golang-nuts" group. To unsubscribe from this group and stop receiving emails from it, send an email to golang-nuts+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/golang-nuts/8bd0082b-ee88-4325-a0c2-6fd09209093b%40googlegroups.com.
