Re: [go-nuts] S2 Compression Index

Kanak -- notice you can trade space for time using the various settings of zstandard. Compression is data dependent, but if you can afford the time, zstandard at 11 will do its hardest to make the compressed data as small as possible. It will take alot of time, but depending on your application,

Re: [go-nuts] S2 Compression Index

Ah, I believe Klaus Post wrote S2 as a faster version of Snappy. I believe it is his own algorithm. He aimed for very fast execution on non-compressible data, and for snappy compatibility in one direction. https://pkg.go.dev/github.com/klauspost/compress/s2 "S2 is designed to have high throughp

Re: [go-nuts] S2 Compression Index

On Mon, Jun 2, 2025 at 1:52 PM Robert Engels wrote: > Have you looked at the S2 Geometry library? > http://s2geometry.io/about/overview.html > > That's a different S2 than Kanak is talking about. I think it is the S2 implementation in https://github.com/klauspost/compress. On Jun 2, 2025, at 3

Re: [go-nuts] S2 Compression Index

Ah thanks, but then in the S2 docs it states to use zstandard for better compression https://github.com/klauspost/compress/tree/master/zstd#zstdOn Jun 2, 2025, at 5:30 PM, Robert Snedegar wrote:On Mon, Jun 2, 2025 at 1:52 PM Robert Engels wrote:Have you looked at the S2 Ge

Re: [go-nuts] S2 Compression Index

Have you looked at the S2 Geometry library? http://s2geometry.io/about/overview.htmlOn Jun 2, 2025, at 3:33 PM, Kanak Bhatia wrote:Hi Everyone,I’m currently working with MinIO and diving into its use of s2 compression for optimizing object storage performance. One area I’m curious about is the S2