Hi Robert, > I think that solving the problems around using a dictionary is going > to be really hard. Can we see some evidence that the results will be > worth it?
Compression dictionaries give a good compression ratio (~50%) and also increase TPS a bit (5-10%) due to better buffer cache utilization. At least according to synthetic and not trustworthy benchmarks I did some years ago [1]. The result may be very dependent on the actual data of course, not to mention particular implementation of the idea. [1]: https://github.com/afiskon/zson/blob/master/docs/benchmark.md -- Best regards, Aleksander Alekseev