This is an amazing talk from last year 2024 March 22 Qcon from the TigerBeetle CEO, Joran Greef. Zig has lessons for Go.
"Redesigning OLTP for a New Order of Magnitude" https://www.infoq.com/presentations/redesign-oltp/ Early on the talks covers that latest trends in memory vs network vs disk, (hint: at 800GB ethernet means memory is now the bottleneck, and it is slower than disk(!)). Greef also talks about Deterministic Simulation Testing (DST) and gives a highly compelling demo for why you want it. He points out that replication algorithms like Paxos and Raft, and points out that a single sector fault on one machine can create global data loss. Yikes. (See 35 minutes in) Again, the video at 35:00 gives a very strong critique of Raft vs VSRR arguing raft too simple/inappropriate (assumes perfect disks) and for actual faulty disks can get blocked and not be fault tolerant at all. They use VSRR in TigerBeetle, plus NASA/Fortran style "pre-allocate all memory". TigerBeetle is Apache 2 open source. It is written in Zig but has lessons for software using Go throughout. His discussion of optimizing write compaction in LSM trees is fascinating, as is integrating consensus with replication (2018 best paper at FAST from Alagappan et al), and using speculative replicated state machine execution to avoid stalling on bad storage sectors -- I expect all of these to be the future of databases. Five stars. Enjoy, Jason -- You received this message because you are subscribed to the Google Groups "golang-nuts" group. To unsubscribe from this group and stop receiving emails from it, send an email to golang-nuts+unsubscr...@googlegroups.com. To view this discussion visit https://groups.google.com/d/msgid/golang-nuts/b9aab0c5-e52e-4950-a98b-11f539c56c83n%40googlegroups.com.
