Okej the system starts to shape up. After some intensive hacking I managed to make a toolbox for piping binary and scheme streams. Currently it can pipe a list of 1000 000 elements typically around 1-4s.
see https://gitlab.com/tampe/stis-engine On Sun, Aug 8, 2021 at 10:27 PM Stefan Israelsson Tampe < stefan.ita...@gmail.com> wrote: > I will start the development of stis-engine that is based on fibers and > will experiment with applications that separate into different network > components. > > Among things I plan to add serializers, deserializers, zipping and zero mq > networking that works > with fibers. E.g. we will stream things with fiber pipelines, use non > blocking zero mq calls, avoid > allocating large bytevectors, and use as little stack as possible in the > code. > > This code depends on stis-data and optionally guile-persists > > References: > https://gitlab.com/tampe/stis-engine > https://gitlab.com/tampe/guile-persist > https://gitlab.com/tampe/stis-data/ >
