Dear Ivan, Thanks for that explaination! I think it explains the slowness clearly.
It is possible to use carray is in Rust [1] so it might be available in R in the future(?) I'll look into rusqlite some time at least. sqlite is supposed to be one of the fastest sql implementations. Realm [2] might be faster, but I don't know how to use it in R so ... I thought someone might suggest Redis, but I think it is way slower. sqlite with indexes and the traditional way of doing that by writing in a temporary table might just be it ... Best, Rasmus [1] https://docs.rs/rusqlite/0.24.2/rusqlite/vtab/array/index.html [2] https://en.wikipedia.org/wiki/Realm_(database) [3] https://en.wikipedia.org/wiki/Redis
signature.asc
Description: PGP signature
______________________________________________ R-help@r-project.org mailing list -- To UNSUBSCRIBE and more, see https://stat.ethz.ch/mailman/listinfo/r-help PLEASE do read the posting guide http://www.R-project.org/posting-guide.html and provide commented, minimal, self-contained, reproducible code.