Not sure what's going on, it's possible my flash drive is corrupted, but Guix not giving any indications of progress is not very helpful.
I managed to install it once from this flash drive and I haven't overwritten it since, so either I'm not hitting different code paths that are stored at corrupted locations or the installer is just borked.