Figured out the issue in the end. After I installed the readline-devel package in my distribution, reran ./configure && make, and now I can use the readline module.
Maybe it's worth going through the effort to provide a different error message when guile-readline cannot be linked?