Forgive me if I'm being silly but just because the kernel recognizes the SD card it does not follow that the software to read it is built into _base_. I hardly ever use an SD card but from what I remember you have install pcsc-tools from ports to use one. If this is so then you will _never_ be able to boot with a keydisk on the SD card. You must use the USB.
Good Luck
