Take a look at the clang-local man page, it documents the difference between the OpenBSD base clang and stock llvm. You can try disabling some of the options to find which one (or combination of options) is causing the slowdown.
I would try building with -fno-stack-protector and -mno-retpoline first to see if either of those are the cause. - todd