I have found the exact reason that people were getting lag. The ident check was NOT turned off, and all of the people that were having problems were behind a firewall that wasn't letting ident requests back in. So this obviously has to wait for 26 seconds before it times out... hence the 20+ second delay. Hope this helps anyone else having similar problems.
