Did you remember to restart the sshd on your amd64 system? If not, try disabling the new high performance stuff on the client. I had a problem logging into a solaris box until i disabled it. In my ~/.ssh/config file I added;
host <ip or hostname>
HPNDisabled yes
