Try setting "IdentitiesOnly yes" in your ssh config file. It seems that if you have lots of public keys, then by default on the newer ssh, the key agent will offer them all. Setting "IdentitiesOnly yes" will make ssh only go for the correct key, and not all of them!
(I had a similar problem, and this seemed to be the fix for me) -- openssh public key auth broken if one has many keys but only in X11 https://bugs.launchpad.net/bugs/309160 You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to openssh in ubuntu. -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs