Hi there, Thank you for those benchmarks. The problem is pretty well understood: it's an issue with the SSH key lookup:
https://gitlab.com/gitlab-com/operations/issues/99 We're working on this issue, and we'll provide updates there. Thank you for your patience. On Thu, May 12, 2016 at 6:01 AM, Jean-Baptiste Quenot <cara...@gmail.com> wrote: > Hi there, > > Thanks for providing gitlab.com for free, at our company we did a > successful migration from our hosted instance to the public shared > gitlab.com instance. > > The bad news is that all developers are experiencing very slow response > times over SSH. > > Facts: > > $ time ssh g...@gitlab.com true > > GitLab: Disallowed command > > ssh g...@gitlab.com true 0.02s user 0.00s system 0% cpu *4.099 total* > > > $ time ssh g...@gitlab.com true > > GitLab: Disallowed command > > ssh g...@gitlab.com true 0.02s user 0.01s system 0% cpu *6.612 total* > > > $ time ssh g...@gitlab.com true > > GitLab: Disallowed command > > ssh g...@gitlab.com true 0.02s user 0.01s system 0% cpu *12.394 total* > > > Wow, 12 seconds to establish the SSH connection is a whole lot of time! > > > I hear you say: probably your connection is slow, etc. First I checked on > a dedicated server, and got the same response times. Then, here is more > detailed timing information: > > > $ time ssh -v g...@gitlab.com true 2>&1 | /usr/local/bin/ts > > May 12 12:53:14 OpenSSH_6.9p1, LibreSSL 2.1.8 > > May 12 12:53:14 debug1: Reading configuration data /Users/jbq/.ssh/config > > May 12 12:53:14 debug1: /Users/jbq/.ssh/config line 26: Applying options > for * > > May 12 12:53:14 debug1: /Users/jbq/.ssh/config line 34: Applying options > for * > > May 12 12:53:14 debug1: Reading configuration data /etc/ssh/ssh_config > > May 12 12:53:14 debug1: /etc/ssh/ssh_config line 20: Applying options for * > > May 12 12:53:14 debug1: /etc/ssh/ssh_config line 53: Applying options for * > > May 12 12:53:14 debug1: Connecting to gitlab.com [104.210.2.228] port 22. > > May 12 12:53:14 debug1: fd 3 clearing O_NONBLOCK > > May 12 12:53:14 debug1: Connection established. > > May 12 12:53:14 debug1: identity file /Users/jbq/.ssh/id_rsa type 1 > > May 12 12:53:14 debug1: key_load_public: No such file or directory > > May 12 12:53:14 debug1: identity file /Users/jbq/.ssh/id_rsa-cert type -1 > > May 12 12:53:14 debug1: identity file /Users/jbq/.ssh/id_dsa type 2 > > May 12 12:53:14 debug1: key_load_public: No such file or directory > > May 12 12:53:14 debug1: identity file /Users/jbq/.ssh/id_dsa-cert type -1 > > May 12 12:53:14 debug1: key_load_public: No such file or directory > > May 12 12:53:14 debug1: identity file /Users/jbq/.ssh/id_ecdsa type -1 > > May 12 12:53:14 debug1: key_load_public: No such file or directory > > May 12 12:53:14 debug1: identity file /Users/jbq/.ssh/id_ecdsa-cert type -1 > > May 12 12:53:14 debug1: key_load_public: No such file or directory > > May 12 12:53:14 debug1: identity file /Users/jbq/.ssh/id_ed25519 type -1 > > May 12 12:53:14 debug1: key_load_public: No such file or directory > > May 12 12:53:14 debug1: identity file /Users/jbq/.ssh/id_ed25519-cert type > -1 > > May 12 12:53:14 debug1: Enabling compatibility mode for protocol 2.0 > > May 12 12:53:14 debug1: Local version string SSH-2.0-OpenSSH_6.9 > > May 12 12:53:15 debug1: Remote protocol version 2.0, remote software > version OpenSSH_6.6.1p1 Ubuntu-2ubuntu2.7 > > May 12 12:53:15 debug1: match: OpenSSH_6.6.1p1 Ubuntu-2ubuntu2.7 pat > OpenSSH_6.6.1* compat 0x04000000 > > May 12 12:53:15 debug1: Authenticating to gitlab.com:22 as 'git' > > May 12 12:53:15 debug1: SSH2_MSG_KEXINIT sent > > May 12 12:53:15 debug1: SSH2_MSG_KEXINIT received > > May 12 12:53:15 debug1: kex: server->client chacha20-poly1...@openssh.com > <implicit> none > > May 12 12:53:15 debug1: kex: client->server chacha20-poly1...@openssh.com > <implicit> none > > May 12 12:53:15 debug1: expecting SSH2_MSG_KEX_ECDH_REPLY > > May 12 12:53:15 debug1: Server host key: ssh-rsa > SHA256:ROQFvPThGrW4RuWLoL9tq9I9zJ42fK4XywyRtbOz/EQ > > May 12 12:53:15 debug1: Host 'gitlab.com' is known and matches the RSA > host key. > > May 12 12:53:15 debug1: Found key in /Users/jbq/.ssh/known_hosts:68 > > May 12 12:53:15 debug1: SSH2_MSG_NEWKEYS sent > > May 12 12:53:15 debug1: expecting SSH2_MSG_NEWKEYS > > May 12 12:53:15 debug1: SSH2_MSG_NEWKEYS received > > May 12 12:53:15 debug1: SSH2_MSG_SERVICE_REQUEST sent > > May 12 12:53:15 debug1: SSH2_MSG_SERVICE_ACCEPT received > > May 12 12:53:15 debug1: Authentications that can continue: publickey > > May 12 12:53:15 debug1: Next authentication method: publickey > > May 12 12:53:15 debug1: Offering RSA public key: /Users/jbq/.ssh/id_rsa > > May 12 12:53:18 debug1: Server accepts key: pkalg ssh-rsa blen 279 > > May 12 12:53:20 debug1: Authentication succeeded (publickey). > > May 12 12:53:20 Authenticated to gitlab.com ([104.210.2.228]:22). > > May 12 12:53:20 debug1: channel 0: new [client-session] > > May 12 12:53:20 debug1: Requesting no-more-sessi...@openssh.com > > May 12 12:53:20 debug1: Entering interactive session. > > May 12 12:53:20 debug1: Remote: Forced command. > > May 12 12:53:20 debug1: Remote: Port forwarding disabled. > > May 12 12:53:20 debug1: Remote: X11 forwarding disabled. > > May 12 12:53:20 debug1: Remote: Agent forwarding disabled. > > May 12 12:53:20 debug1: Remote: Pty allocation disabled. > > May 12 12:53:20 debug1: Remote: Forced command. > > May 12 12:53:20 debug1: Remote: Port forwarding disabled. > > May 12 12:53:20 debug1: Remote: X11 forwarding disabled. > > May 12 12:53:20 debug1: Remote: Agent forwarding disabled. > > May 12 12:53:20 debug1: Remote: Pty allocation disabled. > > May 12 12:53:20 debug1: Sending environment. > > May 12 12:53:20 debug1: Sending env LANG = fr_FR.UTF-8 > > May 12 12:53:20 debug1: Sending env LC_ALL = en_US.UTF-8 > > May 12 12:53:20 debug1: Sending command: true > > May 12 12:53:21 GitLab: Disallowed command > > May 12 12:53:21 debug1: client_input_channel_req: channel 0 rtype > exit-status reply 0 > > May 12 12:53:21 debug1: client_input_channel_req: channel 0 rtype > e...@openssh.com reply 0 > > May 12 12:53:21 debug1: channel 0: free: client-session, nchannels 1 > > May 12 12:53:21 debug1: fd 1 clearing O_NONBLOCK > > May 12 12:53:21 Transferred: sent 3356, received 3320 bytes, in 0.3 seconds > > May 12 12:53:21 Bytes per second: sent 11011.4, received 10893.3 > > May 12 12:53:21 debug1: Exit status 1 > > ssh -v g...@gitlab.com true 2>&1 0.01s user 0.01s system 0% cpu 6.804 > total > > /usr/local/bin/ts 0.02s user 0.01s system 0% cpu 6.803 total > > > As you can see, most of the time is spent after the connection is > established, starting at *Offering RSA public key*, server takes 5 > seconds to perform authentication and accept the key until *Authentication > succeeded*. > > > Is this a known problem? Any plans to solve this? > > > Looking for your input. > > > Best regards, > > -- > > Jean-Baptiste Quenot > > -- > You received this message because you are subscribed to the Google Groups > "GitLab" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to gitlabhq+unsubscr...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/gitlabhq/dfcda93b-6cf0-4664-9ee8-09c99cd72a58%40googlegroups.com > <https://groups.google.com/d/msgid/gitlabhq/dfcda93b-6cf0-4664-9ee8-09c99cd72a58%40googlegroups.com?utm_medium=email&utm_source=footer> > . > For more options, visit https://groups.google.com/d/optout. > -- You received this message because you are subscribed to the Google Groups "GitLab" group. To unsubscribe from this group and stop receiving emails from it, send an email to gitlabhq+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/gitlabhq/CAMBWrQmd877L1L%3D4oCryuwgxDqqzJCR05XrstmOLNEK%2BRPz_Jw%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.