to speedup ssh connect time a little,

ssh -o GSSAPIAuthentication=no user@host

or add it to your ssh config

GSSAPIAuthentication no