I believe this is because you're trying to access the X server over TCP. Either use ssh -X (with /etc/ssh/sshd_config configured to allow forwarded X connections), or edit /etc/X11/xinit/xserverrc and remove the option to not listen to tcp. Andrew.