[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Re: Best operating system according to MSN.com



-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Pigeon <jah.pigeon@ukonline.co.uk> writes:

> I must say I found it vaguely amusing to see that while so far Google
> has only indexed the top-level page of my website, MSN-Search has
> crawled the whole thing, including the odd references to "Microshite"
> and plugs for Debian... :-)

I saw no reason to make Microsoft's search engine more useful (or make
money off my content by extension), so here's my robots.txt.  Given
that Google delivers most of my hits from search engines, and MSN
usually only gives me four or five a year...

User-agent: MSNBot
Disallow: /
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.2.5 (GNU/Linux)

iD8DBQFBlpwxUzgNqloQMwcRAi8NAJ9hDG3pW0lTIRDMmvnlj4k9L90yKACeKj5O
aZFcKdpFRmFDc0SRAPd+W1g=
=/pIU
-----END PGP SIGNATURE-----



Reply to: