robots
Attached is a robots.txt file I use
to cut down on the e-mail harvesters
the spammers use. The level of junk
mail I receive went up by leaps and
bounds after I used one of the mailing
lists. This file might help cut down
on that.
--
Keith Parkansky
keithp@execpc.com
http://www.execpc.com/~keithp
http://www.goingtovegas.com
--
This message and any attachments
were automatically scanned for
viruses prior to being sent.
User-agent: Crescent Internet ToolPak HTTP OLE Control v.1.0
Disallow: /
User-agent: Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0) Fetch API Request
Disallow: /
User-agent: Crescent
Disallow: /
User-agent: Alexibot
Disallow: /
User-agent: ia_archiver
Disallow: /
User-agent: CherryPickerSE/1.0
Disallow: /
User-agent: CherryPickerElite/1.0
Disallow: /
User-agent: webbandit/4.45.0
Disallow: /
User-agent: Microsoft URL Control - 6.00.8862
Disallow: /
User-agent: EmailSiphon
Disallow: /
User-agent: Teleport Pro/1.29.1820
Disallow: /
User-agent: Mozilla/2.0 (compatible; MS FrontPage 4.0)
Disallow: /
Reply to: