Re: Got a puzzle here
On Friday 01 November 2019 12:29:38 Dan Purgert wrote:
> Gene Heskett wrote:
> > [...]
> > Humm. in /var/log/httpd/other_vhosts_access.log, is looks as if both
> > www.yandex.com/bots and www.semrush.com/bot.html are trying to
> > download all of my nitros9 stuff, which is a unix like OS for the
> > trs-80 color computer.
>
> Sounds like you might want a robots.txt file in there, to keep them
> from grabbing it.
I have 2 or 3 in there now. Where is the most effective place to put it?
Cheers, Gene Heskett
--
"There are four boxes to be used in defense of liberty:
soap, ballot, jury, and ammo. Please use in that order."
-Ed Howdershelt (Author)
If we desire respect for the law, we must first make the law respectable.
- Louis D. Brandeis
Genes Web page <http://geneslinuxbox.net:6309/gene>
Reply to: