[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Re: new, not nice web bots disposal



On Wednesday 26 February 2020 08:27:33 Greg Wooledge wrote:

> On Wed, Feb 26, 2020 at 03:57:51AM -0500, Gene Heskett wrote:
> > over the last 90 days or so, we seem to have been plauged with a new
> > breed of bots scanning our web pages, and they are not just indexing
> > our web pages I don't mind that, but they are ignoring our
> > robots.txt
>
> I can believe this.  But it's better if you SHOW us the actual logfile
> entries (not all of them, obviously -- just a reasonable sample).
>
> If the bots have a recognizable user-agent, you can just configure
> your web server to block queries from that user-agent.  Then you don't
> have to deal with iptables, nftables, or whatever they're calling
> it this year.

I've had this in place now long enough the good examples like all the 
russian sembot's have probably all logrotated into /dev/null. This just 
showed up this morning, but no clue what it might be.  Blocked it 
anyway. 46th rule.

coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:06:58 -0500] "-" 
408 0 "-" "-"
coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:06:58 -0500] "-" 
408 0 "-" "-"
coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:07:58 -0500] "-" 
408 0 "-" "-"
coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:07:58 -0500] "-" 
408 0 "-" "-"
coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:08:58 -0500] "-" 
408 0 "-" "-"
coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:08:58 -0500] "-" 
408 0 "-" "-"
coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:09:58 -0500] "-" 
408 0 "-" "-"
coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:09:58 -0500] "-" 
408 0 "-" "-"
coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:10:58 -0500] "-" 
408 0 "-" "-"
coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:10:58 -0500] "-" 
408 0 "-" "-"
coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:11:58 -0500] "-" 
408 0 "-" "-"
coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:11:59 -0500] "-" 
408 0 "-" "-"
coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:12:58 -0500] "-" 
408 0 "-" "-"
coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:12:58 -0500] "-" 
408 0 "-" "-"
coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:13:59 -0500] "-" 
408 0 "-" "-"
coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:13:59 -0500] "-" 
408 0 "-" "-"
coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:14:59 -0500] "-" 
408 0 "-" "-"
coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:14:59 -0500] "-" 
408 0 "-" "-"
coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:15:59 -0500] "-" 
408 0 "-" "-"
coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:15:59 -0500] "-" 
408 0 "-" "-"
coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:51:43 -0500] "-" 
408 0 "-" "-"
coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:51:43 -0500] "-" 
408 0 "-" "-"
coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:20:29:32 -0500] "-" 
408 0 "-" "-"
coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:20:29:32 -0500] "-" 
408 0 "-" "-"

No clue, butt dial? PROXAD.net someplace in France.

Cheers, Gene Heskett
-- 
"There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order."
-Ed Howdershelt (Author)
If we desire respect for the law, we must first make the law respectable.
 - Louis D. Brandeis
Genes Web page <http://geneslinuxbox.net:6309/gene>


Reply to: