Kete Foy at
I didn't know about malicious crawlers or stopping them.
@kete@identi.ca Yep, It a strange and interesting field. Even on my relatively obscure webserver there is a constant flow of crawlers, log spammers, SEO crawlers, scrapers looking for email addresses, and then odd balls like that one.
Then add on to all that noise the script kiddies firing WordPress exploits at a non-wordpress blog. And other much more interesting attack attempts. Reading your webservers logs can be fun and informative. And really something that every webmaster should do.
Then add on to all that noise the script kiddies firing WordPress exploits at a non-wordpress blog. And other much more interesting attack attempts. Reading your webservers logs can be fun and informative. And really something that every webmaster should do.