bluedragonz / bad-bot-blocker Goto Github PK

Maybe this list can help

http://www.askapache.com/htaccess/blocking-bad-bots-and-scrapers-with-htaccess/

My fastcomet hosting is already using ModSecurity firewall. In this case is still ussefull to use this script or not?

SetEnvIfNoCase User-Agent "^LinkScan/8.1a.Unix" bad_bo
SetEnvIfNoCase User-Agent "^LNSpiderguy" bad_bott

should be:
SetEnvIfNoCase User-Agent "^LinkScan/8.1a.Unix" bad_bot
SetEnvIfNoCase User-Agent "^LNSpiderguy" bad_bot

yandex is good bot ))
its more popular that google in Russia and have some audience in exUSSR, Turkey and so on

How can i specifically block a site or any type of bot using by that site to scrap my content. It is scraping my content and publishing as their own.
Please help.

Are there plans to make this rules for Nginx Webserver?

Hi
Thank you for this resource. I found this as site ground staff recommending this as a resource.
I have a wordpress site and have a question on any side effects of having these lines -

Options All -Indexes
RewriteEngine on

I already have the later in a block so have removed it. The other I am not sure about or if I need it. I am also using this in a parent folder for a few sub sites to all share the same bad crawl traffic.

Thanks

Not an issue, just a thank you.

Please, add the user agent "ZmEu".