appsec-bot-challenge-exclude-search-engines
WAF configuration
- Version
- 0.3
Install with a top-level collection
3 collections include itsudo cscli collections install crowdsecurity/appsec-bot-challengeInstalls 2 parsers and 2 scenarios, via WAF - Bot Challenge Good Bots.
View WAF - Bot Challenge →Installation
sudo cscli appsec-configs install crowdsecurity/appsec-bot-challenge-exclude-search-enginesThen reload CrowdSec: sudo systemctl reload crowdsec
Sign in to see which of your engines run it →Configuration
name: crowdsecurity/appsec-bot-challenge-exclude-search-engines# Skip the challenge for verified search-engine crawlers (matched against their published IP/rDNS ranges).# Do not edit this file to add your own exclusions, create a custom config.inband:pre_eval:- filter: MatchKnownBot(req.RemoteAddr, req.UserAgent(), req.URL.Path, "legit_bots/googlebot.json")apply:- ExemptFromChallenge("googlebot")- filter: MatchKnownBot(req.RemoteAddr, req.UserAgent(), req.URL.Path, "legit_bots/googleother.json")apply:- ExemptFromChallenge("googleother")- filter: MatchKnownBot(req.RemoteAddr, req.UserAgent(), req.URL.Path, "legit_bots/bingbot.json")apply:- ExemptFromChallenge("bingbot")- filter: MatchKnownBot(req.RemoteAddr, req.UserAgent(), req.URL.Path, "legit_bots/applebot.json")apply:- ExemptFromChallenge("applebot")- filter: MatchKnownBot(req.RemoteAddr, req.UserAgent(), req.URL.Path, "legit_bots/amazonbot.json")apply:- ExemptFromChallenge("amazonbot")- filter: MatchKnownBot(req.RemoteAddr, req.UserAgent(), req.URL.Path, "legit_bots/yandex.json")apply:- ExemptFromChallenge("yandex")- filter: MatchKnownBot(req.RemoteAddr, req.UserAgent(), req.URL.Path, "legit_bots/baidu.json")apply:- ExemptFromChallenge("baidu")- filter: MatchKnownBot(req.RemoteAddr, req.UserAgent(), req.URL.Path, "legit_bots/yahoo.json")apply:- ExemptFromChallenge("yahoo")- filter: MatchKnownBot(req.RemoteAddr, req.UserAgent(), req.URL.Path, "legit_bots/sogou.json")apply:- ExemptFromChallenge("sogou")- filter: MatchKnownBot(req.RemoteAddr, req.UserAgent(), req.URL.Path, "legit_bots/qwant.json")apply:- ExemptFromChallenge("qwant")- filter: MatchKnownBot(req.RemoteAddr, req.UserAgent(), req.URL.Path, "legit_bots/babbar.json")apply:- ExemptFromChallenge("babbar")- filter: MatchKnownBot(req.RemoteAddr, req.UserAgent(), req.URL.Path, "legit_bots/duckduckbot.json")apply: