2.34. Blocking bots

By default, the hosting blocks:

• Bots that create a senseless load on the site or scan it for vulnerabilities.
• Requests from IP addresses, which we consider to be bots, whose clients do not support JavaScript.

List of User-Agents who have limited access to hosting (in response to requests, they receive answer 403) and which cannot be unlocked:

1. JDatabaseDriverMysqli
2. 80legs.com
3. DLE_Spider.exe
4. xpymep.exe
5. libwww-perl
6. BOT for JCE
7. coccoc
8. heritrix
9. Aibot
10. exabot.com
11. butterfly
12. CareerBot
13. FTRF
14. www.exb.de
15. magpie-crawler
16. SISTRIX
17. radian6
18. BLEXBot
19. JikeSpider
20. Sosospider
21. Attentio
22. filterdb.iss.net
23. cmscrawler
24. tkl.iis.u-tokyo.ac.jp
25. J-BRO
26. ApacheBench
27. meanpathbot
28. IndoXploitTools

Some User-Agents used by bots are blocked due to meaningless load, but blocking can be disabled. This feature is available for bots:

1. SemrushBot
2. MegaIndex
3. Dotbot
4. LTX71
5. Nmap
6. velen.io
7. Re-re Studio
8. netEstate NE Crawler
9. statdom.ru
10. SEOkicks
11. 7Siters
12. Seekport Crawler
13. serpstatbot
14. panscient.com
15. ZoominfoBot
16. SearchAtlas
17. DuckDuckBot
18. AwarioRssBot
19. AwarioSmartBot
20. NetpeakSpiderBot
21. GetIntent
22. ia_archiver
23. AspiegelBot
24. WPScan
25. https://gdnplus.com
26. DuckDuckGo
27. ApacheBench
28. python-requests
29. BorneoBot
30. Ahrefs
31. MJ12Bot

To disable the lock, in site settings opposite "Don't block bots»Select the bots you don't want to block and save the changes:

Changes take effect within 10-15 minutes from the moment of saving.

Any other User-Agent can independently restrict access using directives in .htaccess.