Before you go randomly blocking bots try and find out what they do. The Facebook bot is used by Facebook when someone posts a link to your site on Facebook. It will gather data about the page so it can manipulate the raw link intot a more human friendly link, e.g. using the page title as link text. This IMO would be largely beneficial for your site.
For legitimate bots like this that identify themselves they typically obey robots.txt which is by far the best way to manage bots if they obey it.
https://developers.google.com/search/do ... bots/intro
For legitimate bots like this that identify themselves they typically obey robots.txt which is by far the best way to manage bots if they obey it.
https://developers.google.com/search/do ... bots/intro
Statistics: Posted by thecoalman — Sun Apr 28, 2024 6:34 pm