07-15-2023, 08:41 PM
I'm glad it's finally open. I see the bots crawling and sort through them, block as needed... ESPECIALLY during the past year. I've made a few threads talking about the uptick in AI crawlers, which is what I hate the most... pure theft. I don't block Google or Bing though and they are the ones trawling the most. Of course Bing is straight AI now. I still don't want to block the MAIN search engines. Over the years I have discovered the most troubling bot activity from sources that aren't well known. It's a rabbit hole. Keep your site up and running for some years, watch the traffic and you will see. It's different than it used to be in years past.
