AI crawlers now match Googlebot in traffic to our site (opens in new tab)
What traffic & bots flow to your site after you make it to the front page of Hacker News? Do AI bots crawl as much as Google? Which is the most aggressive bot? Which is the least and thriftiest?
Read the original article