Show HN: Crawlora-deadweb – tell if a domain is dead or just blocking your bot (opens in new tab)
Is a domain genuinely dead, or just blocking your bot? A passive, local, MIT Go CLI + library that classifies domain reachability (alive/redirect/blocked/dead). The open methodology behind the Craw...
Read the original article