free seo tools
SEO.to / 42

Mini site crawler

Enter a URL and the tool crawls up to 40 pages on the same host, following internal links, and reports each page’s status, title and outbound link count.

Same host only, capped at 40 pages, one polite request at a time.

What a small crawl reveals

A crawl of your own home page and its links shows the indexable surface at a glance: 404s, redirects, missing titles, and pages with no links. It is a smoke test, not an enterprise crawler.

Limits, on purpose

  • 40 pages maximum, same host only.
  • Internal links only; external domains are ignored.
  • One pass, no robots.txt, no JavaScript rendering.

Next