Can a crawler find your list of pages?
Looks for your sitemap the way a crawler does, reads it, and shows how many pages it lists and what the site says it is made of.
What it fetches
- robots.txt, once
- The sitemap it declares, or /sitemap.xml and /sitemap_index.xml
- Up to five child sitemaps
That is all. It identifies itself as WUWIBot and does not run JavaScript.
What happens to the result
Nothing. The result is shown to you and not kept. The one thing recorded is a count of lookups, against the site that was read and a scrambled form of your network address, so the tool cannot be used to hammer somebody else’s site.
Questions people ask
Do I need a sitemap?
A small site whose every page is linked from another does fine without one. It starts to matter when pages exist that nothing links to, or when the site is large enough that a crawler will not reach everything by following links.
Does a sitemap mean my pages are indexed?
No. A sitemap says what exists. Whether a search engine has indexed each page is something only that search engine knows, and Google reports it in Search Console.
Why does it say robots.txt does not declare it?
The sitemap was found by trying the usual addresses. That works for crawlers that guess the same way, and a Sitemap line in robots.txt is how every crawler finds it without guessing.
More free tools
- AI crawler accessChatGPT, Claude, Perplexity, Gemini and four more, checked against your robots.txt.Check access
- Page checkTitle, description, headings, speed, canonical and markup for one page.Read this page
- Answer readinessQuestions, direct answers and markup on one page, and whether assistants may fetch it.Read this page
- Business identityThe name, phone, address and hours your page declares, shown as declared.Read this page
Free, and it stays free
What an account adds to this check
The check reads a site once. An account keeps reading it, connects the sources a crawl cannot see, and tells you when something changes. No card is asked for, and the free plan does not expire.
Pages read
This check:12Watch · free:25, and one full crawl of up to 150Pro · $29 a month:25, and full crawls of up to 2,000Findings, with where to fix each and what done looks like
This check:3 on the page, all of them by emailWatch · free:Top 10, rankedPro · $29 a month:All of themRe-checked on a schedule, with an email when something changes
This check:Not includedWatch · free:WeeklyPro · $29 a month:WeeklyGoogle Search Console, Analytics and Business Profile
This check:Not includedWatch · free:Connected, read-onlyPro · $29 a month:Connected, read-onlyWhere you rank for the searches that matter
This check:Not includedWatch · free:20 keywords, down to a city, checked monthlyPro · $29 a month:100 keywords, down to a city, checked weeklyCompared with competitors
This check:Not includedWatch · free:1Pro · $29 a month:2, with a written planHistory kept
This check:Nothing is storedWatch · free:90 daysPro · $29 a month:12 months
One sign-in with WUWI ID. No card, and nothing is promised about rankings or traffic.
