WuwiAI

Can a crawler find your list of pages?

Looks for your sitemap the way a crawler does, reads it, and shows how many pages it lists and what the site says it is made of.

Free, no account, and nothing about the site or the result is stored.

What it fetches

  • robots.txt, once
  • The sitemap it declares, or /sitemap.xml and /sitemap_index.xml
  • Up to five child sitemaps

That is all. It identifies itself as WUWIBot and does not run JavaScript.

What happens to the result

Nothing. The result is shown to you and not kept. The one thing recorded is a count of lookups, against the site that was read and a scrambled form of your network address, so the tool cannot be used to hammer somebody else’s site.

Questions people ask

Do I need a sitemap?

A small site whose every page is linked from another does fine without one. It starts to matter when pages exist that nothing links to, or when the site is large enough that a crawler will not reach everything by following links.

Does a sitemap mean my pages are indexed?

No. A sitemap says what exists. Whether a search engine has indexed each page is something only that search engine knows, and Google reports it in Search Console.

Why does it say robots.txt does not declare it?

The sitemap was found by trying the usual addresses. That works for crawlers that guess the same way, and a Sitemap line in robots.txt is how every crawler finds it without guessing.

More free tools

Free, and it stays free

What an account adds to this check

The check reads a site once. An account keeps reading it, connects the sources a crawl cannot see, and tells you when something changes. No card is asked for, and the free plan does not expire.

  • Pages read

    This check:12
    Watch · free:25, and one full crawl of up to 150
    Pro · $29 a month:25, and full crawls of up to 2,000
  • Findings, with where to fix each and what done looks like

    This check:3 on the page, all of them by email
    Watch · free:Top 10, ranked
    Pro · $29 a month:All of them
  • Re-checked on a schedule, with an email when something changes

    This check:Not included
    Watch · free:Weekly
    Pro · $29 a month:Weekly
  • Google Search Console, Analytics and Business Profile

    This check:Not included
    Watch · free:Connected, read-only
    Pro · $29 a month:Connected, read-only
  • Where you rank for the searches that matter

    This check:Not included
    Watch · free:20 keywords, down to a city, checked monthly
    Pro · $29 a month:100 keywords, down to a city, checked weekly
  • Compared with competitors

    This check:Not included
    Watch · free:1
    Pro · $29 a month:2, with a written plan
  • History kept

    This check:Nothing is stored
    Watch · free:90 days
    Pro · $29 a month:12 months
Create a free account

One sign-in with WUWI ID. No card, and nothing is promised about rankings or traffic.