The Sitebulb MCP is live. Bring your crawl data into Claude & ChatGPT. The Sitebulb MCP is live. See how it works

High
This Hint is very important, and definitely warrants attention.

Confirm important pages are indexable

What to check

Ensure high-value pages (and quality pages in general) such as landing pages, product pages, and key content pages are indexable and not accidentally blocked by robots.txt or a noindex meta robots tag.

  • Flag pages you'd expect to be indexed but aren't, with details on why (meta robots, robots.txt, etc.).

  • Pay special attention to the priority URLs defined during kickoff.

How to check

View Indexable pages specifically and confirm the 'What to check' items.

Why this matters

If key pages can't be indexed, they can't rank, no matter how good they are. An accidental noindex or disallow on an important template can silently remove entire sections from search.

When this typically occurs

  • A noindex tag or disallow rule was applied to a template by mistake.

  • Priority pages were overlooked when indexing rules were set.

Further reading

Tools

Sitebulb

Contents

    Related Sitebulb hints

    None.

    Sitebulb Desktop

    Find, fix and communicate technical issues with easy visuals, in-depth insights, & prioritized recommendations across 300+ SEO issues.

    • Ideal for SEO professionals, consultants & marketing agencies.

    Sitebulb Cloud

    Get all the capability of Sitebulb Desktop, accessible via your web browser. Crawl at scale without project, crawl credit, or machine limits.

    • Perfect for collaboration, remote teams & extreme scale.
    ;