Black Friday: New customers get 20% off any Sitebulb annual plan FOREVER! Offer ends Dec 2. Sign up now!

Dealing with Indexability issues?

Crawl your website with Sitebulb for 300+ tech SEO checks

Try for Free
High This Hint is very important, and definitely warrants attention. Issue This Hint represents an error or problem that needs to be fixed.

Canonical points to a disallowed URL

This means that the URL in question has a canonical element whereby the canonical URL is disallowed in robots.txt.

Why is this important?

The point of a canonical is to explicitly and unambiguously indicate a preferred URL. However in this situation, the canonical instructions are sending conflicting messages to the search engines - which typically means they will ignore the canonicals entirely and try to make their own decisions about what 'the canonical URL' should be.

The net result is that it could lead to incorrect URLs being indexed, resulting in duplicate content issues.

What does the Hint check?

This Hint will trigger for any internal URL which contains a canonical link element that uses a disallow URL as the canonical URL.

Examples that trigger this Hint:

Consider the URL: https://example.com/page-a

The Hint would trigger for this URL if it had a canonical URL pointing at another internal page,

<link rel="canonical" href="https://example.com/page-b" />

where this canonical URL https://example/com/page-b is disallowed in robots.txt:

User-agent: *
Disallow: /page-b
...

How do you resolve this issue?

This is a scenario where the canonical configuration is completely broken. You will first need to establish if Page B is indeed the correct canonical for Page A, and if so remove the disallow rule from robots.txt. If in fact Page B should be disallowed, then Page A should be updated to change the canonical tag, either to become self-referential or to point to another URL.

Issues like this will typically need to be resolved on a case by case basis. 

Sitebulb Desktop

Find, fix and communicate technical issues with easy visuals, in-depth insights, & prioritized recommendations across 300+ SEO issues.

  • Ideal for SEO professionals, consultants & marketing agencies.

Sitebulb Cloud

Get all the capability of Sitebulb Desktop, accessible via your web browser. Crawl at scale without project, crawl credit, or machine limits.

  • Perfect for collaboration, remote teams & extreme scale.