Indexation and Canonicals

Track 3 · Lesson 2 of 6 · about 15 minutes

Indexation and canonicals

Everything in this lesson hangs on one distinction: a directive is obeyed, a hint is considered. Confusing the two is behind most indexation mysteries.

The directive: noindex

A robots meta noindex (or its X-Robots-Tag header equivalent) is obeyed once the page is crawled — reliably, but not instantly, and only if the crawler can reach the page carrying it. It is the correct tool for pages that must exist but must not rank: internal search results, thin utility pages, staging leftovers. One long-run behaviour worth knowing: pages that stay noindexed for a long time tend to be crawled less and eventually treated like nofollow paths — fine for genuinely dead-end pages, worth remembering for anything temporary.

The hint: rel=canonical

Canonical declares which URL you prefer when several carry substantially the same content. Google weighs it alongside your redirects, internal links, sitemap entries and external links — and picks its own winner. When Search Console says “Duplicate, Google chose different canonical than user”, it is telling you your signals disagree: your canonical points one way while your internal links and sitemap keep voting the other. The fix is alignment, not repetition — make every signal point at the same URL and the choice almost always follows.

Canonicals also cannot glue together pages that are genuinely different. A canonical from a real page to an unrelated one is usually just ignored.

Why crawled pages stay unindexed

“Crawled — currently not indexed” is a value judgement: Google fetched the page and declined to store it. No tag fixes this, because nothing is technically wrong. The causes are editorial — near-duplication of something already indexed, thinness, or a site whose overall quality budget is spent. The honest responses are consolidation (merge and redirect), differentiation (give the page something no stored page has), or acceptance (not every page needs to be indexed).

One URL per thing, everywhere

The quiet discipline underneath all of this: http/https, www/non-www, trailing slash, case, and parameters each multiply your URL space. Pick one form, 301 the rest, and — the step most sites skip — make internal links use the canonical form directly rather than bouncing through redirects. Alignment is cheap to maintain and expensive to restore.

Going deeper: technical SEO guides · URL Inspection walkthrough.