πŸ“š General & Other

Diagnosing Why Pages Are Missing From the Index

"The page is not ranking" is three different problems with three different owners, and misdiagnosing which one you have wastes the most time of any error in technical SEO.

"The page is not ranking" is three different problems with three different owners, and misdiagnosing which one you have wastes the most time of any error in technical SEO.

Establish which layer failed first

Can the crawler reach it? Did it get indexed? Is it indexed but ranking poorly? Search Console's URL Inspection answers the first two directly. Skipping that check and going straight to content optimisation is the most common wasted month in the discipline.

Blocked and noindexed are opposite mistakes

A page blocked in robots.txt cannot be read, so a noindex tag on it is never seen β€” which is why blocked pages sometimes stay in the index indefinitely. To remove a page, allow crawling and use noindex. To save crawl budget on pages that should never be fetched, block them. Doing both at once achieves neither.

"Crawled β€” currently not indexed" is a quality signal

This status is not a technical fault. It means the page was fetched and judged not worth storing, which usually points at thin or duplicative content. No amount of technical work fixes it, and teams routinely spend weeks trying.

Route the fix to the right team

Crawl problems are engineering work. Indexing decisions are content problems. Ranking problems are competitive. Naming which one you have, before the meeting, is what stops the wrong team owning it.