SEO • INDEXING
A page can exist, load correctly in a browser and still not appear in Google’s index. The reason is not always a penalty or a technical failure. Sometimes Google has not discovered the URL yet, sometimes a directive blocks indexing, sometimes another URL is selected as canonical, and sometimes Google simply decides that the page does not add enough distinct value to be included.
Short answer: why is Google not indexing a page?
The most common causes are: Google does not know the URL yet, noindex, robots.txt blocking crawling, an incorrect HTTP status, a canonical pointing elsewhere, duplicate or very similar content, weak internal linking, sitemap problems, JavaScript rendering issues, unstable hosting, parameter or filter duplication and low-value pages that Google chooses not to keep in the index.
The correct diagnosis starts by identifying which stage is failing: discovery, crawling, indexing or ranking.
First check whether the page is really not indexed
Use Google Search Console URL Inspection for the exact canonical URL. Check the indexing status, last crawl, user-declared and Google-selected canonical, crawl permission and whether indexing is allowed.
A site: search can be a quick clue, but it is not a reliable substitute for URL Inspection because Google does not promise that the operator shows a complete index.
“URL is on Google” does not guarantee visibility for every query
Indexing only means that Google may use the page in Search. Ranking is a separate stage. A URL can be indexed and still receive no impressions for the keyword you expect.
Crawling, indexing and ranking are three different stages
Crawling
Googlebot fetches the URL and its resources.
Indexing
Google processes the page and decides whether it should be stored and which canonical version represents the content.
Ranking
An indexed page competes with other results for particular searches. A problem at one stage should not be diagnosed as a problem at another.
1. Google does not know the URL yet
New pages can remain undiscovered when nothing links to them and they are absent from the sitemap.
What should you do?
- link to the page from a relevant indexed page
- include a canonical, indexable URL in the XML sitemap
- verify the sitemap in Search Console
- use URL Inspection and Request Indexing for an important new or significantly updated page
2. noindex blocks the page
A meta robots or HTTP header with noindex tells Google not to keep the page in the index.
Typical cases
- noindex left after development
- an SEO plugin setting applied to the wrong content type
- a template that outputs noindex site-wide
- staging settings copied to production
How do you check it?
Inspect the HTML and HTTP response and use Search Console Live Test. Verify both the page-level directive and any plugin or template setting that generates it.
Important: robots.txt can prevent Google from seeing noindex
If crawling is blocked, Google may not be able to fetch the page and read its meta robots directive. Do not treat robots.txt and noindex as interchangeable controls.
3. robots.txt blocks Googlebot
A broad Disallow can make important pages or assets unavailable for crawling.
Check particularly:
- rules copied from staging
- wildcards covering service or product paths
- blocked JavaScript or CSS required to understand the page
- conflicting user-agent groups
Do not edit robots.txt blindly
Some blocked paths are intentionally technical. Remove a rule only after confirming what those URLs are and whether they should be crawled.
4. The page does not return 200 OK
An important indexable URL should usually return a stable 200 response. A 404, 410, 5xx error or repeated redirect can prevent the intended page from being indexed.
If the URL redirects
Google will generally process the destination rather than the old URL. Check whether that is intentional and whether internal links and the sitemap already point directly to the final URL.
5. Canonical points to another page
If the page declares another URL as canonical, you are signalling that the other URL is the preferred version.
A common redesign mistake
A copied template keeps the canonical from a different page, so several new pages all point to one URL. The site looks correct, but Google receives contradictory signals.
6. Google chose a different canonical than you did
Canonical is a strong hint, not an absolute command. Google can select another version when the signals disagree.
Common conflicts
- internal links point to one version while canonical points to another
- the sitemap lists a duplicate rather than the preferred URL
- HTTP/HTTPS or www/non-www versions remain accessible
- parameter URLs contain almost identical content
Strengthen signal consistency
Use direct internal links, redirects where appropriate, self-canonicals on the preferred version and a sitemap that lists the same canonical URLs.
7. The page is a duplicate or near-duplicate
Google may consolidate similar pages and index only one representative URL. This is common with copied location pages, printer variants, tracking parameters and product variations.
This also affects ecommerce
Filters, sorting, category parameters and variants can create many URLs with nearly the same product set. Decide which combinations deserve indexation and which should be consolidated or kept out of the index.
8. The content has very little unique value
A technically indexable page is not automatically worth indexing. If the content repeats another page, contains only a few generic sentences or exists mainly to target another keyword variant, Google may decide not to include it.
Check:
- whether the page has its own search intent
- whether it answers a distinct user need
- whether it contains useful information not already covered elsewhere
- whether another URL should be the main page instead
9. What does “Crawled — currently not indexed” mean?
It means Google fetched the page but did not include it in the index at that time. The status does not reveal one universal cause.
It does not automatically mean:
- the page has a manual penalty
- the content is “too short”
- you need more backlinks immediately
- submitting the URL again will solve the problem
Review canonical signals, uniqueness, intent, internal links, rendering, site quality and whether the page should exist as a separate URL.
10. What does “Discovered — currently not indexed” mean?
Google knows the URL but has not crawled it yet, or has postponed crawling.
Check:
- server stability
- internal linking and page depth
- sitemap quality
- large numbers of low-value URLs
- parameter and filter spaces
- whether the URL is important enough within the site architecture
11. Weak internal linking
A page linked only from the sitemap can look unimportant. Internal links also help Google understand how the page relates to the rest of the site.
For an important page ask:
- does the navigation or a relevant hub link to it?
- do related articles link to it contextually?
- is it several clicks deep for no good reason?
- do the anchors describe the relationship naturally?
12. The sitemap contains the wrong URLs or omits important ones
A good sitemap should mainly contain URLs that are:
- canonical
- indexable
- 200 OK
- useful in organic search
Typical problems
Redirects, noindex URLs, outdated domains, parameter variants or missing newly published pages. A sitemap is a discovery aid, not a guarantee of indexation.
13. Request Indexing is not an “add to Google” button
Submitting a URL can ask Google to recrawl it, but Google still decides whether and when to index the page.
Do not click it repeatedly
Repeated submissions do not replace fixing the underlying problem.
When does Request Indexing make sense?
For an important new URL, a substantial content update or after you have fixed a specific technical indexing problem.
14. JavaScript hides the main content
If key content and links appear only after client-side scripts execute, a rendering failure can make the page much thinner to crawlers than it appears to users.
How do you check it?
Compare the raw HTML with the rendered version, use Search Console Live Test, inspect server-side responses and ensure that core content and links do not depend on fragile interactions.
15. The server is unstable
Frequent 5xx responses, timeouts, rate limits or security systems that block Googlebot can reduce successful crawling.
Check:
- server logs
- uptime and response times
- CDN/firewall rules
- hosting resource limits
- whether Googlebot receives the same response as normal users
16. A new domain needs time
A new site has little crawl history and few signals. It can take time for Google to discover, process and reassess the entire architecture. That is normal, but it is still worth checking technical basics rather than waiting blindly.
17. The page is indexed under another URL
Google may have consolidated the content with another canonical version. Search Console can show the Google-selected canonical. Fix conflicting redirects, internal links and canonicals rather than trying to force the duplicate into the index.
18. HTTP/HTTPS and www/non-www
Multiple host/protocol versions can create duplication if redirects and canonicals are inconsistent. Choose one canonical host and point all other variants to it permanently.
19. Trailing slash and technical duplicates
If both /service and /service/ return separate 200 pages with the same content, consolidate them. The same principle applies to case changes or duplicated path variants where the server allows them.
20. Parameters and filters create thousands of pages
Faceted navigation can generate enormous URL spaces. That can dilute crawl attention and fill the site with weak duplicates.
An audit should decide:
- which filters have real search demand
- which combinations deserve a stable landing page
- which parameter URLs should be crawlable but consolidated
- which should not be exposed through endless internal links
21. Unavailable products
Will the product return?
Keeping the URL and clearly showing temporary unavailability may be appropriate.
Is the product permanently removed with a close replacement?
A relevant redirect can make sense when the replacement genuinely fulfils the same need.
No replacement?
A 404 or 410 may be more honest than redirecting every removed product to the homepage.
22. Local pages are almost identical
Changing only the city name does not create a distinct local page. If several location pages contain the same offer, examples and FAQ, Google may treat them as duplicates or low-value doorway-like pages.
23. WordPress tag pages and archives
WordPress can create category, tag, author, date and pagination archives. Decide which have genuine navigational or search value. Do not index every archive automatically just because the CMS generates it.
24. Staging was indexed instead of production
A public staging site can compete with production, expose duplicate content and create confusing canonical signals.
Staging should be genuinely protected
Prefer authentication or network-level protection. A simple noindex is useful but should not be the only access-control mechanism for a private development environment.
25. Content was published without its own intent
Creating a URL for every keyword variation can produce pages that users do not need. If two pages answer the same decision, consider one stronger page rather than two weak ones.
26. Is thin content always excluded from the index?
No. A short page can be useful for a narrow intent. The issue is not word count by itself but whether the page has enough unique value for its purpose.
27. Does duplicate content cause a penalty?
Duplicate content is usually a selection and consolidation problem, not an automatic manual penalty. Google may choose one canonical version and ignore others, which can still be a major SEO problem when the wrong URL is selected.
28. Does a lack of backlinks block indexing?
No. Pages can be indexed without external links. Links can help discovery and authority, but missing indexation should first be diagnosed through crawling, indexability, canonical and content signals.
29. Does page speed affect indexation?
Extreme instability and slow responses can make crawling harder. Core Web Vitals are not an “indexing switch”, but technical performance is still part of a healthy, crawlable site.
30. How to diagnose one specific URL step by step
Step 1 — URL Inspection
Check the current indexing state in GSC.
Step 2 — Live Test
See whether Google can fetch the current version.
Step 3 — HTTP
Confirm the final URL returns the intended status.
Step 4 — Crawl allowed?
Review robots.txt.
Step 5 — Indexing allowed?
Review meta robots and X-Robots-Tag headers.
Step 6 — Canonical
Check the user-declared canonical.
Step 7 — Google-selected canonical
Check whether Google chose another URL.
Step 8 — Rendering
Verify that key content and links are visible when rendered.
Step 9 — Internal links
Make sure relevant indexed pages link to the URL.
Step 10 — Sitemap
Include the canonical URL if it belongs in Search.
Step 11 — Intent and uniqueness
Confirm the page has a distinct reason to exist.
Step 12 — Request Indexing
Submit it once after meaningful fixes if appropriate.
31. How to diagnose a site-wide problem
If many URLs show the same status, look for a system-level cause rather than editing pages one by one.
Look for systemic causes
- template-wide noindex or canonical errors
- robots rules
- a broken sitemap
- migration redirects
- faceted-navigation explosion
- server or firewall problems
- large groups of duplicate or near-empty pages
32. Is site: a good indexation test?
It is useful as a rough check, but not as a complete inventory. Search Console and direct URL Inspection are more reliable for diagnosis.
33. How long does Google take to index a page?
There is no guaranteed time. A page can be discovered quickly or take days or weeks depending on the site, links, crawl patterns and Google’s own processing.
If it is still not indexed after several weeks
Do not only wait. Recheck crawling, indexability, canonical selection, internal links, sitemap, server stability, uniqueness and whether the page has a distinct purpose.
34. Can you “speed up indexation”?
You can make discovery and processing easier by maintaining good internal links, clean sitemaps, stable servers and useful content. You cannot force Google to index a URL on demand.
35. What not to do
Do not submit the same URL 20 times
Repeated requests do not fix the cause.
Do not buy an “indexing service” blindly
Third-party promises cannot override Google’s selection systems.
Do not create thousands of empty pages
More URLs can make quality and crawl problems worse.
Do not redirect everything to the homepage
Redirect only when a meaningful replacement exists.
Do not remove robots/noindex controls without understanding the architecture
Some technical pages are intentionally kept out of Search.
Do not change the URL only because it is not indexed
A new slug will not solve a weak canonical, content or architecture problem.
From FreenetPro practice: identify the stage of the problem first
Technical problem
Google cannot crawl the URL or indexing is blocked.
Architecture problem
The page is difficult to discover, competes with another URL or receives inconsistent canonical signals.
Index-selection problem
Google can crawl and index the page but chooses not to keep it, often because the URL is redundant or low-value compared with alternatives.
Checklist: Google is not indexing the page
URL
- correct final URL
- 200 status
- no unnecessary redirect chain
Crawling
- robots.txt allows access
- server and firewall do not block Googlebot
- rendering works
Indexability
- no accidental noindex
- canonical points to the intended URL
- no conflicting HTTP headers
Discovery
- relevant internal links
- canonical URL in sitemap where appropriate
Content
- distinct intent
- useful, non-duplicated information
- not a thin city or parameter copy
GSC
- URL Inspection
- Live Test
- Page indexing report
- Google-selected canonical
FAQ
Why is Google not indexing my page?
Common reasons include noindex, robots.txt, a non-200 response, conflicting canonicals, weak discovery, duplicate content or Google deciding that another URL better represents the same information.
How do I check whether a page is indexed?
Use URL Inspection in Google Search Console for the exact URL. A site: search is only a supplementary clue.
What does “Crawled — currently not indexed” mean?
Google crawled the page but did not include it in the index at that time. Review uniqueness, intent, canonical signals, internal links and overall quality.
What does “Discovered — currently not indexed” mean?
Google knows the URL but has not crawled it yet or has deferred the crawl. Review discovery, server health and whether the site exposes too many low-value URLs.
Does Request Indexing guarantee indexation?
No. It requests recrawling; Google still decides whether the URL is indexed.
Does repeated Request Indexing speed Google up?
No. Fixing the reason for exclusion is more useful than repeated submissions.
Does a sitemap guarantee indexation?
No. A sitemap helps discovery and communicates canonical URLs, but it does not force inclusion in the index.
Does robots.txt block indexing?
It blocks crawling. A blocked URL can sometimes still appear based on other signals, and Google may not see a noindex directive if it cannot crawl the page.
Does canonical affect indexation?
Yes. A canonical pointing elsewhere tells Google another URL is preferred, and Google can also choose a different canonical when signals conflict.
Does missing indexation mean a Google penalty?
No. Most indexing exclusions are technical, architectural or selection decisions rather than manual penalties.
Does a small amount of text block indexation?
No. A short page can be valuable. The question is whether it uniquely and completely satisfies its purpose.
How long does a new page take to index?
There is no guaranteed time. It can range from hours to weeks depending on the site and Google’s processing.
Does Google index JavaScript?
Google can render JavaScript, but important content and links should not rely on fragile client-side behaviour when a more resilient implementation is possible.
Should every ecommerce product be indexed?
Not automatically. Products with genuine value and stable canonical URLs may belong in Search; duplicates, technical variants and empty pages may not.
The most important rule
Do not treat “not indexed” as one problem with one fix. First determine whether Google cannot discover the URL, cannot crawl it, is told not to index it, selects another canonical, or simply does not see enough distinct value to keep it. The correct fix follows from that diagnosis.
