Free tool Noindex checker: can Google index this page?
Enter a URL and the checker fetches it the way Googlebot or Bingbot would ask for it, reads the site’s robots.txt, and looks at every signal that decides indexing: the status code, redirects, meta robots and googlebot tags, the X-Robots-Tag header and the canonical link. You get a one-line answer first, then the evidence.
- Fetches as a crawler
- Meta, header and robots.txt
- Via check.tapcub.com
Check whether a URL can be indexed
Enter a URL, pick the crawler and click Check. It takes two or three requests: the page, then robots.txt (one more if a redirect lands on another host).
check.tapcub.com, a TapCub service on Cloudflare Workers. It fetches the page from Cloudflare’s network (8-second timeout, up to 5 redirects, first 512 KB of the body), identifies itself with a From: tools@tapcub.com header, and returns the response to your browser, where all the analysis happens. After the page it also fetches /robots.txt on the same host, and on the final host when a redirect changes host. The request carries the crawler’s user agent string, but it comes from Cloudflare’s IP addresses, so a site that verifies crawlers by IP will treat it as an ordinary visitor. It keeps no copy of the page; its logs hold the domain, status code and timing, not the full URL. Limit: 10 fetches a minute and 200 a day per IP address.Full address or just the domain and path; https:// is added if you leave it out.
Sets the user agent of the request, the robots.txt group that applies and the meta name that counts (googlebot or bingbot).
Verdict
Yes. Nothing on this page stops Googlebot from indexing it. Whether it is indexed still depends on the search engine’s own quality and duplicate checks.
Based on what the server returned to this request. Indexing is never guaranteed even when nothing blocks it.
Checks
Problems first.
- OKrobots.txt allows Googlebot to crawl this URL.
- OKHTTP 200: the page loads.
- OKNo noindex for Googlebot in meta tags or the X-Robots-Tag header.
- OKThe canonical points to this URL.
Signals found
Each signal that can affect indexing, where it came from and what it does.
| Signal | Found | Effect |
|---|---|---|
| robots.txt | Allow: / | Allows indexing |
| Status code | 200 | Allows indexing |
| Meta robots | <meta name="robots" content="max-image-preview:large"> | Allows indexing |
| Canonical | https://tapcub.com/tools/utm | Allows indexing |
Redirects
Every hop the request followed.
# https://tapcub.com/robots.txt
Allow: / # line 2The longest matching Allow or Disallow line for this crawler (RFC 9309).
Share these inputs: the values go after the # in the link, so they never reach a server.
https://tapcub.com/tools/noindex-checker
Version v1.0Updated Update history
How the verdict is decided
The checker looks at signals in the order a search engine meets them, and the first one that blocks wins.
1. robots.txt
If crawling is disallowed, the crawler never downloads the page, so nothing on it counts, not even a noindex. The URL can still be listed without a description when other sites link to it.
2. Status code and redirects
Only a 200 response can be indexed. A redirect sends the crawler to another URL; that target is what gets indexed.
3. noindex
In a <meta name="robots"> or googlebot tag, or an X-Robots-Tag HTTP header. Any one of them is enough; the most restrictive rule wins.
4. Canonical
A canonical to another URL is a strong hint, not a command. The page is indexable, but Google usually shows the canonical address in results.
A green verdict means nothing blocks indexing. It does not mean the page is indexed: Google still decides based on quality, duplicates and crawl budget. Use the URL Inspection tool in Search Console for the actual index status.
Check a URL in three steps
Useful after a site migration, a CMS change or when a page has dropped out of search.
-
1
Enter the URL
Use the exact address you expect to rank, including the trailing slash or query string if it has one.
-
2
Pick the crawler
Googlebot smartphone is what Google uses for most sites. Pick Bingbot to check Bing; meta names and robots.txt groups differ per crawler.
-
3
Click Check
The page is fetched with that crawler’s user agent, then robots.txt. The verdict appears first, then each signal and the robots.txt line that decided.
-
4
Fix and check again
Remove the noindex, change the robots.txt rule or update the canonical, then run the check again. Ask Google to recrawl with URL Inspection in Search Console.
Where each indexing signal can live
Google reads indexing rules from three places, and robots.txt decides whether it can read the other two at all.
<meta name="robots" content="noindex">applies to all crawlers;name="googlebot"orname="bingbot"only to that crawler. Google also respects robots meta tags placed in the bodyX-Robots-Tag: noindexin the HTTP response; an optional prefix such asgooglebot: noindexlimits it to one crawler. Works for PDFs and images toononemeansnoindex, nofollow; anunavailable_afterdate in the past works like noindex- robots.txt is matched with the RFC 9309 rules: the most specific User-agent group, then the longest matching path, with Allow winning a tie
| What you set | What happens | Fix |
|---|---|---|
| noindex + Disallow in robots.txt | noindex is never read; the URL may stay listed | Allow crawling until the page drops out, then block if needed |
| noindex + canonical to another page | Mixed signals; Google advises against noindex for canonicalization | Use only the canonical |
| 200 + canonical to itself | Indexable | Nothing to do |
| 301 to a noindex page | Neither URL is indexed | Redirect to an indexable page |
| robots.txt returns 503 | Google pauses crawling of the whole site | Make robots.txt return 200 or 404 |
The sample: one of our own pages
The default result is https://tapcub.com/tools/utm, fetched as Googlebot smartphone on 2026-11-17, with tapcub.com/robots.txt.
| Signal | Found | Reading |
|---|---|---|
| robots.txt | User-agent: * / Allow: / | Crawling allowed |
| Status code | 200 | The page loads |
| Meta robots | max-image-preview:large | A display setting, not a block |
| X-Robots-Tag | None | — |
| Canonical | https://tapcub.com/tools/utm | Points to itself |
| Verdict | Yes | Nothing blocks indexing |
Try a URL you have deliberately excluded, such as a thank-you page, to see the noindex path.
How pages end up out of the index by accident
Most cases are a setting left over from development or a rule that was meant for something else.
Staging settings shipped to production
A “discourage search engines” switch, a global noindex header in the server config or a Disallow: / in robots.txt that went live with the site.
Blocking a page you want removed
Adding Disallow for a page that also has noindex hides the noindex. Google keeps the URL and shows it without a description.
Redirect to the wrong place
Old URLs redirect to a page that is noindex or 404, so neither address ends up indexed.
Canonical copied from a template
Every page declares the home page or the first page of a category as canonical, so Google folds them all into one.
See whether crawlers actually come
Indexable is the first step. TapCub shows whether search engine and AI crawlers fetch the page, and whether searches send people to it.
Crawler reports
Googlebot, Bingbot and AI crawlers counted separately from people, by page.
Learn moreSearch performance
Search Console queries, clicks and position for each page, next to your analytics.
Learn morePage reports
Visitors and entrances per page, so you notice when a page stops receiving search traffic.
Learn moreNoindex checker questions
Still have a question?
Chat with the team behind TapCub — we usually reply within a few hours on business days.
How do I check if a page is noindex?
Enter the URL above and click Check. The tool fetches the page as Googlebot, reads the meta robots and googlebot tags and the X-Robots-Tag header, and also checks robots.txt, redirects and the canonical. The first line tells you whether anything blocks indexing.
What is the difference between noindex and Disallow?
noindex (a meta tag or HTTP header) lets the crawler fetch the page but tells it not to show the page in results. Disallow in robots.txt stops the crawler from fetching the page at all, so it cannot see a noindex; the URL can still be listed if other pages link to it.
Why does my page show as indexable but is not in Google?
Nothing on the page blocks indexing, but Google may not have crawled it yet, may consider it a duplicate of another URL, or may judge it not useful enough. Check the URL Inspection report in Search Console for the actual reason.
Does the checker see noindex added by JavaScript?
No. It reads the HTML and headers the server returns and does not run scripts. Google’s JavaScript SEO guide says that when Google finds noindex before running JavaScript, it does not render or index the page, so a script that removes the tag later has no effect. Keep indexing rules in the server response.
Is a canonical to another URL the same as noindex?
No. A canonical is a strong hint that another URL is the preferred version; Google usually indexes that one and may still use this page’s signals. noindex is a rule that keeps this page out of results.
Will the site see that this was a TapCub check?
Yes. The request carries the crawler’s user agent string, plus a From: tools@tapcub.com header, and it comes from Cloudflare’s network rather than Google’s IP ranges. Sites that verify crawlers by reverse DNS will treat it as a normal visitor, which can change what they return.
How many URLs can I check?
Each check uses two or three fetches. The service allows 10 fetches a minute and 200 a day per IP address. For many URLs, use the sitemap or bulk status tools.
Update history
New features, fixes and data refreshes for this tool, newest first.
-
· v1.0
LaunchedFirst release.
Data this tool relies on
- Sample page fetched from tapcub.com — checked 2026-11-17, reviewed every 3 months (next review by 2027-02-17)
Missing something or found an error? Tell us — requests that come up often go into the next update. All tool updates
Check the rest of the page
Once the page can be indexed, make sure it is worth showing.