TapCub is live — analytics, insights and live chat, free on one platform

Free tool Noindex checker: can Google index this page?

Enter a URL and the checker fetches it the way Googlebot or Bingbot would ask for it, reads the site’s robots.txt, and looks at every signal that decides indexing: the status code, redirects, meta robots and googlebot tags, the X-Robots-Tag header and the canonical link. You get a one-line answer first, then the evidence.

  • Fetches as a crawler
  • Meta, header and robots.txt
  • Via check.tapcub.com

Check whether a URL can be indexed

Enter a URL, pick the crawler and click Check. It takes two or three requests: the page, then robots.txt (one more if a redirect lands on another host).

Checker
What is sent, and to whom. Nothing is requested when this page opens: the result below is a dated sample. When you click Check, your browser sends the URL to check.tapcub.com, a TapCub service on Cloudflare Workers. It fetches the page from Cloudflare’s network (8-second timeout, up to 5 redirects, first 512 KB of the body), identifies itself with a From: tools@tapcub.com header, and returns the response to your browser, where all the analysis happens. After the page it also fetches /robots.txt on the same host, and on the final host when a redirect changes host. The request carries the crawler’s user agent string, but it comes from Cloudflare’s IP addresses, so a site that verifies crawlers by IP will treat it as an ordinary visitor. It keeps no copy of the page; its logs hold the domain, status code and timing, not the full URL. Limit: 10 fetches a minute and 200 a day per IP address.

Full address or just the domain and path; https:// is added if you leave it out.

Sets the user agent of the request, the robots.txt group that applies and the meta name that counts (googlebot or bingbot).

Sample result: https://tapcub.com/tools/utm, fetched on 2026-11-17 while this page was built. Click Check to fetch a live copy.

Verdict

Yes. Nothing on this page stops Googlebot from indexing it. Whether it is indexed still depends on the search engine’s own quality and duplicate checks.

Based on what the server returned to this request. Indexing is never guaranteed even when nothing blocks it.

Checks

Problems first.

  • OKrobots.txt allows Googlebot to crawl this URL.
  • OKHTTP 200: the page loads.
  • OKNo noindex for Googlebot in meta tags or the X-Robots-Tag header.
  • OKThe canonical points to this URL.

Signals found

Each signal that can affect indexing, where it came from and what it does.

SignalFoundEffect
robots.txtAllow: /Allows indexing
Status code200Allows indexing
Meta robots<meta name="robots" content="max-image-preview:large">Allows indexing
Canonicalhttps://tapcub.com/tools/utmAllows indexing
robots.txt rule that decided
# https://tapcub.com/robots.txt
Allow: /   # line 2

The longest matching Allow or Disallow line for this crawler (RFC 9309).

Parsing and every check run in your browser. The only server involved is check.tapcub.com, which fetches the address you enter when you click Check. Pasted HTML is never sent anywhere. The URL goes into the share link; the page content does not.

Share these inputs: the values go after the # in the link, so they never reach a server.

Version v1.0Updated Update history

Read the result

How the verdict is decided

The checker looks at signals in the order a search engine meets them, and the first one that blocks wins.

1. robots.txt

If crawling is disallowed, the crawler never downloads the page, so nothing on it counts, not even a noindex. The URL can still be listed without a description when other sites link to it.

2. Status code and redirects

Only a 200 response can be indexed. A redirect sends the crawler to another URL; that target is what gets indexed.

3. noindex

In a <meta name="robots"> or googlebot tag, or an X-Robots-Tag HTTP header. Any one of them is enough; the most restrictive rule wins.

4. Canonical

A canonical to another URL is a strong hint, not a command. The page is indexable, but Google usually shows the canonical address in results.

A green verdict means nothing blocks indexing. It does not mean the page is indexed: Google still decides based on quality, duplicates and crawl budget. Use the URL Inspection tool in Search Console for the actual index status.

How to use it

Check a URL in three steps

Useful after a site migration, a CMS change or when a page has dropped out of search.

  1. 1

    Enter the URL

    Use the exact address you expect to rank, including the trailing slash or query string if it has one.

  2. 2

    Pick the crawler

    Googlebot smartphone is what Google uses for most sites. Pick Bingbot to check Bing; meta names and robots.txt groups differ per crawler.

  3. 3

    Click Check

    The page is fetched with that crawler’s user agent, then robots.txt. The verdict appears first, then each signal and the robots.txt line that decided.

  4. 4

    Fix and check again

    Remove the noindex, change the robots.txt rule or update the canonical, then run the check again. Ask Google to recrawl with URL Inspection in Search Console.

Rules

Where each indexing signal can live

Google reads indexing rules from three places, and robots.txt decides whether it can read the other two at all.

  • <meta name="robots" content="noindex"> applies to all crawlers; name="googlebot" or name="bingbot" only to that crawler. Google also respects robots meta tags placed in the body
  • X-Robots-Tag: noindex in the HTTP response; an optional prefix such as googlebot: noindex limits it to one crawler. Works for PDFs and images too
  • none means noindex, nofollow; an unavailable_after date in the past works like noindex
  • robots.txt is matched with the RFC 9309 rules: the most specific User-agent group, then the longest matching path, with Allow winning a tie
Common combinations
What you setWhat happensFix
noindex + Disallow in robots.txtnoindex is never read; the URL may stay listedAllow crawling until the page drops out, then block if needed
noindex + canonical to another pageMixed signals; Google advises against noindex for canonicalizationUse only the canonical
200 + canonical to itselfIndexableNothing to do
301 to a noindex pageNeither URL is indexedRedirect to an indexable page
robots.txt returns 503Google pauses crawling of the whole siteMake robots.txt return 200 or 404
Worked example

The sample: one of our own pages

The default result is https://tapcub.com/tools/utm, fetched as Googlebot smartphone on 2026-11-17, with tapcub.com/robots.txt.

Signals and verdict
SignalFoundReading
robots.txtUser-agent: * / Allow: /Crawling allowed
Status code200The page loads
Meta robotsmax-image-preview:largeA display setting, not a block
X-Robots-TagNone—
Canonicalhttps://tapcub.com/tools/utmPoints to itself
VerdictYesNothing blocks indexing

Try a URL you have deliberately excluded, such as a thank-you page, to see the noindex path.

Common mistakes

How pages end up out of the index by accident

Most cases are a setting left over from development or a rule that was meant for something else.

Staging settings shipped to production

A “discourage search engines” switch, a global noindex header in the server config or a Disallow: / in robots.txt that went live with the site.

Blocking a page you want removed

Adding Disallow for a page that also has noindex hides the noindex. Google keeps the URL and shows it without a description.

Redirect to the wrong place

Old URLs redirect to a page that is noindex or 404, so neither address ends up indexed.

Canonical copied from a template

Every page declares the home page or the first page of a category as canonical, so Google folds them all into one.

FAQ

Noindex checker questions

Still have a question?

Chat with the team behind TapCub — we usually reply within a few hours on business days.

How do I check if a page is noindex?

Enter the URL above and click Check. The tool fetches the page as Googlebot, reads the meta robots and googlebot tags and the X-Robots-Tag header, and also checks robots.txt, redirects and the canonical. The first line tells you whether anything blocks indexing.

What is the difference between noindex and Disallow?

noindex (a meta tag or HTTP header) lets the crawler fetch the page but tells it not to show the page in results. Disallow in robots.txt stops the crawler from fetching the page at all, so it cannot see a noindex; the URL can still be listed if other pages link to it.

Why does my page show as indexable but is not in Google?

Nothing on the page blocks indexing, but Google may not have crawled it yet, may consider it a duplicate of another URL, or may judge it not useful enough. Check the URL Inspection report in Search Console for the actual reason.

Does the checker see noindex added by JavaScript?

No. It reads the HTML and headers the server returns and does not run scripts. Google’s JavaScript SEO guide says that when Google finds noindex before running JavaScript, it does not render or index the page, so a script that removes the tag later has no effect. Keep indexing rules in the server response.

Is a canonical to another URL the same as noindex?

No. A canonical is a strong hint that another URL is the preferred version; Google usually indexes that one and may still use this page’s signals. noindex is a rule that keeps this page out of results.

Will the site see that this was a TapCub check?

Yes. The request carries the crawler’s user agent string, plus a From: tools@tapcub.com header, and it comes from Cloudflare’s network rather than Google’s IP ranges. Sites that verify crawlers by reverse DNS will treat it as a normal visitor, which can change what they return.

How many URLs can I check?

Each check uses two or three fetches. The service allows 10 fetches a minute and 200 a day per IP address. For many URLs, use the sitemap or bulk status tools.

Changelog

Update history

New features, fixes and data refreshes for this tool, newest first.

  1. · v1.0

    LaunchedFirst release.

Data this tool relies on

  • Sample page fetched from tapcub.com — checked 2026-11-17, reviewed every 3 months (next review by 2027-02-17)

Missing something or found an error? Tell us — requests that come up often go into the next update. All tool updates

See your data clearly. Find your growth.

Every click, backed by data. Install one line of code and see your first numbers in a minute.

No credit card · Free plans for analytics and chat · Cookieless analytics