Free tool Sitemap checker: are the URLs in your sitemap worth crawling?
A sitemap should list only pages you want in search: live, not redirected, indexable and canonical. Enter a domain and the checker finds the sitemap through robots.txt, reads up to three child sitemaps, then requests up to 100 of the listed URLs and tells you which ones break those rules.
- Finds the sitemap for you
- Status, noindex, canonical
- CSV export
Check the URLs in a sitemap
Enter a domain (example.com) to look up robots.txt first, or the full address of a sitemap or sitemap index. The result below is a dated sample until you click Check sitemap.
check.tapcub.com, which requests the pages from Cloudflare’s network with a From: tools@tapcub.com header and returns status codes and the parts of the page this tool needs. The service keeps only host names, status codes and timings for rate limiting, not paths, queries or page content, and stores no results. The sitemap search uses up to 6 single requests (limit: 10 a minute per IP address). Batch checks go out 8 addresses per request. The first one may ask for a quick human check (Cloudflare Turnstile); after that you have a 15-minute pass. Limits per IP address: 30 batch requests a minute and 150 a day.For example example.com, https://example.com/sitemap.xml or https://example.com/sitemap_index.xml.
Taken from the top of the sitemap, after removing duplicates.
Only changes the table; the CSV has every checked URL.
URLs in sitemap
388
Unique URLs in the files read.
Checked
100
Clean
98
200, indexable, canonical to itself.
Errors
2
Not 200, or noindex.
Warnings
0
Redirects, other canonical, other host.
Summary
- OKFound through robots.txt (1 Sitemap line(s)). Search engines can discover it the same way.
- NoteChecking the first 100 of 388 URLs.
- Error2 URL(s) carry noindex in meta robots. A sitemap should only list pages you want indexed.
How the sitemap was found
| Step | Address | Status | Result |
|---|---|---|---|
| robots.txt | https://basecamp.com/robots.txt | 200 | 1 Sitemap line(s) |
| Sitemap | https://basecamp.com/sitemap.xml | 200 | 388 URLs |
URLs
Hover a finding to see the full target URL.
| # | URL | Status | Findings |
|---|---|---|---|
| 2 | https://basecamp.com/2 | 200 | noindex (meta robots) |
| 3 | https://basecamp.com/2/integrations | 200 | noindex (meta robots) |
url,status,final_url,redirects,noindex,canonical,title,findings
https://basecamp.com/,200,https://basecamp.com/,0,,https://basecamp.com/,Basecamp,
https://basecamp.com/2,200,https://basecamp.com/2,0,yes,https://basecamp.com/2,"Basecamp — Project management software, online collaboration — Basecamp 2",noindex
https://basecamp.com/2/integrations,200,https://basecamp.com/2/integrations,0,yes,https://basecamp.com/2/integrations,"Basecamp — Basecamp 2 Integrations, Apps, and Add-ons",noindex
https://basecamp.com/about,200,https://basecamp.com/about,0,,https://basecamp.com/about,Basecamp — Where we came from,
https://basecamp.com/accessibility,200,https://basecamp.com/accessibility,0,,https://basecamp.com/accessibility,Basecamp — Basecamp and accessibility,
https://basecamp.com/ai,200,https://basecamp.com/ai,0,,https://basecamp.com/ai,"Basecamp — Use Basecamp with ChatGPT, Claude, and other AI assistants + agents",
https://basecamp.com/apps,200,https://basecamp.com/apps,0,,https://basecamp.com/apps,"Basecamp — Get Basecamp for iOS, Android, Mac, Windows, on the web, and on the command line",
https://basecamp.com/before-and-after,200,https://basecamp.com/before-and-after,0,,https://basecamp.com/before-and-after,Basecamp — Before & After,
https://basecamp.com/books,200,https://basecamp.com/books,0,,https://basecamp.com/books,Basecamp — Books we’ve written,
https://basecamp.com/bootstrapped,200,https://basecamp.com/bootstrapped,0,,https://basecamp.com/bootstrapped,"Basecamp — Bootstrapped, profitable, & proud",
https://basecamp.com/breakfast,200,https://basecamp.com/breakfast,0,,https://basecamp.com/breakfast,Basecamp — Breakfast with Basecamp,
https://basecamp.com/classes,200,https://basecamp.com/classes,0,,https://basecamp.com/classes,Basecamp — Join us for a free live class,
https://basecamp.com/cloud-exit,200,https://basecamp.com/cloud-exit,0,,https://basecamp.com/cloud-exit,Basecamp — Leaving the Cloud — Cloud Computing Isn’t For Everyone,
https://basecamp.com/community,200,https://basecamp.com/community,0,,https://basecamp.com/community,Basecamp — Get more out of your Basecamp experience,
https://basecamp.com/customers,200,https://basecamp.com/customers,0,,https://basecamp.com/customers,Basecamp — Customer testimonials,
https://basecamp.com/customers/support,200,https://basecamp.com/customers/support,0,,https://basecamp.com/customers/support,Basecamp — Support Testimonials,
https://basecamp.com/discounts,200,https://basecamp.com/discounts,0,,https://basecamp.com/discounts,"Basecamp — Basecamp discounts for teachers, students, and non-profits",
https://basecamp.com/features,200,https://basecamp.com/features,0,,https://basecamp.com/features,"Basecamp — Features, benefits, benefits, and benefits",
https://basecamp.com/gettingreal,200,https://basecamp.com/gettingreal,0,,,Getting Real,
https://basecamp.com/guides/group-chat-problems,200,https://basecamp.com/guides/group-chat-problems,0,,https://basecamp.com/guides/group-chat-problems,Basecamp — Group Chat: The Best Way to Totally Stress Out Your Team,
https://basecamp.com/guides/how-we-communicate,200,https://basecamp.com/guides/how-we-communicate,0,,https://basecamp.com/guides/how-we-communicate,Basecamp — The 37signals Guide to Internal Communication,
https://basecamp.com/guides/how-we-make-decisions,200,https://basecamp.com/guides/how-we-make-decisions,0,,https://basecamp.com/guides/how-we-make-decisions,Basecamp — The 37signals Guide to Making Decisions,
https://basecamp.com/guides/seven-shipping-principles,200,https://basecamp.com/guides/seven-shipping-principles,0,,https://basecamp.com/guides/seven-shipping-principles,Basecamp — Seven Shipping Principles,
https://basecamp.com/guides/why-we-choose-profit,200,https://basecamp.com/guides/why-we-choose-profit,0,,https://basecamp.com/guides/why-we-choose-profit,Basecamp — Why We Choose Profit at 37signals,
https://basecamp.com/handbook,200,https://basecamp.com/handbook,0,,,The 37signals Employee Handbook,
https://basecamp.com/help,200,https://basecamp.com/help,0,,https://basecamp.com/help,Basecamp — Basecamp Help,
https://basecamp.com/hill-charts,200,https://basecamp.com/hill-charts,0,,https://basecamp.com/hill-charts,Basecamp — See where projects really stand with Hill Charts,
https://basecamp.com/integrations,200,https://basecamp.com/integrations,0,,https://basecamp.com/integrations,Basecamp — Basecamp Integrations,
https://basecamp.com/keyboard,200,https://basecamp.com/keyboard,0,,https://basecamp.com/keyboard,Basecamp — Keyboard cheat sheet,
https://basecamp.com/learn,200,https://basecamp.com/learn,0,,https://basecamp.com/learn,Basecamp — Mastering Basecamp,
https://basecamp.com/live,200,https://basecamp.com/live,0,,https://basecamp.com/live,Basecamp — Live around the world,
https://basecamp.com/managers,200,https://basecamp.com/managers,0,,,The 37signals Manager Playbook,
https://basecamp.com/newsletter,200,https://basecamp.com/newsletter,0,,https://basecamp.com/newsletter,Basecamp — Sign up for the Basecamp newsletter,
https://basecamp.com/overkill,200,https://basecamp.com/overkill,0,,https://basecamp.com/overkill,Basecamp — Kill overkill,
https://basecamp.com/paths,200,https://basecamp.com/paths,0,,https://basecamp.com/paths,Basecamp — The people’s path to Basecamp,
https://basecamp.com/pricing,200,https://basecamp.com/pricing,0,,https://basecamp.com/pricing,Basecamp — Pricing,
https://basecamp.com/projects,200,https://basecamp.com/projects,0,,https://basecamp.com/projects,Basecamp — Project management examples for every kind of team,
https://basecamp.com/projects/album-reissue,200,https://basecamp.com/projects/album-reissue,0,,https://basecamp.com/projects/album-reissue,Basecamp — Album Reissue project management example,
https://basecamp.com/projects/annual-fundraiser,200,https://basecamp.com/projects/annual-fundraiser,0,,https://basecamp.com/projects/annual-fundraiser,Basecamp — Annual Fundraiser project management example,
https://basecamp.com/projects/annual-report,200,https://basecamp.com/projects/annual-report,0,,https://basecamp.com/projects/annual-report,Basecamp — Annual Report project management example,
https://basecamp.com/projects/annual-sales-meeting,200,https://basecamp.com/projects/annual-sales-meeting,0,,https://basecamp.com/projects/annual-sales-meeting,Basecamp — Annual Sales Meeting project management example,
https://basecamp.com/projects/architecture-competition,200,https://basecamp.com/projects/architecture-competition,0,,https://basecamp.com/projects/architecture-competition,Basecamp — Architecture Competition project management example,
https://basecamp.com/projects/avalanche-safety-courses,200,https://basecamp.com/projects/avalanche-safety-courses,0,,https://basecamp.com/projects/avalanche-safety-courses,Basecamp — Avalanche Safety Courses project management example,
https://basecamp.com/projects/band-tour,200,https://basecamp.com/projects/band-tour,0,,https://basecamp.com/projects/band-tour,Basecamp — Band Tour Planning project management example,
https://basecamp.com/projects/bike-share-expansion,200,https://basecamp.com/projects/bike-share-expansion,0,,https://basecamp.com/projects/bike-share-expansion,Basecamp — Bike Share Expansion project management example,
https://basecamp.com/projects/board-of-directors,200,https://basecamp.com/projects/board-of-directors,0,,https://basecamp.com/projects/board-of-directors,Basecamp — Board of Directors project management example,
https://basecamp.com/projects/boat-restoration,200,https://basecamp.com/projects/boat-restoration,0,,https://basecamp.com/projects/boat-restoration,Basecamp — Boat Restoration project management example,
https://basecamp.com/projects/bookstore-author-events,200,https://basecamp.com/projects/bookstore-author-events,0,,https://basecamp.com/projects/bookstore-author-events,Basecamp — Bookstore Author Events project management example,
https://basecamp.com/projects/brand-identity-refresh,200,https://basecamp.com/projects/brand-identity-refresh,0,,https://basecamp.com/projects/brand-identity-refresh,Basecamp — Brand Identity Refresh project management example,
https://basecamp.com/projects/brand-refresh,200,https://basecamp.com/projects/brand-refresh,0,,https://basecamp.com/projects/brand-refresh,Basecamp — Brand Refresh project management example,
https://basecamp.com/projects/business-expansion,200,https://basecamp.com/projects/business-expansion,0,,https://basecamp.com/projects/business-expansion,Basecamp — Business Expansion project management example,
https://basecamp.com/projects/cafe-menu-launch,200,https://basecamp.com/projects/cafe-menu-launch,0,,https://basecamp.com/projects/cafe-menu-launch,Basecamp — Café Menu Launch project management example,
https://basecamp.com/projects/car-showroom-remodel,200,https://basecamp.com/projects/car-showroom-remodel,0,,https://basecamp.com/projects/car-showroom-remodel,Basecamp — Car Showroom Remodel project management example,
https://basecamp.com/projects/charity-gala-planning,200,https://basecamp.com/projects/charity-gala-planning,0,,https://basecamp.com/projects/charity-gala-planning,Basecamp — Charity Gala Planning project management example,
https://basecamp.com/projects/cider-harvest,200,https://basecamp.com/projects/cider-harvest,0,,https://basecamp.com/projects/cider-harvest,Basecamp — Cider Harvest project management example,
https://basecamp.com/projects/classroom-expansion,200,https://basecamp.com/projects/classroom-expansion,0,,https://basecamp.com/projects/classroom-expansion,Basecamp — Classroom Expansion project management example,
https://basecamp.com/projects/client-onboarding,200,https://basecamp.com/projects/client-onboarding,0,,https://basecamp.com/projects/client-onboarding,Basecamp — Client Onboarding project management example,
https://basecamp.com/projects/client-website-redesign,200,https://basecamp.com/projects/client-website-redesign,0,,https://basecamp.com/projects/client-website-redesign,Basecamp — Client Website Redesign project management example,
https://basecamp.com/projects/climbing-gym-expansion,200,https://basecamp.com/projects/climbing-gym-expansion,0,,https://basecamp.com/projects/climbing-gym-expansion,Basecamp — Climbing Gym Expansion project management example,
https://basecamp.com/projects/company-offsite,200,https://basecamp.com/projects/company-offsite,0,,https://basecamp.com/projects/company-offsite,Basecamp — Company Offsite project management example,
https://basecamp.com/projects/company-retreat,200,https://basecamp.com/projects/company-retreat,0,,https://basecamp.com/projects/company-retreat,Basecamp — Company Retreat project management example,
https://basecamp.com/projects/condo-sales-launch,200,https://basecamp.com/projects/condo-sales-launch,0,,https://basecamp.com/projects/condo-sales-launch,Basecamp — Condo Sales Launch project management example,
https://basecamp.com/projects/content-calendar,200,https://basecamp.com/projects/content-calendar,0,,https://basecamp.com/projects/content-calendar,Basecamp — Content Calendar project management example,
https://basecamp.com/projects/custom-home-design,200,https://basecamp.com/projects/custom-home-design,0,,https://basecamp.com/projects/custom-home-design,Basecamp — Custom Home Design project management example,
https://basecamp.com/projects/customer-interviews,200,https://basecamp.com/projects/customer-interviews,0,,https://basecamp.com/projects/customer-interviews,Basecamp — Customer Interviews project management example,
https://basecamp.com/projects/customer-support,200,https://basecamp.com/projects/customer-support,0,,https://basecamp.com/projects/customer-support,Basecamp — Customer Support project management example,
https://basecamp.com/projects/design-agency-client-work,200,https://basecamp.com/projects/design-agency-client-work,0,,https://basecamp.com/projects/design-agency-client-work,Basecamp — Design Agency Client Work project management example,
https://basecamp.com/projects/documentary-production,200,https://basecamp.com/projects/documentary-production,0,,https://basecamp.com/projects/documentary-production,Basecamp — Documentary Production project management example,
https://basecamp.com/projects/fall-marketing-campaign,200,https://basecamp.com/projects/fall-marketing-campaign,0,,https://basecamp.com/projects/fall-marketing-campaign,Basecamp — Fall Marketing Campaign project management example,
https://basecamp.com/projects/florist-wedding-bookings,200,https://basecamp.com/projects/florist-wedding-bookings,0,,https://basecamp.com/projects/florist-wedding-bookings,Basecamp — Florist Wedding Bookings project management example,
https://basecamp.com/projects/food-festival-management,200,https://basecamp.com/projects/food-festival-management,0,,https://basecamp.com/projects/food-festival-management,Basecamp — Food Festival Management project management example,
https://basecamp.com/projects/furniture-collection,200,https://basecamp.com/projects/furniture-collection,0,,https://basecamp.com/projects/furniture-collection,Basecamp — Furniture Collection project management example,
https://basecamp.com/projects/game-development,200,https://basecamp.com/projects/game-development,0,,https://basecamp.com/projects/game-development,Basecamp — Game Development project management example,
https://basecamp.com/projects/glassware-collection,200,https://basecamp.com/projects/glassware-collection,0,,https://basecamp.com/projects/glassware-collection,Basecamp — Glassware Collection project management example,
https://basecamp.com/projects/grant-application,200,https://basecamp.com/projects/grant-application,0,,https://basecamp.com/projects/grant-application,Basecamp — Grant Application project management example,
https://basecamp.com/projects/gravel-bike-launch,200,https://basecamp.com/projects/gravel-bike-launch,0,,https://basecamp.com/projects/gravel-bike-launch,Basecamp — Gravel Bike Launch project management example,
https://basecamp.com/projects/group-camping-trip,200,https://basecamp.com/projects/group-camping-trip,0,,https://basecamp.com/projects/group-camping-trip,Basecamp — Group Camping Trip project management example,
https://basecamp.com/projects/holiday-catering-season,200,https://basecamp.com/projects/holiday-catering-season,0,,https://basecamp.com/projects/holiday-catering-season,Basecamp — Holiday Catering Season project management example,
https://basecamp.com/projects/holiday-food-drive,200,https://basecamp.com/projects/holiday-food-drive,0,,https://basecamp.com/projects/holiday-food-drive,Basecamp — Holiday Food Drive project management example,
https://basecamp.com/projects/holiday-party,200,https://basecamp.com/projects/holiday-party,0,,https://basecamp.com/projects/holiday-party,Basecamp — Holiday Party project management example,
https://basecamp.com/projects/hospital-wing-construction,200,https://basecamp.com/projects/hospital-wing-construction,0,,https://basecamp.com/projects/hospital-wing-construction,Basecamp — Hospital Wing Construction project management example,
https://basecamp.com/projects/hotel-renovation,200,https://basecamp.com/projects/hotel-renovation,0,,https://basecamp.com/projects/hotel-renovation,Basecamp — Hotel Renovation project management example,
https://basecamp.com/projects/knitwear-collection,200,https://basecamp.com/projects/knitwear-collection,0,,https://basecamp.com/projects/knitwear-collection,Basecamp — Knitwear Collection project management example,
https://basecamp.com/projects/laptop-upgrades,200,https://basecamp.com/projects/laptop-upgrades,0,,https://basecamp.com/projects/laptop-upgrades,Basecamp — Laptop Upgrades project management example,
https://basecamp.com/projects/magazine-production,200,https://basecamp.com/projects/magazine-production,0,,https://basecamp.com/projects/magazine-production,Basecamp — Magazine Production project management example,
https://basecamp.com/projects/manager-training-program,200,https://basecamp.com/projects/manager-training-program,0,,https://basecamp.com/projects/manager-training-program,Basecamp — Manager Training Program project management example,
https://basecamp.com/projects/marathon-planning,200,https://basecamp.com/projects/marathon-planning,0,,https://basecamp.com/projects/marathon-planning,Basecamp — Marathon Planning project management example,
https://basecamp.com/projects/marine-research-survey,200,https://basecamp.com/projects/marine-research-survey,0,,https://basecamp.com/projects/marine-research-survey,Basecamp — Marine Research Survey project management example,
https://basecamp.com/projects/marketing-campaign,200,https://basecamp.com/projects/marketing-campaign,0,,https://basecamp.com/projects/marketing-campaign,Basecamp — Marketing Campaign project management example,
https://basecamp.com/projects/mobile-app,200,https://basecamp.com/projects/mobile-app,0,,https://basecamp.com/projects/mobile-app,Basecamp — Mobile App project management example,
https://basecamp.com/projects/museum-exhibit,200,https://basecamp.com/projects/museum-exhibit,0,,https://basecamp.com/projects/museum-exhibit,Basecamp — Museum Exhibit project management example,
https://basecamp.com/projects/new-airline-route,200,https://basecamp.com/projects/new-airline-route,0,,https://basecamp.com/projects/new-airline-route,Basecamp — New Airline Route project management example,
https://basecamp.com/projects/new-hire-onboarding,200,https://basecamp.com/projects/new-hire-onboarding,0,,https://basecamp.com/projects/new-hire-onboarding,Basecamp — New Hire Onboarding project management example,
https://basecamp.com/projects/new-office-build-out,200,https://basecamp.com/projects/new-office-build-out,0,,https://basecamp.com/projects/new-office-build-out,Basecamp — New Office Build-Out project management example,
https://basecamp.com/projects/new-product-line,200,https://basecamp.com/projects/new-product-line,0,,https://basecamp.com/projects/new-product-line,Basecamp — New Product Line project management example,
https://basecamp.com/projects/office-manager-search,200,https://basecamp.com/projects/office-manager-search,0,,https://basecamp.com/projects/office-manager-search,Basecamp — Office Manager Search project management example,
https://basecamp.com/projects/office-move,200,https://basecamp.com/projects/office-move,0,,https://basecamp.com/projects/office-move,Basecamp — Office Move project management example,
https://basecamp.com/projects/office-renovation,200,https://basecamp.com/projects/office-renovation,0,,https://basecamp.com/projects/office-renovation,Basecamp — Office Renovation project management example,
https://basecamp.com/projects/opening-a-second-location,200,https://basecamp.com/projects/opening-a-second-location,0,,https://basecamp.com/projects/opening-a-second-location,Basecamp — Opening a Second Location project management example,
https://basecamp.com/projects/outdoor-theater-production,200,https://basecamp.com/projects/outdoor-theater-production,0,,https://basecamp.com/projects/outdoor-theater-production,Basecamp — Outdoor Theater Production project management example,One row per checked URL: status, final URL, noindex, canonical, title and findings.
Share these inputs: the values go after the # in the link, so they never reach a server.
https://tapcub.com/tools/sitemap-url-checker
Version v1.0Updated Update history
What each finding means
Every URL in a sitemap is a request to crawl and index it. A finding means the sitemap and the page disagree.
Error status or no response
404, 410, 5xx or no answer. Search Console’s page indexing report flags submitted URLs like these. Remove the URL or bring the page back.
Redirects
The listed URL sends visitors elsewhere. The page works, but the sitemap points at an address that is not the one you want indexed. List the final URL.
noindex
The page asks not to be indexed while the sitemap asks for it to be crawled; Search Console reports it as “Submitted URL marked ‘noindex’”. Decide which you mean.
Canonical elsewhere
The page names another URL as the main version. Google treats the canonical tag as a hint, and a sitemap listing the other URL weakens it. “Variant” means only http/https, www or a trailing slash differ.
A clean result covers the URLs checked, not the whole site. Lastmod dates, hreflang and image entries are not checked here; the sitemap generator’s validation mode checks the XML itself.
Three steps
No sign-up. One run reads the sitemap and checks up to 100 URLs.
-
1
Enter a domain or sitemap
A domain makes the checker read robots.txt first, as crawlers do. For a large site, enter a single child sitemap to check that section.
-
2
Check
The steps table shows each file read and what it contained. The URL table fills in as the batches return.
-
3
Fix and export
Work through errors first, then redirects and canonicals. Download the CSV to hand the list to whoever generates the sitemap.
From robots.txt to each URL’s head
The checker follows the same path a search engine does, then reads the start of every listed page.
- Domain entered: read
/robots.txtand take itsSitemap:lines (first two tried); without one, try/sitemap.xmland/sitemap_index.xml - Sitemap index: read up to 3 child sitemaps, in order, until enough URLs are collected. Compressed
.xml.gzfiles are not read - URLs are de-duplicated and the first 100 (or 50 / 20) are requested with GET in groups of 8, following up to 3 redirects
- From each page’s first 64 KB: status, final URL,
<title>, meta robots (robots, googlebot, bingbot), the X-Robots-Tag header and<link rel="canonical"> - A canonical is resolved against the final URL and compared with the listed URL, ignoring #fragments
| Finding | Level | Typical fix |
|---|---|---|
| Returns 404 / 410 / 5xx | Error | Remove from sitemap or restore page |
| noindex | Error | Remove from sitemap, or drop noindex |
| Redirects to another URL | Warning | List the final URL |
| Canonical points elsewhere | Warning | List the canonical URL |
| Different host | Warning | Move to that host’s sitemap |
| Duplicate entry | Warning | List each URL once |
basecamp.com’s sitemap on 2026-11-17
The default result above: found through robots.txt, a single urlset file.
| Step | What happened |
|---|---|
| robots.txt | One Sitemap: line pointing to https://basecamp.com/sitemap.xml |
| sitemap.xml | A <urlset> with 388 URLs; the first 100 were checked in 13 batches |
| Results | 98 are clean. Two — /2 and /2/integrations — answer 200 but carry noindex, so the sitemap asks search engines to crawl pages that ask not to be indexed |
Sitemaps change daily. Click Check sitemap for the current state; the sample keeps its date.
Why sitemaps fill up with bad URLs
Most sitemaps are generated by a CMS or plugin, so problems come from settings, not typos.
Listing noindex pages
Tag pages, search results and thank-you pages get noindex but stay in the plugin’s sitemap. Exclude them in the plugin settings.
Old URLs after a migration
The sitemap still lists the pre-migration addresses, which now redirect. Regenerate it from the new site, not from the old export.
http or www mismatch
The sitemap says http://example.com while the site lives at https://www.example.com. Every entry becomes a redirect and a canonical mismatch.
An HTML page at /sitemap.xml
Single-page apps often answer every path with the home page. A crawler gets HTML instead of XML and reads nothing.
See what crawlers do with your sitemap
A clean sitemap is an invitation. TapCub shows which crawlers accept it and what they fetch.
Bots and AI crawlers
Search engines, AI crawlers and scrapers are identified and kept out of your human numbers.
Learn moreCrawl compliance
A daily fetch of your robots.txt and llms.txt is compared with what actually crawled you.
Learn moreSearch performance
Google Search Console and Bing Webmaster data next to your pages, to see whether fixed URLs start getting clicks.
Learn moreSitemap checker questions
Still have a question?
Chat with the team behind TapCub — we usually reply within a few hours on business days.
How do I check my sitemap for errors?
Enter your domain above and click Check sitemap. The checker finds the sitemap through robots.txt, reads it and requests up to 100 listed URLs, then lists every URL that does not return 200, redirects, carries noindex or names a different canonical.
How do I find a website’s sitemap?
Look for a Sitemap: line in /robots.txt; that is where crawlers look. Common default locations are /sitemap.xml and /sitemap_index.xml. This checker tries all three in that order.
Should redirected URLs be in a sitemap?
No. Google’s guidance is to list the canonical URLs you want in search. A redirecting entry still gets crawled, but it points search engines at an address you do not want indexed.
Is it bad to have noindex pages in a sitemap?
It sends opposite signals: the sitemap asks for the page to be crawled, the page asks not to be indexed. Remove them from the sitemap unless you are temporarily listing them so search engines see the noindex sooner.
Can it check a whole sitemap with thousands of URLs?
One run checks up to 100 URLs from the top. For a big site, enter each child sitemap separately, or paste specific URLs into the bulk status checker.
Does it validate the XML itself?
It reads the XML leniently to get the URLs. To check the file’s syntax, lastmod dates and hreflang, paste it into the sitemap generator’s validation mode.
Why does a URL show 403 here but work in a browser?
The site blocks automated requests or cloud networks. Search engine crawlers may be allowed through by IP address, so a 403 here is a hint to check, not proof of a problem.
Update history
New features, fixes and data refreshes for this tool, newest first.
-
· v1.0
LaunchedFirst release.
Data this tool relies on
- Sample batch, sitemap, link and tracking checks — checked 2026-11-17, reviewed every 6 months (next review by 2027-05-17)
Missing something or found an error? Tell us — requests that come up often go into the next update. All tool updates
Watch crawlers use your sitemap
TapCub separates crawler visits from people and checks your robots.txt every day.