Author
Xu An
Customer Experience Consultant
Author · 32 articles · 14 glossary terms
Writes about live chat, visitor conversations, and self-service, sharing practical ways to make customer communication clearer and more effective.
Articles by Xu An
32 articles
Live Chat · Nov 7, 2026 · 9 min read
Types of chatbots: rule-based, FAQ, AI and hybrid, compared
Chatbots differ most in how they produce an answer: fixed menus, keyword rules, stored FAQ matches, or generated text grounded in your documents. The main types compared, how retrieval-augmented AI works, and what a support bot actually resolves.
Read more
Live Chat · Nov 7, 2026 · 8 min read
Customer service training: what to cover, a 30-day plan and how to measure it
A practical customer service training programme: the skills to cover and how to practise each, a 30-day onboarding plan for chat agents, training methods compared, and how to prove the training worked with support metrics.
Read more
Analytics · Nov 6, 2026 · 8 min read
Website analysis: how to analyze a website in 7 steps
How to analyze a website across traffic, behavior, technical health and search, with a 28-day worked example, how to size up a competitor site, common mistakes and a FAQ.
Read more
AI Search · Nov 6, 2026 · 5 min read
Zero-click searches: what the data shows and how to adapt
About 60% of Google searches now end without a click. What zero-click searches are, which queries are most affected, a worked before/after where impressions rose 4% and clicks fell 20%, and seven ways to adapt.
Read more
AI Search · Nov 6, 2026 · 6 min read
Multilingual SEO: URL structure, hreflang and a worked audit
How to rank a website in several languages: choosing a URL structure, hreflang rules that cause most errors, localizing keywords, and a worked audit where fixing hreflang tripled German clicks and lifted Japanese clicks sixfold.
Read more
AI Search · Nov 6, 2026 · 6 min read
SEO for startups: a 12-month plan that turns searches into signups
When a startup should start SEO, which keywords a new domain can actually win, a 12-month plan, and a worked year where bottom-of-funnel pages brought 28% of organic traffic and 74% of signups.
Read more
AI Search · Nov 6, 2026 · 6 min read
Web crawler: how it works, types of crawlers and how to verify them
What a web crawler is, the six steps every crawler follows, search vs AI training vs AI search crawlers, a worked week of server logs with spoofed Googlebots, and how to verify and control crawlers.
Read more
AI Search · Nov 6, 2026 · 7 min read
AI visibility: how to measure and improve it in AI search
AI visibility is how often AI answers read, cite and send people to your site. Three layers to measure, four metrics, a worked month of AI traffic by operator, and seven ways to improve it.
Read more
AI Search · Nov 5, 2026 · 7 min read
Single-page application SEO: routing, status codes and analytics
Single-page apps need every client-side view to behave like a real page for crawlers and analytics. Seven requirements, history vs hash routing, soft 404 fixes, a migration that grew indexed pages from 15 to 271, and how to count SPA pageviews correctly.
Read more
AI Search · Nov 5, 2026 · 6 min read
JavaScript SEO: how Google and AI crawlers handle JS, and how to fix it
JavaScript SEO makes sure crawlers can see content that scripts produce. How Google crawls, renders and indexes JS, why most AI crawlers see an empty shell, rendering strategies, common problems and a catalog audit that went from 53% to 94% indexed.
Read more
AI Search · Nov 4, 2026 · 4 min read
Bytespider: What It Is and How to Control It
Bytespider is the web crawler operated by ByteDance, the company behind TikTok. Site owners often notice it because of its request volume. Its user agent, a worked week measuring its load and robots.txt compliance, and the options from robots.txt to a firewall block.
Read more
AI Search · Nov 4, 2026 · 4 min read
Google-Extended: What It Controls and How to Use It in robots.txt
Google-Extended is a robots.txt token, not a separate crawler. It lets you choose whether content Google crawls may be used for Gemini models and some other AI products, without affecting Google Search. What it controls, what it does not, and how to set it.
Read more
AI Search · Nov 4, 2026 · 4 min read
Meta-ExternalAgent: What Meta’s AI Crawler Does and How to Control It
Meta-ExternalAgent is the crawler Meta uses to collect web content for AI training and indexing. How it differs from Meta’s link preview crawler, how to verify it, a worked month comparing what it reads with the visitors Meta sends back, and robots.txt rules.
Read more
AI Search · Nov 4, 2026 · 4 min read
Content Pruning: When to Update, Merge or Remove Old Pages
Content pruning means reviewing old pages and improving, merging or removing the ones that no longer earn their place. Decision rules using traffic, links and conversions, a worked pruning of 600 posts, and how to remove pages without losing value.
Read more
AI Search · Nov 4, 2026 · 4 min read
Content Decay: How to Spot It, Diagnose It and Fix It
Content decay is the gradual loss of traffic on pages that used to perform. How to define it with numbers, rule out seasonality and site-wide drops, diagnose by impressions, position and CTR, and choose between refresh, merge and leave alone.
Read more
AI Search · Nov 4, 2026 · 4 min read
Bingbot: What It Is, How to Verify It and Control Its Crawling
Bingbot is Microsoft’s web crawler for Bing search. Its user agents, how to verify real Bingbot by reverse DNS, a worked week comparing it with Googlebot (with fake Bingbot traffic), how to control its crawl rate and how IndexNow speeds up discovery.
Read more
AI Search · Nov 4, 2026 · 4 min read
Orphan Pages: How to Find and Fix Them
Orphan pages exist on your site but no other page links to them, so visitors and search engines struggle to find them. How to find them by comparing URL lists, a worked example of 150 orphans, and when to link, redirect or remove.
Read more
AI Search · Nov 4, 2026 · 4 min read
How to Improve Organic Search: Start With What You Already Rank For
The fastest organic search gains usually come from pages that already rank: fix titles with low CTR, push pages from positions 8–20 into the top 5, refresh decaying content, and remove technical blockers. A worked example with click estimates.
Read more
AI Search · Nov 4, 2026 · 5 min read
Crawl Errors: Types, Causes and How to Fix Them
Crawl errors are failed requests from search engine bots: DNS and server errors, timeouts, 404s and redirect problems. The main types, what causes them, a worked week of Googlebot data, and the order to fix them in.
Read more
AI Search · Nov 4, 2026 · 4 min read
Branded vs Non-Branded Keywords: What to Track and Report
Branded keywords include your brand name; non-branded keywords describe the problem. They behave very differently in search. How to split them in your own data, a worked example, and which one shows real SEO growth.
Read more
AI Search · Nov 4, 2026 · 5 min read
Googlebot: What It Is, How It Crawls and How to Verify It
Googlebot is the crawler Google uses to fetch pages for Search. How it crawls and renders, the other Google crawlers you will see in logs, how to tell a real Googlebot from a fake one, and a sample month of log data.
Read more
AI Search · Nov 4, 2026 · 4 min read
Content Audit: How to Review Every Page and Decide What to Do
A content audit lists every page with its traffic, conversions, links and trend, then decides to keep, update, merge or remove it. The data to collect, decision rules, and a worked sample of 120 pages.
Read more
AI Search · Nov 4, 2026 · 4 min read
SEO KPIs: 10 Metrics That Show Whether SEO Is Working
Not every SEO metric is a KPI. Ten SEO KPIs in three tiers, business, visibility and technical health, with formulas, data sources, a sample quarterly scorecard and how to set targets.
Read more
AI Search · Nov 4, 2026 · 5 min read
SEO Dashboard: What to Include and How to Read It
An SEO dashboard should answer three questions: is organic search bringing business, are we more visible, and is anything broken. A four-row layout, a sample weekly dashboard with numbers, and what to leave out.
Read more
AI Search · Nov 4, 2026 · 5 min read
Keyword Cannibalization: How to Find It, Prove It and Fix It
Keyword cannibalization is when two of your pages compete for the same query and both rank worse than one would. How to tell real cannibalization from harmless overlap, a worked example with split clicks, and which fix to use.
Read more
AI Search · Nov 4, 2026 · 4 min read
Sudden Drop in Website Traffic? A 15-Minute Triage
When website traffic drops suddenly, first check whether the drop is real, then find which channel, pages and devices it sits in. A step-by-step triage, a table of causes with their evidence, and a worked example.
Read more
AI Search · Nov 4, 2026 · 5 min read
What Is Organic Traffic? How It Is Counted and How to Grow It
Organic traffic is visits from unpaid search results. How analytics decides a visit is organic, how it differs from paid and direct traffic, a sample breakdown, and a routine for growing it or explaining a drop.
Read more
AI Search · Nov 3, 2026 · 5 min read
How Often Does Google Crawl a Site? Measure Yours, Then Speed It Up
Google has no fixed crawl schedule: your home page may be fetched many times a day and a deep product page once a month. How to measure crawl frequency on your own site by page type, and what actually gets new pages crawled sooner.
Read more
AI Search · Nov 3, 2026 · 5 min read
Crawl Budget: Does It Matter for Your Site, and Where Is It Going?
Crawl budget is how much a search engine is willing and able to crawl on your site. When it matters, what wastes it, and how to read server logs to see where search and AI crawlers actually spend their requests.
Read more
Analytics · Nov 3, 2026 · 5 min read
Referral Spam: Three Kinds, How to Spot Each, and Where to Stop It
Referral spam comes in three kinds: ghost hits that never touch your site, crawler visits and scripted browser visits. The report signals for each and the fix that belongs at each layer, from collection allowlists to filters.
Read more
AI Search · Nov 3, 2026 · 6 min read
ClaudeBot: What It Crawls, How to Block It and How to Verify It
ClaudeBot is one of three Anthropic web agents. What each one does, what blocking it changes, robots.txt rules for common goals, how to verify requests against Anthropic's published IP list, and how to see ClaudeBot in your own data.
Read more
Live Chat · May 14, 2026 · 9 min read
Proactive chat best practices: triggers, copy and limits that don't annoy
Proactive chat works when it arrives at the moment of a real question. Triggers, invite copy, frequency limits, staffing and how to measure whether invites lift conversion.
Read more
Glossary terms by Xu An
14 glossary terms
Glossary
Bot / crawler
Automated traffic: search engine spiders, monitoring tools, scrapers, AI fetchers and abusive scripts.
Learn more
Glossary
Crawl depth: what it is and how to keep important pages shallow
Crawl depth (click depth) is the minimum number of internal links a crawler or user must follow from the homepage to reach a page.
Learn more
Glossary
Dwell time: what it is in SEO and how to measure proxies
Dwell time is the length of time a searcher spends on a page after clicking a search result and before returning to the search results.
Learn more
Glossary
Index bloat: what it is, how to detect it and how to fix it
Index bloat is a condition where a search engine has indexed many more of a site’s URLs than the site has valuable pages, typically from parameter variants, internal search, thin archives and duplicates, wasting crawl resources and diluting quality signals.
Learn more
Glossary
Indexability: what it is, what blocks it and how to audit it
Indexability is a page’s ability to be added to a search engine’s index after it is crawled.
Learn more
Glossary
Mobile first
Mobile first is an approach that designs and builds for small screens and constrained conditions first, then enhances for larger screens; in SEO, mobile-first indexing means Google uses the mobile version of a page for indexing and ranking.
Learn more
Glossary
Page experience: what Google measures and how to improve it
Page experience is Google’s term for aspects of a page that affect how users experience it beyond its content: Core Web Vitals, HTTPS, mobile usability, the absence of intrusive interstitials and an unobtrusive ad experience.
Learn more
Glossary
Painted door test
A painted door test (fake door test) is a demand test in which users see a realistic entry point, such as a button, menu item, pricing option or landing page, for a feature that has not been built, and the share who try to use it is measured before any build decision.
Learn more
Glossary
Redirect chain: what it is, why it hurts and how to fix it
A redirect chain is a sequence of two or more HTTP redirects between a requested URL and its final destination (A → B → C).
Learn more
Glossary
Soft 404: what it is, common causes and how to fix it
A soft 404 is a URL that returns HTTP 200 OK while showing a “not found” message or almost no content, so search engines cannot rely on the status code.
Learn more
Glossary
Two-way translation
The visitor writes in their language, the agent reads and replies in theirs.
Learn more
Glossary
URL parameters
URL parameters (query parameters) are key-value pairs added to the end of a URL after a question mark, separated by ampersands, such as ?color=red&utm_source=newsletter.
Learn more
Glossary
User agent
A user agent is the software, such as a browser, app or crawler, that makes a request on the web.
Learn more
Glossary
X-Robots-Tag
X-Robots-Tag is an HTTP response header that gives search engine crawlers indexing instructions, such as noindex or nofollow, for the URL being served; unlike the robots meta tag, it works for any file type, including PDFs and images.
Learn more