Guides
The work that pays off with every agent, not just WebMCP
Practical checks for the pages and tools an agent can read, discover and use, including a grounded guide to Meta AI connector readiness.
GPTBot vs OAI-SearchBot vs ChatGPT-User: robots.txt rules
Choose crawler rules for training, ChatGPT search and user-requested visits separately. Inspect the public response and verify the edge configuration.
2 sources · reviewed 30 September 2026
Test a WebMCP tool in a browser: registration, call and result
Use a fictional read-only demo to separate registration, a manual tool call and an assistant's real task. Record browser versions and observed results.
2 sources · reviewed 30 September 2026
An agent readiness audit an agency can hand to a client
Choose one public customer task, check its exact page, hand over three evidenced findings, and test the task after each change.
3 sources · reviewed 30 September 2026
Meta AI Connectors: is your site ready for MCP and WebMCP?
A practical check for the two agent surfaces: a remote MCP connector Meta AI may call, and WebMCP tools a browser agent may use on your page. What our scan measures, and what still needs a live test.
4 sources · reviewed 25 September 2026
robots.txt for AI bots: crawler rules and access checks
Review GPTBot, OAI-SearchBot and PerplexityBot rules, distinguish user-requested visits, and check whether a public page is actually reachable.
6 sources · reviewed 30 September 2026
Content that survives without JavaScript
The most common and most expensive failure on the agentic web. Why an empty shell defeats the crawlers behind AI answers, how to tell whether you have one, and what to do when a rewrite is not on the table.
4 sources · reviewed 27 August 2026
Forms an agent can actually fill
The cheapest large improvement most sites can make. Labels, names, types and autocomplete tokens turn a guess into a certainty — and they are the same work the declarative WebMCP API will ask for.
4 sources · reviewed 27 August 2026
Structured data: the one place you state facts
Prose implies. JSON-LD asserts. Which types earn their keep for agent readiness, why validity matters more than volume, and the failure mode where markup and page disagree.
5 sources · reviewed 27 August 2026
llms.txt: what it is, and what it is not
A convention, not a standard, and ignored by Google Search. It is still worth publishing — because it is the one place you get to write the summary rather than hope one is inferred.
3 sources · reviewed 27 August 2026
Discovery documents, and the robots.txt trap
WebMCP tools only exist while a page is open. A discovery document is how an agent learns you exist before it arrives — and the most common failure is a site hiding its own manifest.
6 sources · reviewed 27 August 2026
Use the scanner from your agent
webmcp-tool.com is also an MCP server: five tools, no key, rate-limited. How to add it to Claude, Cursor, VS Code and ChatGPT, what it costs you, and what we record.
7 sources · reviewed 27 August 2026