Good for Bots is a free AI crawler checker and a directory of scanned websites. It helps website owners find out what a crawler can reach, what content it receives, and which problems make that content harder for language models and agents to read. Enter a domain to get a score out of 100, a public report, and a set of fixes.
A website can look finished in a browser while giving a crawler less to work with. Its text might depend on JavaScript, its firewall might challenge automated requests, or its robots.txt might block the crawlers its owner wants to allow. Good for Bots checks the responses its crawler receives and puts the findings beside the score, so owners have something to investigate.
The scan covers robots.txt, llms.txt, sitemaps, Markdown negotiation, structured data, and HTML structure. It examines navigation links, names for buttons and form fields, and other signals that help machines understand a page. The report distinguishes scored checks from optional agent capabilities. Publishing an API catalog or an agent card can be useful, but missing optional capabilities do not subtract points.
Reports include prompts for coding agents. Each prompt relates to a finding, giving developers a starting point for making the change in their own codebase. Free reports include prompts for the three highest priority fixes; Pro provides prompts for every fix. After changes are deployed, a new scan can show whether the relevant checks now pass. The prompts do not edit or publish the website themselves.
Every scored listing has a live badge that its owner can embed on a website. The badge links back to the report and reflects the latest published score, subject to caching. Visitors can open the report to see the checks behind the number. The directory groups listings by category and supports filters for detected platforms, standards, and agent capabilities, making it possible to explore examples beyond your own site.
Owners who want ongoing checks can claim their listing for free. Pro adds weekly automatic scans, email alerts for score drops or bot access changes, and a public score history chart. It also supplies draft llms.txt and robots.txt files based on scan evidence. Those drafts are for review before publication. Pro is purchased once for each individual listing, and its extra tools never change the scoring rules.
Good for Bots publishes its methodology and identifies its crawler as GoodForBotsBot. The crawler respects robots.txt, uses bounded requests, and reports an opted out state when the site's rules refuse access to its homepage. Listing removal is free. Free and paid listings receive the same score for the same findings.
For founders, developers, and technical SEO teams, the result is a way to check the machine readable side of a website and work through the problems found. The score describes technical readiness from the collected evidence. It does not establish that ChatGPT, Claude, or another assistant has visited the site, and it does not guarantee mentions, search rankings, traffic, or citations in generated answers.
