SiteAudit · our crawler

SiteAuditBot

If you found this page in your server logs, a visitor to SiteAudit asked us to audit your site. Someone typed your address into our free audit form. We did not pick your site.

What it does

It loads up to 40 public pages of one site and reads the title, headings, links, meta tags and visible text. It checks for duplicate pages, thin content, broken links and missing basics. It runs once per request, not on a schedule.

What it does not do

How it identifies itself

SiteAuditBot/0.1 (+https://prizmaudit.com/bot)

How to block it

SiteAuditBot reads your robots.txt before anything else and follows it. To keep it out entirely, add this:

User-agent: SiteAuditBot
Disallow: /

To keep it out of part of your site, disallow just that path. If your robots.txt returns a server error, we treat that as a no and crawl nothing.

Speed

A single audit makes at most 6 requests at a time and stops after 90 seconds. Each visitor gets 5 audits an hour.

Contact

Something wrong, or you want us to stop? Write to our contact address (added when the site goes live).