Skip to the content
CopytoneStart a 7-day trial

For website owners

CopytoneBot

CopytoneBot reads public web pages for Copytone. It reads a page when someone asks Copytone to check it, or when a company asks Copytone to check its own website.

What it does

  • It checks robots.txt, using a copy up to 24 hours old, before every page and every address a redirect points to. It obeys the rules for CopytoneBot, or for all robots when there are none for it.
  • If robots.txt answers with a server error or does not answer at all, it reads nothing. A site with no robots.txt is read.
  • When a site says there have been too many requests, it waits as long as the site asks, up to five seconds, and asks once more. If the site asks for a longer wait, or is still busy, it stops, and asks for robots.txt again no sooner than a minute later. A request that times out or breaks on the way is asked once more after a moment and a half, and no more.
  • It reads a site's sitemap to list its pages. For a free check it also reads up to 12 more pages of the same site, chosen from the checked page's links and the sitemap as the ones most likely to hold reviews or testimonials. It follows no other links, and never reads another site.
  • It reads one page at a time, with a pause between pages.
  • It reads a page's HTML first. When the checked page has no words in its HTML, or the site's pages hold too few reviews or testimonials, it opens the page, and up to three of the site's pages, in a browser, so their scripts run as they would for a visitor. There it names itself Mozilla/5.0 (compatible; CopytoneBot/1.0 (+https://copytone.co/bot)). It never signs in or fills in a form, keeps no cookies once the check ends, and never opens a review site such as Google or Trustpilot.
  • When a site answers with a login, a bot check or a block, it stops. It never tries another way in.
  • It follows Content Signals. If a site says ai-input=no, Copytone counts and checks its words and never sends them to an AI model.

How to stop it

Add these lines to your robots.txt:

User-agent: CopytoneBot
Disallow: /

Contact

Write to support@copytone.co.