RankSurfBot
RankSurfBot fetches publicly reachable pages to check whether a change a customer made was actually delivered, and to measure how the page is represented in AI answers.
How to identify it
Every request RankSurfBot makes carries this exact user agent string:
RankSurfBot/1.0 (+https://ranksurf.com/bot)In robots.txt, RankSurfBot identifies itself with the product token RankSurfBot.
How it behaves
- robots.txtChecked before every single page fetch, not sampled — RankSurfBot identifies itself, so any non-compliance is directly attributable to us.
- ConcurrencyAt most 2 concurrent requests to your host at any time.
- RateAt least 500ms between sequential requests to your host.
How to block it
Add this to your robots.txt to disallow RankSurfBot entirely. We honor it.
User-agent: RankSurfBot
Disallow: /Contact
For questions about RankSurfBot’s behavior on your site, email hello@ranksurf.com.