About our crawler

SubprocessorsBot/0.1 (vendor page monitor; +https://subprocessors.co/crawler)

Before September 3, 2026 the same crawler identified itself as AIVendorWatch/0.1. If you are reading older logs, that was us. Nothing else about how it behaves changed.

Every request we make carries that string, including requests made through a real browser engine.

We fetch public subprocessor, privacy, and security pages on a daily schedule, one page at a time, at a low rate. We store what we fetch so we can show our customers what a page said on a given date. Our customers are privacy and security professionals monitoring the vendors they rely on. Yours may be one of them.

• We do not access anything behind a login, a click-through agreement, or a gated trust portal.
• We honour robots.txt, and we check it at every step of a redirect chain, not only at the final destination.
• We do not reproduce, forge, or reverse-engineer signed URLs, tokens, or any other access control, even when the data behind it is already public.
• We do not disguise our crawler as a consumer browser. Where we render a page with a real browser engine, it is to run that page's own scripts, and it identifies itself with the string above.

Where a page cannot be read without doing one of those things, we record the vendor as not independently verifiable and tell our customers exactly that, rather than working around it.

Tell us and we will stop fetching your pages. No argument, no verification process, no form. Disallow us in robots.txt and we will stop on our own.

Email b@kindredeq.com.

We would rather you did not, and here is the honest reason: we monitor your public subprocessor page so your customers' privacy officers can see, in one place, that it has not quietly changed. That is a page you publish in order to be read.