About the fetcher

This service fetches a page only when somebody pastes its address into the form. It does not crawl, it does not follow links out of a page, and it keeps no list of sites it has seen.

What it sends

User-Agent: getdefend.org page checker (+https://getdefend.org/bot)

Blocking it

Disallow the user agent in your robots.txt and the request stops. If a page of yours was checked and you would rather the report did not exist, the address of the report is enough for us to delete it.

What it will not fetch

Anything that resolves to a private, local or reserved address, on the first request and on every redirect after it.

defend · about the fetcher