Tools for the next question.

Start with a website scan. Go deeper when you need to inspect a policy, a request or a saved report. Every tool is free.

Check a website

Website scannerCheck one page

Find access problems, content gaps and suggested fixes for a URL.

Site comparisonCompare your page

Keep your page first and compare it with up to two others.

Bulk scannerCheck several websites

Scan up to 25 URLs and download the results as a CSV.

Inspect crawler access

robots.txt testerReview a crawler policy

Test a draft before publishing. Everything stays in your browser.

Crawler log analyzerInspect recorded requests

Check crawler requests and responses in your own access logs.

Advanced utilities

Saved reports & HTMLWork with local files

Compare saved scan reports or inspect HTML without fetching a website.

API and CI checksAutomate a check

Use the JSON API and deployment checks in your own workflow.

Focused diagnostic checks

Inspect one part of the same scanner when you already know where to look.

AI robots.txt checker

Inspect the deployed AI crawler policy for one URL.

llms.txt validator

Check an optional llms.txt response and its Markdown structure.

AI WAF block tester

Compare browser and crawler-header responses for a public page.

Wikidata and entity checker

Review local identity signals and an unverified Wikidata candidate.