Test pasted crawler rules against URLs without fetching your website.
No matching tools.
Local rule simulation supports user-agent groups, Allow, Disallow, wildcard * and end marker $. The most specific matching agent group and longest path rule win; Allow wins ties. Crawl-delay and unsupported directives are reported as ignored. No fetching, HTTP status, cached policy, indexing or access control is tested. Use one website origin.
The sample blocks /admin/ but allows /admin/help. /products/shirt has no blocking rule.