A single Disallow line can deindex a whole section. Test every important URL against your robots.txt before you ship it.
The example below is already loaded, so you can see exactly what you get. Replace it with your own list and the result updates as you type.
Got a bigger job? The full Notepad runs the same engine on lists of any size — chain this with dedupe, sort and filter, undo any step, and save the whole routine as a recipe for next time.
/blog/
/wp-admin/
/tag/shoes//blog/ → ✓ Allowed
/wp-admin/ → ⛔ Blocked
/tag/shoes/ → ⚠ Tag archive (noindex risk)Tests a list of URLs against a pasted robots.txt file and flags common noindex-risk URL patterns, without needing to crawl the live site.
Yes. Robots.txt Tester runs entirely in your browser below, with no sign-up, no limits, and nothing sent to a server.
No — you paste the robots.txt content directly, so it works even for a site you haven't published yet.
How many keywords, how many words, how many characters? Get every count for your list at a glance.
The words that repeat most in your keyword list are your real topics. See them ranked in one click.
Single-word counts say “shoes”. Phrase counts say “trail running shoes” and “for women” — the topics and modi…
Which sites link to you most? Which sections hold most of your pages? Count every URL by domain or folder in …
The Robots.txt Tester is one of the free tools inside Seowolf’s Notepad. Paste a list once, then dedupe, filter, sort, compare and format it in seconds — every step undoable, nothing uploaded, no account.
Open the Notepad — it’s free