For Human Eyes Only

Useful resources on what should be in your robots.txt file.

Here are some useful resources on what should be in your robots.txt file – which is one of those things I can never seem to find the time for…