robots.txt example

Your robots.txt file is a powerful tool when you’re working on a website’s SEO – but it should be handled