Do you want to improve your robots.txt file? This is important for SEO but can be confusing for users. In this video, we will show you how to optimize your WordPress robots.txt for seo.
If you liked this video, then please Like and consider subscribing to our channel for more WordPress videos.
Text version of this tutorial:
http://www.wpbeginner.com/wp-tutorials/how-to-optimize-your-wordpress-robots-txt-for-seo/
Check us out on Facebook:
https://www.facebook.com/wpbeginner
Follow us on Twitter:
Tweets by wpbeginner
Join our circle on Google+:
https://plus.google.com/+wpbeginner/
Checkout our website for more WordPress Tutorials
http://www.wpbeginner.com/
Summary of this Tutorial:
The robots.txt file is normally located in the root folder for your site and you can get to it either by using a FTP client or through your cpanel’s file manger.
You can decide which locations can be indexed from bots using this file.
As well as what to index to help with SEO.
source