Do you want to improve your robots.txt file? This is important for SEO but can be confusing for users. In…