Mar 14, 2016
What to Place in a WordPress Robots.txt File
What to Place in a WordPress Robots.txt File
I think, the previous two (1 and 2) article is sufficient for robots.txt file. Now we come with what to place in robots file? The great thing about the robots exclusion standard is that you can view the robots.txt file of any website on the internet (as long as they have uploaded one). All you have to do is visit http://www.websitename.com/robots.txt. If you check out the wordpress robots.txt…
View On WordPress