seo - Meta tag vs robots.txt -
-
Use meta tags * or robots.txt file to inform spiders / crawlers Better
-
Is there a problem using both Meta tags and robots.txt?
* Example: & lt; #META name = "robots" content = "index, follow" & gt;
robots.txt imho
meta tag option bots personalized Can not use to index files, while robotstext can be used to restrict access to entire directories.
Of course, if you have a meta tag, weird page in indexed folders that you want to skip but generally, I suggest more indexed content than one of your lists in one or more folders and I use robots.txt to leave a lot.
No, there is no problem using both of them - if there is a conflict, then in common terms, reject one allow overrul Will do
Comments
Post a Comment