seo - Meta tag vs robots.txt -


  1. Use meta tags * or robots.txt file to inform spiders / crawlers Better

  2. Is there a problem using both Meta tags and robots.txt?

* Example: & lt; #META name = "robots" content = "index, follow" & gt;

robots.txt imho

meta tag option bots personalized Can not use to index files, while robotstext can be used to restrict access to entire directories.

Of course, if you have a meta tag, weird page in indexed folders that you want to skip but generally, I suggest more indexed content than one of your lists in one or more folders and I use robots.txt to leave a lot.

No, there is no problem using both of them - if there is a conflict, then in common terms, reject one allow overrul Will do


Comments

Popular posts from this blog

c# - sqlDecimal to decimal clr stored procedure Unable to cast object of type 'System.Data.SqlTypes.SqlDecimal' to type 'System.IConvertible' -

Calling GetGUIThreadInfo from Outlook VBA -

Obfuscating Python code? -