seo - Meta tag vs robots.txt -


  1. Use meta tags * or robots.txt file to inform spiders / crawlers Better

  2. Is there a problem using both Meta tags and robots.txt?

* Example: & lt; #META name = "robots" content = "index, follow" & gt;

robots.txt imho

meta tag option bots personalized Can not use to index files, while robotstext can be used to restrict access to entire directories.

Of course, if you have a meta tag, weird page in indexed folders that you want to skip but generally, I suggest more indexed content than one of your lists in one or more folders and I use robots.txt to leave a lot.

No, there is no problem using both of them - if there is a conflict, then in common terms, reject one allow overrul Will do


Comments

Popular posts from this blog

paypal - How to know the URL referrer in PHP? -

oauth - Facebook OAuth2 Logout does not remove fb_ cookie -

wpf - Line breaks and indenting for the XAML of a saved FlowDocument? -