Add new comment

Thank you Robert. My reading seems to indicate that it is not a good thing to do that in robots.txt. However, since my site is a blog, that does give me an avenue of investigation that I had not considered.

The content of this field is kept private and will not be shown publicly.

Beperkte HTML

  • Allowed HTML tags: <a href hreflang> <em> <strong> <cite> <blockquote cite> <code> <ul type> <ol start type> <li> <dl> <dt> <dd> <h2 id> <h3 id> <h4 id> <h5 id> <h6 id>
  • Lines and paragraphs break automatically.