Robots.txt

Robots.txt – A file used within the root directory of a website that restricts the indexing of selected web pages or directories.

Leave a Reply

You can use these XHTML tags: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>