This Message Forum is no longer in use

Please use the new Bravenet Help Forums FOUND HERE

General Forum
This Forum is Locked
Author
Comment
robots text file problem

Can anyone please tell me what is wrong with this robot text file and what would be better.
meta ="Content-Type" content="text/html; charset=iso-8859-1"
META name="Copyright" content="Copyright 2005 Anora Anna http://.anoraanna.com/"
META ="Content-Language" content="en"
META name="revisit-after" content="15 days"
META name="robots" content="index, follow"
META name="Rating" content="General"
META name="Robots" content="All"
(I have removed < > so I could paste)

Re: robots text file problem

None of those commands are in the right format for a robots.txt file they are meta tags that go in a web page.

If for example you want to ban search engines from your cgi-bin and images folders then robots.txt would need to contain

User-agent: *
Disallow: /cgi-bin/
Disallow: /images/

If you just want a robots.txt that doesn't ban anything then use

User-agent: *
Disallow:

Re: robots text file problem

thankyou steve i appreciate your help