robots.txt

[Christoph]

What does everyone think about the following for the contents of my "robots.txt" file?

Content visible to registered users only.

Should I remove the initial forward slashes "/" from each Disallow?

The last Disallow is to stop "config.php" and "create_db.php" from being spidered.

Also, I left the "install" directory in for now. However, I can safely delete this directory and its contents after the install, right?

Any other suggestions for stuff to include in the "robots.txt" file? Anything that would help with SEO is welcome as well.

[seothatworks]

Not sure about previous, some seem unnecessary but I will leave others to comment since I am not very experienced in that area.
I would disallow submit.php, unless you got a reason for having it indexed.

[David]

I have always been a little "ify" about robots.txt files.
For example, why would I want to make it possible for people to know which folders exist that I don't want anyone to see?

I know some will disagree, and I'm all for having a good answer to this.
I see over on WMW, they use the slashes at the beginning of the folder name (look near the bottom)
http://www.webmasterworld.com/robots.txt

[kulinar]

Content visible to registered users only.For security reasons I always delete install directory after instalation. Some APsI even don't work when havin install directory (for ex. phpBB)

[David]

Note: the install directory is used during upgrades too, but you can always upload it again.

[Christoph]

Content visible to registered users only.

That is why I left the directory (and its contents) on my server and placed a Disallow in my robots.txt file. I have also done a 'chmod 700' on it.