Php files and robots.txt

[SeanyG]

I have a database driven site I'm working on for one of my client. They did not have a robots txt file so I am adding one.

Most of all URLs are seo friendly, on the other hand, the regular php files are still on the server and could be picked up from the spiders.

So, do I need to keep out product.php, contact.php, etc. to the robots.txt?

[eUK-Ralf]

Hi,

Here is the sample code to disallow files/folders under your account.

User-agent: *
Disallow: /Folder Name/
Disallow: /File Name

Hope this answers your questions

[Raymond]

If you are having friendly URLs, then usually those php pages are 301 redirected to the friendlies, correct? If that’s the case, then I don’t think that you need to exclude them.