PDA

View Full Version : How to prevent se bots to crawl my dynamic page?


Sxperm
02-11-2006, 12:58 AM
Hi, my friends. I've seen stats and found something wierd. I've used mod_rewrite to change from "refer.php?id=XX" to "Tell-a-friend-this-Listing-{$link.ID}-{$link.TITLE}.html" but google bots crawl both of them. like

"refer.php?id=11"

"Tell-a-friend-this-Listing-11-{$link.TITLE}.html"

It seems to be a duplicated content. How to prevent bots to crawl both of them but on url I rewrited?

:wink: Cheers,
Sxperm