PDA

View Full Version : Demo directory is spiderable


pawelboss
08-11-2005, 09:29 PM
Hey I just installed the directory on my server and everything looked good till I noticed that there is a major difference in your demo directory and the one I just installed. The one I installed is not spiderable by search engines and the links to categories look like this:

http://www.home-business-opportunity-directory.com/business-directory/index.php?c=9


Instead of like it would be on your demo:
http://www.home-business-opportunity-directory.com/business-directory/work-at-home/

I need that changed asap. Can someone help me?

pawelboss20@yahoo.com

Ap0s7le
08-11-2005, 10:13 PM
This is one of those things where I just can't help but want to ask for a couple bucks for doing it haha

Login to the admin, goto

System > Directory and Enable URL rewrite

Thank you very much, feel free to send a donation ;) lol

-Casey

pawelboss
08-11-2005, 10:37 PM
Thanks for quick reply to my last post.
I don't know how I didn't notice it before :)

I would like to remove your link from the directory and I know how
I already found the file with it. How much would you charge me for it?

Thanks ,
Pawel

Ap0s7le
08-11-2005, 11:51 PM
You can go to the home page and click on the donate now button.

Send the URL of the website, the url of the directory and 50 dollars and than feel free to remove the copyright.

Thanks

-Casey

pawelboss
08-12-2005, 07:11 PM
Ok Google picked up my directory home page, but not subcategories. How can they be spiderable if they don't exist. The links somehow are virtual or something but they can't be seen by search engines. PLease help with this one. The links look spiderable but the script didn't actually create actual pages or anything.

Thanks,
Pawel

Ap0s7le
08-12-2005, 07:45 PM
It doesn't have to create pages. The urls are valid to Google or any other search engine out there.

Google will often not spider a whole site the first time anyway.

I have numerous websites that use this method, it's a standard and completely acceptable.

Thanks

-Casey

pawelboss
08-14-2005, 01:38 AM
hey it's been three days, and my directory is not spidered. Only the main page. Something is wrong becuase google spiders my website daily and any new page apears in the index within 24 hours. None of the categories are in the index. Besides that Google spider doesn't even visit those virtual pages , only the main page and leaves. How did you get your demo spidered then?

Ap0s7le
08-14-2005, 05:01 AM
by giving it time

ilushkin
08-14-2005, 04:42 PM
Content visible to registered users only.
it's spiderable. google and msn spider mine daily even subcategories. just check your CPanel Web Statistics.

David
08-14-2005, 06:32 PM
You might try putting some links to internal pages on another site or two. What is the PageRank of the the homepage?
I'm found that if it is less than 4 the google spider does not index new content as quickly (unless you get lucky), so if possible add some links to internal pages on higher pagerank sites.