DMOZ Help

[f1gm3nt]

I'm working on a DMOZ extrator for this thing. I'm really new to this project and I like what I see. I was wondering if some other people that have been working on this thing can give me some insight on some code I'm working on. Basicly I have all the categories saved in a database as 'Top/Category/AnotherCategory' etc. It doesn't have a parent id. I'm having trouble converting it to where it checks the database for a bunch of stuff. Maybe it's the lack of sleep, I'm not sure but if someone can help me with this code the rest is done :) I'll just have to test it and change a few things and I can release it in the mods forum.

[Mike77]

I was wondering why not just use one of dmoz extractors alredy available and importing directy to mysql database?

I would be careful since it is possible that sooner or later google will start penalizing all those dmoz or part of dmoz clones. Isnt this happening right now? (I see many complaints on webmasterworld forums on directories beeing deindexed etc)

[f1gm3nt]

Other MySQL extrators don't save it as phpld uses it. You'll have to change a lot of things. All I'm really doing with this is making it covert data into the phpld database. I also have never found a good working extrator. I'm not sure about the whole google thing. I use to run a 'dmoz clone' but I just started like that. After awhile it was an entire different link directory.

*UPDATE* I got it to convert the directory structure =)

[minstrel]

If you want your directory to be of any current relevance, don't bother with the DMOZ feeds.

I don't know if you've looked closely at what's in DMOZ lately but I have -- most of their categories these days are woefully out of date or cluttered with spammy sites...

[f1gm3nt]

Well, since I'm so close to finishing it, I'm going to go ahead. The next thing I'll look into is importing links from other programs and databases. Maybe in future versions of phpld it could have a 404 error checker?

DMOZ Test
/dmoz

[Abilnet]

Sounds like a Great Project to me, looking forward to test it ;)

Keep up the great work! :lol:

[Ap0s7le]

f1gm3nt, sounds like a good plan.

I'd like to check out your code, wanna share?

Yell at me on one of my IM's, we need to get to know one another.

Thanks

-Casey

[f1gm3nt]

It's done but I'm seeing a few bugs. I've sent a copy to David, if anyone wants to test it out then send me a PM with your e-mail in it. I will suggest that you back-up or even better put everything into a test database. I really don't want e-mails/messages with angry people.

[David]

Thanks, I got it, and I sent you a message. I'm hoping to try to show a couple of folks, so they help.
Thanks,
David

[Ap0s7le]

I'll throw it on a test directory, and look for any bugs and try to clean up anything I can.

Yell at me on one of my IM's Josh.

later

[f1gm3nt]

Well, I have a test set up - /dmoz The only bug I've noticed is it doesn't add some of the categories. I'm looking into it right now.

[latino]

Hi:

Just one question about the DMOZ extractor, How the PR will be updated from N/A? Any idea or phpLD will take care of that. Also, how much time could take to extract the whole DMOZ? Just for curiosity...

Regards!

:wink:

[David]

You can update it. Look here:
http://www.phplinkdirectory.com/forum/viewtopic.php?p=1877#1877

[latino]

Thanks David!

:)