DMOZ / Open Directory RDF Dump Parser(repost)(repost)

**Easy parser; great for RAC newbies! You can do it! :-)** The Open Directory provides all of its data as *enormous* RDF files. We only need the URL's for a certain subset, delivered as a text file. Write the software in your favorite language. Even though we are buying the software, it's only going to be run a few times, on your computer. This project gives us the right to have you run this five times, (with different queries of a similar nature), but you will be paid in full upon the first successful run. ## Deliverables All parsing should be done on the file(s) from the [Open Directory RDF Dump][1]. You need to determine *which* file(s) is/are most appropriate, based on what is stated there. (Warning: Those files are absolutely enormous!) **Do _not_ "scrape" the human-readable area of the site;** those are only mentioned below for the convenience of communication! The first run is to extract all URL's from [Health: Alternative][2] and *all* subordinate sections (recursively) *except* for the [Opposing Views][3]. Future runs will have a similar specification. Generate a text file with one URL per line. Remove the "http://" or "https://" (or any other protocol) from the beginning of the URL. If the URL then starts with "www.", strip that, as well. (Yes, I understand that this step may/will generate some broken URL's.) If the URL *ends* with a *trailing* "/", strip that, too. Do *not* strip any other "/" characters that may remain! **Example:** "ftp://[login to view URL]" should be stored as "[login to view URL]", even if DNS is not set up to make that a valid, working URL. The deliverable is the text file and the software used to generate it. There is no such thing as a stupid question. Please feel free to ask me anything! We will retain all rights to the software produced. * * *1) Complete and fully-functional working program(s) in executable form as well as complete source code of all work done. 2) Deliverables must be in ready-to-run condition, as follows? (depending on the nature? of the deliverables): a)? For web sites or? other server-side deliverables intended to only ever exist in one place in the Buyer's environment--Deliverables must be installed by the Seller in ready-to-run condition in the Buyer's environment. b) For all others including desktop software or software the buyer intends to distribute: A software? installation package that will install the software in ready-to-run condition on the platform(s) specified in this bid request. 3) All deliverables will be considered "work made for hire" under U.S. Copyright law. Buyer will receive exclusive and complete copyrights to all work purchased. (No GPL, GNU, 3rd party components, etc. unless all copyright ramifications are explained AND AGREED TO by the buyer on the site per the coder's Seller Legal Agreement). ## Platform Any platform, any language. Line breaks should work under Windows, i.e., don't forget to use "\r\n" if you are on Unix.