Ruby web crawler 1.0

Operating systemsOS : Windows / Linux
Program licensingScript Licensing : Freeware
CreatedCreated : Jun 27, 2007
Size downloadDownloads : 4
Program licensing
Thank you for voting...

This Ruby script reads in a list of links from ...

This Ruby script reads in a list of links from links. dat, it then picks out the ones it can easily spider and gets a list of url from each page listed in links. dat.
Every new URL it finds will be added to newlinks. dat for later spidering by another bot running along side this one.

Ruby web crawler 1.0 scripting tags: ruby web crawler, url, finds, linksdatevery, newlinksdat, added, ruby snippets, list. What is new in Ruby web crawler 1.0 software script? - Unable to find Ruby web crawler 1.0 news. What is improvements are expecting? Newly-made Ruby web crawler 1.1 will be downloaded from here. You may download directly. Please write the reviews of the Ruby web crawler. License limitations are unspecified.