Harvest-NG is a set of tools for building a standards-compliant web crawler
8682Harvest-NG is a set of tools for building a standards-compliant web crawlerhttp://webharvest.sourceforge.net/ng/The current release of Harvest-NG has come a long way towards achieving these goals, and provides a strong foundation upon which to build internet resource discovery systems. These are the two roles of the project, to build both a fast, resilient, and efficient indexing system, and through this, to produce a highly extensible toolkit for building other systems to achieve different tasks.CGI and Perl > Scripts and Programs > Searching > Web IndexingOct 11, 2006
The current release of Harvest-NG has come a long way towards achieving these goals, and provides a strong foundation upon which to build internet resource discovery systems. These are the two roles of the project, to build both a fast, resilient, and efficient indexing system, and through this, to produce a highly extensible toolkit for building other systems to achieve different tasks.
Joining mailing list will entitle you
to receive occasional emails informing you of news and
updates to the site and any special offers that may be
of interest to you.