|  | | webbase | | | webbase is an internet web crawler written in C and later ported to C++. It uses a MySQL database to store information about crawled URLs. It is available as a command line program or as a library (shared or static). It has two main functions: crawl the WEB to get documents and build a full text database with these documents. The crawler part visits the documents and stores intersting information about them locally. It visits the document on a regular basis to make sure that it is still there and updates it if it changes. The full text database uses the local copies of the document to build a searchable index. The full text indexing functions are not included in webbase.
| | Title: | webbase | | Author: | Loic Dachary | | Price / Cost: | Free | | Version: | 5.13 | | Last Updated: | Thu Oct 24 2002 | | Home Page: | Click to Visit | | Download: | Click to Download | | Web site Language: | English | | Current Rating: | 0.00 | | Total Hits #: | 85 | | Listings ID #: | 3647 | |  |
|