SETTING UP YOUR DATABASE - HTTP Programming Recipes for Java Bots - page 614

dbURL: jdbc:odbc:Driver={Microsoft Access Driver (*.mdb)};DBQ=c:\
spider.mdb;DriverID=22;READONLY=false}
dbClass: sun.jdbc.odbc.JdbcOdbcDriver
workloadManager:com.heatonresearch.httprecipes.spider.workload.
sql.SQLWorkloadManager
startup: clear

filter: com.heatonresearch.httprecipes.spider.fil-

ter.RobotsFilter

Of course, you will have to modify the above listing to include the filename and path of
your database.

Setting Up Oracle
Oracle is a commercial database product. Many companies use oracle. For more infor-
mation about Oracle you should visit the following URL:

http://www.oracle.com

Oracle also makes a free version of their database, named Oracle Express. This free ver-
sion allows developers to try the Oracle database, without having to purchase an expensive
license. For more information about Oracle Express, visit the following URL:

http://www.oracle.com/technology/products/database/xe/index.html

The DDL script to create the tables on Oracle is shown in Listing F.5.

Listing F.5: Oracle DDL Script

-- Create SPIDER_WORKLOAD

CREATE TABLE SPIDER_WORKLOAD
(
WORKLOAD_ID INTEGER NOT NULL,
HOST INTEGER NOT NULL,
URL VARCHAR2(2083 BYTE) NOT NULL,
STATUS VARCHAR2(1 BYTE) NOT NULL,
DEPTH INTEGER NOT NULL,
URL_HASH INTEGER NOT NULL,
SOURCE_ID INTEGER NOT NULL
)
LOGGING
NOCOMPRESS
NOCACHE
NOPARALLEL
MONITORING;