Java Reference
In-Depth Information
The spider also uses workload managers. Any workload manager used by the spider
must implement the WorkloadManager interface. The workload managers manage
the URL list. There are two workload managers provided with the Heaton Research Spi-
der. The MemoryWorkloadManager class stores the workload in memory. The
SQLWorkloadManager class stores the workload in an SQL database.
This chapter introduced internals of the Heaton Research Spider. You also saw how the
MemoryWorkloadManager was constructed. In the next chapter, you will see how
the SQLWorkloadManager class was constructed and how the Heaton Research Spi-
der interacts with an SQL based workload manager.
Search WWH ::




Custom Search