Using spiders
no spider included with VDK
extra credit for group which gets spider code from public domain & makes it build VDK bulk files for class to use
- must have throttling of spidering rate
- should adhere to robot files
- should be able to limit scope of spidering