USER REVIEWS
Crawl a website with this free ActiveX spidering component. Advanced features include caching, "avoid" patterns, and robots.txt compliance.
WRITE USER REVIEW
Serving Software Downloads in 956 Categories, Downloaded 50.479.638 Times