Capture entire websites

SiteCrawler is a useful, trial version software only available for Mac, that belongs to the category Internet software with subcategory Download Managers.

More about SiteCrawler

This software is available for users with the operating system Mac OS X and prior versions, and it is available in different languages such as English and Swedish. Its current version is 1.1.2 and the latest update happened on 4/19/2007.

Since we added this program to our catalog in 2007, it has achieved 5,599 downloads, and last week it achieved 0 downloads.

SiteCrawler is a slick program that will require less free space than the average program in the section Internet software.

SiteCrawler is a website downloading application that lets you capture entire sites or selected portions, like image galleries. It features powerful settings that no other application offers.

You don’t have to be an expert to use SiteCrawler. While the advanced features are easily accessible, they don’t bog down the basic settings, so you can stay focused on the task at hand. To start crawling a site, enter a web address and choose a destination folder on your disk. Further options help you fine-tune the behavior, such as which parts of the site to access.

By default, SiteCrawler changes references in downloaded HTML pages to point locally. This means you can browse downloaded sites without problems with broken links and links that point to the originating web site. Also, the file extensions of downloaded files are changed to match their actual content.

You can set up rules that SiteCrawler obeys when crawling a website. For example, you may want to exclude all files whose file extension is ‘jpg’. Or, you may want to explicitly allow SiteCrawler to follow links to certain domains that are not normally included. You can arrange rules like these in the Rules list. The rules are evaluated in order, so later rules can override previous ones.