Run multiple web crawling scripts to retrieve data

BrownRecluse is a web crawler, or spider, that browses the web to pull out specific information the user has defined. It can be used for tasks like email harvesting, and downloading source code.

While BrownRecluse tries to be accessible, this is still not suitable for beginners. You’ll need a rudimentary understanding of programming to use and benefit from this web crawler. To help, there are ready-made scripts that give you a starting point to make your own.

Open a script file and hit run, and BrownRecluse will begin to crawl the specified web site, and save the data the script requires. The script could be written to collect addresses, monitor site changes, or download all the images or MP3 files on a site. BrownRecluse’s uses depend only on the person programming the script.

BrownRecluse allows multiple scripts to run at the same time, and they can be paused and restarted without problem.

If you want to grab information or files from websites, and have enough technical knowledge, BrownRecluse does the job.