Daisy Analysis Editing Browser - Spidering Web Sites

Back

 Spidering is the process whereby all pages in a web site are read and checked for links.

The spidering process in the Daisy Editing Browser uses HTTP rather than FTP, which means that it can pull web sites without knowing the FTP settings. Obviously, don't do this without the correct permissions and copyrights.

Spidering is controlled from the dialog shown.

Spidering a Web Site

The results shown in the dialog were obtained by running the program on an incomplete version of the Multiple Browser web site.

Note :-

  1. Check the various boxes and enter any ignore masks to decide how the spider will be performed.

  2. The working directory can be populated with the files from the web site.

    This working directory is deliberately not the same as the download working directory as it should be cleared before spidering.

  3. Zips can be created of the files.

  4. Note that there is a more-powerful, but slower spider, that uses FTP in the Manage dialog.