checklinks

checklinks ..

coded up a small tool in tcl this evening to check links from a page or list of pages. basically i needed to verify that the links from a page were valid. it works like the following:

$ checklinks.tcl http://monkey.org/~jose/software/
==> checking http://monkey.org/~jose/software/
==> checking http://www.monkey.org/~jose/software/extract/
==> checking http://www.monkey.org/~jose/software/tracepath/
==> checking http://www.monkey.org/~jose/software/picpages/
==> checking http://www.monkey.org/~jose/software/cligoogle/
==> checking http://www.monkey.org/~jose/software/fw-mon-0.0a.tar.gz
==> checking http://www.monkey.org/~jose/myscanssh/
==> checking http://www.monkey.org/~jose/pdfsearch/
==> checking http://www.monkey.org/~jose/software/cli/
==> checking http://www.monkey.org/~jose/software/failgen/
linkcheck ending

some problems with it:

if you use relative links it fails:
```
==> checking /
    link not found: /
```
same for 302 redirect codes ...
it performs a breadth first search, i should change this to a depth first search to make sorting the source of the invalid links easier.
i should also have it only do a HEAD request for the followed links, saving on bandwidth ...

uses the Tnm package from scotty and tcllib.

the code is available: http://www.monkey.org/~jose/software/checklinks/checklinks.tcl

[link] Wednesday, Dec 10, 2003 @ 10:29pm