written by Ian McCracken at Thursday, April 24, 2008
We needed to spider the entire Zenoss app for basic link checking. I was all for writing a simple Python script; I thought that would be easiest. As it turns out,
-roption, which will recursively hit (and download) all the pages in the site. I had no idea. Don't know yet if it'll give us the error reporting we really need -- don't want to parse all those files individually -- but it's pretty cool to know it's there.