Hmmm....you don't have to have cgi scripts in cgi-bin if you know how to configure the server. In fact, if you'll look at the URLs for the Forum, you'll see that none of them are in cgi-bin.
Cgi-bin would be a URL like this:
http://www.stovebolt.com/cgi-bin/blah.pl or whatever.
URLs for the Forum are like this:
http://www.stovebolt.com/bboard/cgi-bin See the difference?
Anyway, your spider probably needs access to /html/bboard/cgi-bin/ultimatebb.cgi so it can parse the files. I'll have to see if there's a way to allow that without allowing access to other stuff in there that I don't want spidered (the Member list for one thing. The last thing we need is providing spiders with everyone's email addresses and passwords!)
