Comments on: Validating an entire site

By: Scrambled

Scrambled — Mon, 21 Nov 2005 01:00:47 +0000

Ok, update I have it working sort of but nothing happens when I run either script except that crawlsite does crawl the site, dos box - I’m running Windows - showing all the links but doesn’t output to a file? I’ve specified a file for it write to and massvalidate runs for about a second then nothing?

By: Scrambled

Scrambled — Sun, 20 Nov 2005 02:27:06 +0000

I’ve just downloaded the W3C Validator and noticed the check script is completely different to your version any tips on mods needed?

By: helen

helen — Wed, 09 Nov 2005 20:48:50 +0000

Ben Hammersley’s RSS validation version is great. We always use it and it never failed. I would reccomend it.

By: Pete

Pete — Wed, 12 Oct 2005 12:55:27 +0000

I will leave comment nine here as an interesting specimen of comment spam. Does he really think that people will be interested in following links after statements like “Now I already year of the free person with weighty incom!”?

By: Roger Johansson

Roger Johansson — Sun, 15 May 2005 09:33:51 +0000

Tim: You can put them anywhere, as long as the htmldata library is in the same folder as crawlsite.py. You also need to rename The htmldata script to htmldata.py. I put everything in the validator/htdocs folder.

By: Tim Swan

Tim Swan — Fri, 13 May 2005 17:41:37 +0000

Where are you putting the crawlsite and massvalidate scripts? I’ve got everything working up to this point, but I’m a newbie.

By: Jens Meiert

Jens Meiert — Wed, 11 May 2005 11:08:24 +0000

You can also use the "Validate entire site" option of the (web-based) WDG HTML validator (which is per default enabled if you try UITest.com's Site Check).

By: Small Paul

Small Paul — Wed, 11 May 2005 00:32:21 +0000

Great stuff - being on a PowerBook, I expect I'll be finding this very useful in future.

I had the same issue at work recently. We solved it pretty quickly, as a developer had built an XML validator using a stock .NET XML validation control. It took him about 90 minutes to whip it into reasonable shape, which was pretty cool.

By: Roger Johansson

Roger Johansson — Sat, 07 May 2005 17:02:31 +0000

Neat. Thanks for compiling this info. I got it working after a bit of fiddling around - the “check” script in my installation of the W3C validator seems to be a different version than the script you modified. I had the validator installed already, so I suppose it could be an older version… not sure.

By: Tom

Tom — Mon, 11 Apr 2005 16:45:25 +0000

Hmm, perhaps Ben could shed some light on why it’s not working for some URLs. I guess an intranet would throw a spanner in the works somewhat.

Oh I think you have to use “site:www.standards-schmandards.com” instead of “site:http://www.standards-schmandards.com” .