I want to write a crawler to automatically build and maintain a catalogue the pages of a largish Google Site (new sites). This is necessary because there is no sitemap functiona