Can I use wget to check for a 404 and not actually download the resource? If so how? Thanks
You can use the following option to check for the files:
wget --delete-after URL