Created Friday 21 December 2007
Options:
-Kk convert links and backup -c continues downloads -r recursive -p download page-requisites
If wget doesn't want to download some files because of a robots.txt file, just download everything that you can, then modify the file robots.txt downloaded to suit what you want, chmod -w it and re-run wget with -c switch.