To download whole web sites recursively, use wget -m <URL> where -m (mirror) does a recursive download of up to five levels and only downloads files which are newer than the local copy.