| > I'm asking myself if it is possible to grab the site
> www.dol2day.com?> We try to make an archive-CD of this site and I
wonder
> if it is possible. The Database is about 1 GB big.
Hum, first ask permission to the website admin - 1GB
is really big, and it might be a good idea to schedule
the download in non-business hours.
Then, if the website requires authentication, and
especially formular-based authentication, you'll have
to use the 'add url/capture url' feature. Define
proper filters, too, if the default one are not
convenient (the default ones are: capture the website,
plus external images/js/css is any)
Ah, one tip: you may use bandwidth limiter and/or a
limited number of simultaneous connection if you have
a fast pipe - not to clobber the website!
| |