| How do I download a full sight with all files?I have added rules such as
+www.imdb.com/*
+http://movies.imdb.com/*
I still am missing files and folders.
Also when I view the mirrored site and try to access the protected content of
the sight it doesn't let me even though I
inputed my login and pass in the correct manner. example:
1234:abcd@wwwimdb.com
Do I need to make a rule such as +1234:abcd@wwwimdb.com/*
would this work?
I also should note that I have the no robots.txt option selected.
I do notice something like this in the log file,
"www.imdb.com/trailers.5d.delayed"
What does the delayed mean?
Any help would be much appreciated.
Thanks,
Bryston
| |