| > what is the staring url, what does robots.txt say,
> what is the url with the actual content, what does
> the log file say about the image url. did you set
> the log file to debug.
> You don't give any information, so you can't get any
> answers.
Sorry about that, went to look at the log after it finally completed the
mirror and realized what happened. httrack apparently mirrors the site level
by level and due to the speed of the html connection, had yet to reach that
depth when I was looking at it. However, before it can reach that depth, it
ran into the default 100,000 links limit and "completed".
Resuming with a higher link limit appears to make it work fine with regards to
doc/pics/zip since I can see it downloading some at this point.
I'm back to the -%N0 problem though. It's still only using one connection for
html. Overall transfer speed has gone up to reasonable levels once the actual
content mirroring started but html's still crawling.
Is the default simultaneous connections max 2? If so, then I could see why it
seems like -%N0 has no effect. | |