| > But still, httrack's behaviour is not exactly what
> I'd wish: transfer rate slows down to 8kb/s when
> downloading 8k files, and skyrockets to more than
> 100kb/s when downloading big files in a row. Average
> was 50kb/s.
It takes time to open a channel, request the file, and server starts sending.
What you're seeing is the turn around time to the server and that dominates
the download for small files.
With bigger files, the max transfer rate dominates.
On my mirror, I got only get about 3 files per second updated. That's
independent of the file size since nothing is being downloaded but the
headers.
With the new version, you can update using multiple connections. More
connections reduce the average round trip time. Keep the server happy by
keeping the connections/sec small (I used 5) | |