| > 1- regular download speed
The speed is limited to 25KB/s by default to avoid any server overload ; this
is probably still a good default value nowadays (more and more server-side
scripts eating CPU), but you may want to raise it in the settings.
Regarding the number of connections, it mainly depends on the site being
crawled.
| |