| I have a site that will not download. There's nothing crazy in the robots.txt
file (though I set the Spider to "no robots.txt rules" just in case.)
==================================================
User-agent: *
Allow: /
Disallow: /*?ada_mode=*
==================================================
Originally the log file was showing redirects and saying it was due to the URL
Hack, so I turned that off as suggested in another forum thread. That still
didn't work, and the log file said the following:
==================================================
12:11:28 Warning: Moved Permanently for www.drthatcher.com/
12:11:28 Warning: File has moved from www.drthatcher.com/ to
<https://www.drthatcher.com/>
12:11:28 Warning: No data seems to have been transferred during this session!
: restoring previous one!
==================================================
Then I found another thread with a similar issue where they suggested adding
https:// to the start of the web address, but the site still doesn't download
(though after a greater period of time) and the log now says:
==================================================
11:56:13 Warning: HTML file (380 bytes) retransferred due to lack of cache:
<https://www.drthatcher.com/>
11:56:43 Warning: Retry after error -4 (Interrupted transfer) at link
<https://www.drthatcher.com/> (from primary/primary)
11:56:43 Warning: HTML file (380 bytes) retransferred due to lack of cache:
<https://www.drthatcher.com/>
11:57:44 Warning: Retry after error -4 (Interrupted transfer) at link
<https://www.drthatcher.com/> (from primary/primary)
11:57:44 Warning: HTML file (380 bytes) retransferred due to lack of cache:
<https://www.drthatcher.com/>
11:58:15 Error: "Interrupted transfer" (-4) after 2 retries at link
<https://www.drthatcher.com/> (from primary/primary)
11:58:15 Warning: No data seems to have been transferred during this session!
: restoring previous one!
==================================================
Any idea what I'm missing here? Thanks! | |