HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: Error: "" (500) after 2 retries at link...
Author: William Roeder
Date: 05/15/2009 04:29
 
> sorry for that. The correct link is
> <http://wl4.wealth-lab.com/cgi-bin/WealthLab.DLL/cate>
> gories and this is what I used in httrack.
> 
> Why not?
robots.txt says:
User-agent: *
Disallow: /cgi-bin/

The site doesn't want you to. You'll have to override robots.txt setting
 
Reply Create subthread


All articles

Subject Author Date
Error: "" (500) after 2 retries at link...

05/14/2009 01:28
Re: Error: "" (500) after 2 retries at link...

05/14/2009 01:33
Re: Error: "" (500) after 2 retries at link...

05/14/2009 16:37
Re: Error: "" (500) after 2 retries at link...

05/14/2009 20:34
Re: Error: "" (500) after 2 retries at link...

05/15/2009 04:29
Re: Error: "" (500) after 2 retries at link...

05/20/2009 14:12
Re: Error: "" (500) after 2 retries at link...

05/20/2009 16:48
Re: Error: "" (500) after 2 retries at link...

05/20/2009 19:12




e

Created with FORUM 2.0.11