HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: OFF Topic: HTTP protocol problem.
Author: Xavier Roche
Date: 12/21/2002 01:11
 
> This is a off topic message and has nothing to do with
> httrack. I'm desperate and need help. Maybe someone can 
help me.
> I try to make a simple program to retrieve data from a
> webpage and store it in a file called 't.htm' but it only
> works for certain websites and I don't know why.
> I test it with www.yahoo.com and it works but not for
> www.altavista.com.

1.
Apparently you are using \n as end of line. You MUST (RFC) 
use \r\n as canonical end of lines. Servers SHOULD (RFC) 
accept \n as eol, but are not required to do so. Therefore, 
servers may not fullfil your request properly.

2.
Do NOT use Connection: Keep-Alive unless you exactly know 
what you are doing (see RFC2616). Use Connection: Close for 
safer results

3.
Always use a Host: header (RFC2616)

 
Reply Create subthread


All articles

Subject Author Date
OFF Topic: HTTP protocol problem.

12/20/2002 21:25
Re: OFF Topic: HTTP protocol problem.

12/20/2002 21:35
Re: OFF Topic: HTTP protocol problem.

12/21/2002 01:11
Re: OFF Topic: HTTP protocol problem.

12/21/2002 06:19
Re: OFF Topic: HTTP protocol problem.

01/13/2006 14:31
Re: OFF Topic: HTTP protocol problem.

06/27/2009 03:27




b

Created with FORUM 2.0.11