| Greetings,
First of all: congratulations for the incredible tool.
How do I change the "Accept" header from the request so the
spider just download pure text files?Because when the Accept header is set to
"Accept: text/*",
it will download only pure text links, receiving 406 if the
content of a link is not pure text.
Thanks. | |