Hi !
I am using httrack and it work fine. It download many pages, but unfortunately
many wordpress blogs have many urls with the same content.
How to detect that text on page is on another page ? How not to download the
same content twice or more ?
Thanks for help !
|