Is there a way to remove parameters from URLs to avoid duplicate pages (as
suggested earlier, <http://forum.httrack.com/readmsg/6881/6843/index.html> )?
For example to avoid downloading both
/page.html?param=1.2.3 and
/page.html?param=2.3.4
if they are the same page?
Thanks. |