So if I remove all +filters (+*.png +*.gif +*.jpg +*.css
> +*.js -ad.doubleclick.net/* -mime:application/foobar) it should stop
crawling other website unnecessarily? When I had looked at the progress in the
morning it was crawling a completely different domain. I'm going to try again
tonight with no +filters and hopefully it saves only my projects and the
images linked to ExactTarget from within the local HTML file. Thanks for your
help! |