When spidering, optionally, if the resource exists locally where the diskwriter plugin would download it to, set the If-Last-Modified header to its last-modified time, and optionally ignore resources that produce 304 Not Modified status.
Log in to post a comment.