
After 1 - 2 months, the Error 404 Page should not be found again.
Another approach is to place the Error 404 html file in a special directory and use robots.txt to disallow web spider to crawl on that directory which looks like:
[file robots.txt]
User-agent: *
Disallow: /cgi-bin/
Disallow :/404-file/
No comments:
Post a Comment