Google released a feature “to help you discover if your site serves undesirable “soft” or “crypto” 404s. A “soft 404” occurs when webserver responds with 200 OK HTTP response code if a page doesn’t exist rather than appropriate 404 Not Found. Soft 404s can limit a site’s crawl coverage by search engines because these duplicate URLs may be crawled instead of pages with unique content. web is infinite, but the time search engines spend crawling your site is limited. Properly reporting non-existent pages with a 404 or 410 response code can improve crawl coverage of your site’s best content.
You can find new soft 404s reporting feature under Crawl errors section in Webmaster Tools. Here’s a list of steps to correct soft 404s to help both Google and your users:
- Check whether you’ve soft 404s listed in Webmaster Tools
- For soft 404s, determine whether URL:
- Contains correct content and properly returns a 200 response (not actually a soft 404)
- Should 301 redirect to a more accurate URL
- Doesn’t exist and should return a 404 or 410 response
- Confirm that you’ve configured proper HTTP Response by using Fetch as Googlebot in Webmaster Tools
- If you now return 404s, you may want to customize your 404 page to aid your users. custom 404 widget can help.