I think there is nothing worse than a 404 error. For example, when you're looking for some content on the internet, and you find an interesting site (or worse – a product), bah: "error 404 page not found". You surely know that feeling. Frustrating. And yet so common. The topic of 404 errors and how to handle them is prevalent in technical SEO. However, I believe this topic is so vital that it's worth devoting a few words to it on our blog.
Error 404 (HTTP 404, 404 not found, 404, 404 error, page not found, or file not found) is a wrong response code. Refers to a subpage that wasn't found during the last visit of the crawler. It informs us that the user accessing the given subpage refers to a location or file that doesn't exist. The "page not found" error is often confused with the "server not found" error.
So, in summary, error code 404 happens when the client (e.g., a web browser) can communicate with the server, but the server cannot find the requested file, or it's configured not to fulfill the request and not display why.
If you notice 404 errors on your site, the most common causes are:
Whether it's a user's error or yours – by not setting a redirect, the effect will be the same – the user won't see the resources they expected.
There are some excellent tools out there to help you find 404 errors on your site. I personally use three of them on a daily basis:
While analyzing your website, you may encounter a bug described in Google Search Console as "Submitted URL seems to be a Soft 404". What does it mean? The subpage doesn't exist, but the browser still receives a status code of 200. It also happens that the user is shown a page with little or almost empty content. Such a result will be indexed in the search results, which means that the Google robot - instead of indexing existing pages we want it to, will return to a non-existent subpage and try to index it again and again. Therefore, we lose the crawl budget on subpages that neither the user nor the robot should be able to access.
Well, it depends (yeah, I know it's not funny anymore, but I can't hold myself back). ;) In general, Google's recommendations are clear: if we don't care about a given subpage in terms of position in search results, we can leave it as it is. Single pages with 404 errors are automatically found and removed from the Google index.
However, if we don't want to lose the link juice of incoming links, we need to set a permanent redirect 301. It's only worth remembering that it should lead to the subpage that was thematically closest to the deleted one, consistent with the user's intention.
You can also properly configure the .htaccess file, automatically directing traffic from the error page to the home page of our website. But in my opinion, this is not the optimal solution.
As you know, there is no one correct answer to a problem in SEO. And sometimes, it turns out that what on the surface is a mistake may turn out to be your asset. A creative web admin may also use 404 errors to their advantage. How? After all, you can design a 404 page with great graphics that draw users' attention. Alternatively, you can place an internal search engine on your website where users can enter a phrase to find what they are looking for or direct them to other pages on the site.
Don't forget about a sense of humor. And it may turn out that with the creative use of 404 pages, you'll improve user experience and increase your conversion rate. ;) Look at these examples of clever 404 pages.