Build My Site for Free

Matt Cutts: Okay, this is getting a little fixated on the idea of PageRank and maybe leaving aside rankings. So again, PageRank only depends links; it’s the ranking that might be affected.

So let’s talk through it a little bit. Your website goes down; what should Google do? Let’s play the game of step into Google’s shoes. We try to crawl a webpage that we’ve been able to reach in the past and for whatever reason it times out or it’s unavailable. How should we respond?

Well, if the website is about to come back in 15 minutes you clearly don’t want to drop its search rankings completely. But what if that webserver has just died and that domain is going away and is never coming back? Clearly at some point you want to drop if from the index and never show it again.

What Google tries to do is come up with a reasonable balance between these two extremes. If your website is only down for a day or so then we’d like to continue to visit it, see if it stops timing out, see if it’s back up and if it is immediately show it in the search rankings again.

If it’s down forever and as some point it looks really bad; it looks stale if we’re still returning that search result. So, we try to find a good balance. If your website is down for a relatively small amount of time, a day or two, then just bringing it back up should mean that it pops right back in the search results or it won’t disappear at all.

But at the point where your website is down for several days or a week or a month, then we are probably going to drop it from the search results at least until we can fetch again, find it, index it and then return it.

So, if you step into the game of play the search engine, step into our shoes and try to figure out what to do; it’s impossible to know when a given page disappears whether it’s gone for good or it’s gone for 20 seconds. And so we try to come up with reasonable sets of heuristics that say, “Ok, if we try to crawl it again and again and again and we finally find it the third time, then maybe we never drop it or we’ll show it again pretty quickly.”

Whereas if it’s gone for a week or more or lots of time, then you probably want to drop it and it’ll take a little bit more time for it to rank. None of this changes your basic strategy, which is try to keep your website up and try to make sure that it doesn’t go away for long periods of time if you can help it.