How Quickly Does Google Update its Database(s)?

David Degrelle, of e-SEMA (European Search Engine Marketing Alliance) tells me that Google is pretty quick these days, and his blog post – Google calculates SERP’s in 14 minutes and goes real time! points to a quick turnover time.

I’d be a little surprised if Google refreshed it’s whole index in that quick a period of time – there are so many websites to crawl, including new sites, and updated pages, that it seems unlikely. Yet, blogs that ping Google when there are updates may find the content of their pages getting indexed pretty quickly. And I’ve seen times indicated for news results at Google News that are minutes old, rather than hours.

Share

19 thoughts on “How Quickly Does Google Update its Database(s)?”

  1. Pingback: Как да попаднем в Google Blog Search за 2 минути
  2. Probably the most naive article I’ve ever read about search. This is nothing more that a blog search result being displayed directy in Google’s default search results pages. Has this guy ever heard of Universal Search?

  3. @ Nadir : You certainly don’t take time to read the full story and tests made, the surprising thing is not that a blog result appear in the Google SERP’s (and I wrote it in my article read it) but that Google do it NOW in REAL TIME !

    That’s the point amazing IMHO because I never see, in the last 8 years that I work in SEO industry, that Google recompute the ranking as fast as less than 1 hour in its global index. I don’t talk about Google blog search that do it in less than 2 minutes.

  4. Hi David. I did read your post and understood the point you’ve made. Google is not recomputing their ENTIRE index in less than an hour like you said. Like I’ve said in my post, this is just Universal Search in action.

    Google’s displaying Blog Search and News results (which they immediately obtain thanks to pinging) directly in their web results pages.

  5. It is completely unlikely that Google re-indexes the Web every 14 minutes, or every hour, or even every day.

    The rate at which it would have to crawl sites to do that would render many sites inoperable, with crawling having a similar impact as a distributed denial of service attack.

    Even in the early days of Google, the paper The Anatomy of a Large-Scale Hypertextual Web Search Engine described the use of a multi-tiered database – with an area for fresher and newer results that hadn’t been brought into the inverted index yet, and were indexed and searched as full text documents instead.

    It’s not surprising that blogs enter into the search results as quickly as they do, after pinging Google.

    We learned from Marissa Mayer’s presentation in June in Seattle in the Conference on Scalability: Scaling Google for Every User that Universal Search brought with it a completely new infrastructure. Interesting to see David write about how quickly his works make their way into Google results, but he’s not the only one to write about that this week. I’ve seen a few others.

    Then again, I’ve been seeing posts from here make their way into Google results fairly quickly, for a fair amount of time, even before Universal Search.

  6. Well, Marissa Mayer is a clever one and not that bad looking either! I’m pretty amazed at the quick inclusion into the SERPS. I’ve found that I had some good success recently with less competitive keywords to rise to the tip of the SERPS within a week or two.

  7. Yeap, google is pretty fast index my blog, but the problem is about my old post that I have modified to improve for better keyword and landing page.

  8. There is something curious about this. I am form Portugal and my principal blog is in portuguese… but i have some friends that are blogging in english, and google takes much more time to index english pages than portuguese pages… Why?!

    Have a nice weekend!

  9. I wish I had read this comment trail earlier and I have probably missed the opportunity for meaningful conversation. I would have to believe, without additional investigation, that Nadir is correct in the idea that this type of indexing is a result of Universal Search.

    I’m glad that it was pointed out, although I was under the impression that it must be a blended search result which was a possible based on the existing quality (or lack there of) of the search results already present. Either way, it’s an impressive demonstration (imo) of how a company/website owner could gain potential search visibility.

  10. Hi Derek,

    Your post inspired me to add a “subscribe to comments” plug in, so that people who are interested in a topic can track comments made, if they want.

    Interestingly, I haven’t noticed any less visits from Googlebot here, even if blog posts are entering Google’s index quicker because of pings to google when publishing a post.

    We know that Blog posts were entering the Google blog search respository pretty quickly. I’ve seen my blog posts enter fairly quickly, too. Have they been quicker since Universal Search? I don’t know for certain.

  11. Thank you very much for the quick reply – that is interesting. We relaunched our site and blog at almost the exact some time as the Universal Search announcement, so it would have been difficult to form comparisons on our end.

    I feel that part (if not all) of our success (in terms of rapid indexing – blog or regular web page) was in relation to the optimization of code and navigational design. I cannot guarantee that, but my experience (successful or unsuccessful) building and optimizing other blogs would indicate this.

    I do like the follow-up comments via email plugin and need to utilize that as well.

  12. Agreed. A good clean site with optimized code and navigational design is a plus when it comes to being crawled, though of course, some links help, too.

    There are enough decent blog directories and RSS feed directories, that it makes sense to submit to those pretty quickly after launching a blog as well.

  13. I was wondering the answer to this question myself for the longest time. It seems like Google not only updates its index but it switches databases too very often.

  14. Google is really fast indexing my sites. I use goo.gl / bit.ly to make it faster and the results are there within a few minutes soo i think it works for me.
    Cheers.

    p.s. Very usefull post from oggin indeed :)

  15. Hi Dimitar,

    I’m not sure that using shortened links help make the indexing of web pages any faster. They seem to add an additional step that the search engines need to follow in the crawling of links.

Comments are closed.