Google Gets Caffeinated
Posted by krosenblatt in Affiliate Marketing, SEO, Traffic Tuesday, 15 June 2010 11:30 47 Comments
Something strong has been brewing in Mountain View California, at the HQ Google programmers call home. In response to the recent explosive growth in online information and instant connection and communication, Google has revised its index, and named the new search indexing system Caffeine.
This revision is in keeping with the recent changes to the look of Google’s search results page and their keyword search tool. Google’s new search skin allows you to sort the search results by news feeds, videos, shopping, blogs and discussions.
Here’s why the change to the indexing system is important: it’s focused on finding the latest relevant content.
Let’s break it down:
When you search Google, you’re searching their index of the web, not the actual web itself. The index is informed by the spiderbots that constantly go out, ‘read’ websites and report back. The old index was layered, and to renew a layer with current web information meant searching and analyzing the entire web. Google found that this layered format meant that there was a lag between the time that new information was added to the web, and when that information was added to the layer.
The new indexing system analyzes portions of the web, and updates the index continuously. According to Google, Caffeine “processes hundreds of thousands of pages in parallel.” By breaking the web into smaller sections and sending out search groups, Caffeine can get closer reporting what’s relevant in real time. Here’s how they picture it on their official blog when they announced the change:
The exponential growth in popularity of YouTube, Facebook, Twitter, and FourSquare reflect the desire for real-time connectivity, and coverage of events – large and small – in real time. What’s being said now, filmed now, happening now, and where it’s happening this instant, has changed the content on the web and what we expect to find when we search it. Caffeine reflects that change.
Here’s a timely example, look at the search results for the query ‘world cup’:
Right after the URL at the bottom of the link is a time stamp. The stamp reflects when the information was indexed, or Google’s most recent stored version of that page. While the 4 minute stamp seems impressive, if we look at Google’s search results in their ‘Updates’ category:
We find that the is coming in so quickly it’s posting as ‘seconds ago,’ and the stream of new postings is rolling so quickly it’s hard to keep up!
Google’s goal has always been the most relevant information. But in this 24-hour news cycle and Twittering world, ‘current’ is becoming stronger. The Caffeine indexing system is Google’s latest quest for relevancy. Does it work for you?
So if I read this correctly, then it’s even more imperative that companies who haven’t “bought onto” to social media (and frequent changes) will quickly find themselves sinking down the rankings if their content isn’t kept fresh and consistently revised. Is this a correct assumption?
This sounds like it will have big ramifications for the small business owner who has a brochure-type website. I wonder if they have integrated this into the Google Local/Maps indexing?
Thanks for the great summary of this new approach.
Also, no one seems to be discussing how this adversely affects AdWords. When you switch to the Google “latest view” no ads display. When you switch to “past 24 hours” it appears that only Google’s own ads show.
Will these “latest” views only show AdWords that have been changed within the timeframe as well?
Powerful, put perplexing to businesses. It could have serious ramifications to the viability of PPC advertising.
the site is really good and useful and specially the content…
I’ve been monitoring my sites using a service which compares how the “old” Google index returned pages and how the “new” Google index returns pages. There are subtle changes.
You have to love Google for staying true to their business model of delivering relevant content to their customers, i.e., searchers.
Initially I felt a bit of a wave of panic when I read about their changes. And I realized what a silver lining this can be for those of us who do continually add fresh and new content as opposed to the staid and static corporate websites we consider “search engine page results” competitors. This is a valid competitive advantage.
So yes, we will all need to become more ’social’ – and why wouldn’t we – because social sites where we have an internet presence are one of the ten slots we’re trying to fill to own page one. And we should all continue to focus on the basics of what we should have been doing all along – providing and delivering fresh and relevant content to our customers via our website properties. That’s what they want, and that’s what the search engines (Google) wants.
The games afoot. You know the rules. Go write some fresh and new and make it known!
Best regards,
Cheryl C. Cigan
Known Books
I still haven’t figured out how all of this affects sites that promote products that do not change as quickly as trending news does.
I can see how G may want to get all the latest buzz about the oil spill, world cup or other newsworthy items and be the first search engine to show results but there is so much more to the web than just trending items or fads.
Have you wrapped your head around how G may fit in these stagnant types of sites? Are they not affected as much or is there a different fame plan going on for them?
Intriguing
Revolutionized
It looks like it’s working faster than anyone can keep up. What trully does this mean for the single marketer as well as everyone else who’ll be thinking their content/posts are fresh?
I like the new Google interface, however I’ve seen that most of my sites traffic is dropping. Do you guys experience the same thing or is it just a seasonal thing? Our sales is up however…
And as Kathy said, what is the future of PPC? Can Google afford to loose revenue from PPC?
This is truly interesting! It looks like some type of explosion of at the momemt information finding and dispersing out to cyberworld.
It could prove a great impact to many who”s looking for targeted or specific information if I understand this right. That’s why your website Niche is important as well as Keywords.
The negative of all of this is who is left out because we all know that google have high expectations of great content and great over the top web site that is just screeching with information, information, information;links, links, links, and a little Bang!
This goes to show you how your products should also include information which could even mean more books, ebooks, articles, and the like to enhance the niche!
How to, Get to, Now!
Thelma
This is great info and I’m certainly glad that I’m involved in “social” media as your examples demonstrate the power it is having with Google! Obviously frequent and relevant “social” media posts are necessary to keep a site in public view and for good rankings.
Your post does, however, raise some very good questions especially the one by Kathy Keating…How does this affect AdWords advertising?
Please let us know..
Thanks
I´m sure Google doesn´t shoot themselves in the foot.
Adwords brings in most of their profit and it seems unlikely they are planning such big changes.
Nothing like staying current! Businesses will have to research now to find whether their most effective advertising will be on You tube, social networking sites, or PPC and other types of Google advertising. Seems as though the rules are changing and the tools haven’t quite caught up for business advertising.
Looks to me that if you are not updating your blogs and websites on a regular basis you will continually fall in the search engine rankings with google? Is that whats happening here?
first is invention, the second aspect is implementation, last is the positive achievement.
For the information that is non localized, this should be a great change. My observation is that most searches are for local companies and businesses and my question would be how much will it effect those searches.
The latest, up-to-the-second musings from every Twitter user on the planet is not what I’d consider “valuable content.” I’d have difficulty even calling it ‘content.’
Fresh? Yes. Useful? No. Rambling blather? Definitely. Apparently, Google forgot there’s an important distinction between ‘data’ and ‘information.’
I thought Google was smarter than this — there are better ways to provide fresh content that’s actually valuable.
Now, anyone can post and shoot right to the top of Google. For about 2 seconds. But if it’s never seen again, just how valuable was it?
How will this affect static websites (ie. non-blog) being found via Google search?
Still trying to work out how this will effect some one like me, with a appliace repair business and website. Does this mean I will need to keep updating my site to keep No 1 positision for my chosen keywords or will backlinking still do? This info will help me to keep on top. Thanks
It will be great to get qualified traffic to certain web sites
Thank you for this post. It will be very helpful as I develop a class on internet marketing.
I am going to go play around with it and check out Kathy’s comment on Adwords.
I can see a few things coming from this. Depending o the subject matter you could potentially go up or down rather quickly in Google’s rankings. For example. search for world cup or oil spill right now and depending on how active you are could have a quicker effect on your rankings rather than a search on weight loss.
I did a search on all three. The first two had time stamps, the oil spill didn’t have time stamps on every site on page one so that was interesting. Weight loss on the other hand didn’t have any time stamps. That being the case if I’m thinking if you were to build a weight loss site and have some fairly constant updates along with everything else you’ll climb the ladder that much faster because not everybody else is updating as much as you are at the moment.
I can also see this as a way to make it that much easier for Google to spot auto blogs in the future.
just my 2 cents
Good information. I also would be interested in seeing how this will affect AdWords
So does this mean we will be able to get search listed faster as well as de-listed faster? in other words, Google will be indexing sites on a continuous basis, hourly , thus we can get on first page result very fast as well? sounds like a double edged sword doesn’t it?
I think this is very exciting and it seems like the trends will be more up to date if I’m reading it right.
That is a good point about the ads–where will they be?
You are hot on the heels of a HUGE breaking story.
Thanks for the detailed information.
It looks like they are trying to deal with the new search engine – Now Relevant.
Plus include Twitter and Facebook breaking stories — that means Twitters new Geo-Targeting,
And Facebooks Geo-Targeting will be included — a big plus for local businesses — of all types.
It’s time to relearn Keyword research.
If timeframe becomes the basis, it is good for breaking news or current events that is affecting the world. For business purposes or for searching merchandise or services, your website will end up way down unless you have to write something new every few seconds.
Does this mean that “latest” will eclipse “best,” “most relevant” and ‘highest quality?” Will it be like a classroom where one student gives an in depth, well considered answer and then someone pipes up with something silly and the teacher (Google) says “Good, we’ll go with the most recent response?”
This will surely affect the micro niche websites who relies on little content. The set and forget sites.
This great info to go forward with. Relevancy and current information will make active blogs way more important than ever.
Very interesting and informative post! Yet again I’m glad I opened your email and checked your post, as I’m just now embarking on my first Adwords campaign. You’ve brought up some seriously thought provoking questions here, as has Kathy in her reply. Now I need to rethink whether to use search or content network for my first campaign with paid ads.
Looking forward very much to seeing your insights into how this is going to affect marketing.
Does it mean all established websites will go down and new ones will come on the top?
Just another piece of the growing puzzle… but to me, current does not necessarily translate to relevant or value. More often than not, it is fleeting and superficial.
Thanks now I know How google index when people search on google search, this is good information
Very useful information. Thank you for the post.
I was surprised to see the changes in the Google keyword tool recently, particularly as the website analysis function was restored. Your blog helps explain what all this was about.
I note Kathy Keating’s comments regarding adwords and PPC. It would seem there will be major implications for PPC in particular – like it will drive prices up!
Speed to market is everything.
Just when you think you got it under control..right!! lol
O well change is good ..Thanks for the heads up
Wonder if they will start charging us more for our adword bids since they are helping us to blend in?
I believe you are right. PPC and Google Adwords in particular will continue to evolve in the wake of these changes. I’ve noticed several differences in the Google interfaces. One that I welcome is the ability to request more targeted data. Being from Canada, Google search is usually slanted at what it thinks I want and serves up content for Canadians. This of course doesn’t help when I am targeting a different country. I am for the ability to target Google search by country in the near future.
This is in real time. Which could be good for some of us and not to good for the rest of us.
I personally like the “real” time search. I have always tried to impress on my clients the importance of keeping the web relevant and integral and Google is definatly helping. I am also curious about how this will affect Adwords.
There they go again… changing the rules of engagement on us. Better for the user but harder for Web marketers and online publishers, for sure.
This new change is going to have people freaking out trying to change their sites to suit the new rules. Their doesn’t seem to be any change on the main search of everything but latest updates on blogs will definately be a plus if you want your site to show up on the first page of google.
Thanks for the info!
I believe this make it hard to rank using just the common SEO tactics, althought this give a lot of opportunities for those posting fresh content.
Heck I don’t know, its kind of confusing still… but great for google! always innovating…
I have to agree with the small business owners that are concerned about their static web sites that don’t change frequently. It will be interesting to see how this plays out.
“G get caffeinated” is the news – thanks for getting it to us. “What does it mean (for the affiliate marketers)”? Huge opportunity for who has the answer. [wish it were me :-]
Thanks very much guys, you continue to come up with the goods.
I work with local small businesses and I think this is actually a ral opportunity to levl the playing feild with the bigger corporates. If small business maybe look to adopt blog style websites and make it part of their weekly (or daily) process to post something new and relevant they might just be able to get a step ahead of the slower movers.
We all knew it was coming – what matters is who was ready for it.
They must have changed something else too…. i saw 3 of my “www.xyzscam.com’s” fall off the serps and a few others have been dropped down… the content was only a week old – so that cant be it!
plus i have been seeing my other sites jump up and down in the searchs for now reason whatsoever! no new back links… nothing..
Weirdos!
I feel a twitter killer in the works soon…….. anik we need a cafeenated drip marketing system able to rank for each of those little tab thingies…
I can be at the head of the curve for once! Woop!