Girl Geekette dotNet

Where the Girl Ends and the Geekette Begins


Googlebot Meta Tags

Besides the keyword and description meta tags being the most important ones, there are some meta tags that are proprietary to Google’sOpens in a new Window own Googlebot. According to GoogleOpens in a new Window, the  tags that would apply specifically to Google’sOpens in a new Window Googlebot are the ones that have name="googlebot" in the meta tag.

There are many reasons not to have a Search Engine cache a page. If it is copyrighted, if it contains private information that you do not want displayed from a search engine, or for any other reason you do not want the page crawled by a search engine, you can add the following code to the meta tags of a page and it will keep the page from being indexed:

<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">

If you would like specifically to keep Google Opens in a new Window from indexing the page, but allow other Search Engines to index it, you can place the following meta tags in your headers of the page:

<META NAME="GOOGLEBOT" CONTENT="NOINDEX, NOFOLLOW">

On the other hand, if you would like the robots to index the file, but not follow the links on the page, you can use this code.

<META NAME="ROBOTS" CONTENT="NOFOLLOW">

When the Search Engines spiders, bots or robots crawl and index a page, they take a snapshot of a page. This is called a cached copy or a cache of the page. If for some reason, the site is unavailable when you visit it, a Search Engine can show the cached copy of the page. Or, if the cached copy of the page has a different version, then for various reasons, someone might want to use this cached version. It will be what the page looked like at the time of the crawl. So, if a robot crawled the site at 12:00pm on Saturday, and Monday more articles were added and changed on the page that was cached, you could still view what the cached version of that page looked like if the last time the bot crawled it was before it was changed on Monday. If you do not want Search Engines to cache a copy of this page or retain an older version of the page, you can add the following meta tags to the header of the page:

<META NAME="ROBOTS" CONTENT="NOARCHIVE">

If it is specifically Google’s Opens in a new Window Search Engine that you do not want to have a copy of that page, but you want the other Search Engines to have a copy, then you would use this meta tag in the headers:

<META NAME="GOOGLEBOT" CONTENT="NOARCHIVE">

Using the above meta tag for Google Opens in a new Window will result only in the cached copy not being stored. Google’s Googlebot will still continue to index the page with what is known as a snippet for that link on the Search Engine. A snippet is a preview of the webpage that is indexed. This is the preview that appears below the title of the page when you search on Google Opens in a new Window. If you set it to use no snippet, it will display what is in the Description Meta tag of the page instead of a snippet.
.
Note: The snippet will also remove the cached page:

Aleeya dotNet Opens in a new Window
Daily life information for the family and people of all ages. Household Tips,
DVDs, Books, Reviews, Search Engine Optimization, News, Amateur Radio and more …
www.aleeya.net/ - 34k - Oct 13, 2005 - Similar pages Opens in a new Window

Without a snippet using the Description Meta tag:

Aleeya dotNet 
Daily life information for the family and people of all ages. Household Tips,
DVDs, Books, Reviews, Search Engine Optimization, News, Amateur Radio and more …
www.aleeya.net/ - 34k - Oct 12, 2005 - Cached  - Similar pages

Below is a result for a search for Aleeya (in Google) and an example of what the results look like when it is not using a snippet or a Description Meta tag.

Aleeya.net: October 2005
… and kept the non technical site as http://www.aleeya.net . But, from previous,
Aleeya.net only had a 4/10 on Google’s page rank when I used PHPnuke. …
aleeya-net.blogspot.com/ 2005_10_01_aleeya-net_archive.html - 21k - Cached - Similar pages 
[ More results from aleeya-net.blogspot.com ]

So, to set it so the GoogleOpens in a new Window Bots will index a page, but not use a snippet - but use the Description Meta Tag, use the code below:
This will remove the cache of the page:

<META NAME="GOOGLEBOT" CONTENT="NOSNIPPET">

There are many other meta tags available to use for HTML. The ones above are just a sample and also demonstrate the ones that are proprietary to GoogleOpens in a new Window.

End of Article

For further reading:
Opens in a new WindowGoogle Information for Webmasters
Opens in a new WindowThe Robots META tag
Opens in a new WindowW3C Recommendations - Meta Data

Top of the Page Top of the Page


Related Articles on Aleeya.net:

Recent Entries:


Submit: Shout this!
Search: Cosmos | BlogPulse
Bookmark: Del.icio.us | Furl It | Spurl | Tag!RawSugar | Simpy This! | Shadows Tag! | Blink It | My Web
Aleeya dotNet Tags: , , ,
Technorati Tags: , , ,
Filed under: SEO .



You can follow any responses to this entry through the RSS 2.0 feed. You can leave a response, or trackback from your own site.

This entry was posted on Monday, October 17th, 2005 at 6:44 am

You can also choose to read SEO Category, which is the previous entry, or Titles, Description, and Keywords, the next entry.


Top of the Page Top of the Page



Leave a Reply

XHTML: You can use these tags: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <code> <em> <i> <strike> <strong>

Top of the Page Top of the Page


About the Geekette

I am a Computer and Network Technician. I love what I do for a living, as my work is also my hobby.

All of the technical information from the original Aleeya.net site became this site - GirlGeekette dotNet - and the remaining became what is now known as Aleeya dotNet. This site is where I store all of my notes related to computers and Technology so I may share it with others.

  Google


Web This site

Feeds

Validations

Ratings

Computer Links

Blog Links

Security Links

Geek Links

You Are Here

You are currently browsing an entry titled Googlebot Meta Tags from the Girl Geekette dotNet weblog archives.

Archives

Recent Comments:

Powered by WordPress with a modified version of Ragiels Dream theme.

62 queries complete in 0.294 seconds.