• Enter your email address to subscribe to this blog and receive notifications of new posts by email.

    Join 837 other followers

  • Karen Kallets Twitter

  • Recent Posts

  • Top Clicks

    • None
  • Pages

  • Top Posts

  • Categories

  • Recent Comments

    Shana on How can you get your blog inde…
    Quentin on Blogging Mistakes for Beg…
    Adell on What other blogs are saying ab…
    Jackie on Ping-O-Matic is your one stop…
    Hermine on What other blogs are saying ab…
    Ans on Tools for creating business we…
    Harris Ferencz on 2010 Marketing Plans: Facebook…
    Kevin Moreland on How can you get your blog inde…
    Twitter on Retweeting your own tweet…
    spam filtering on How can you get your blog inde…
    tweet on Retweeting your own tweet…
    Rich on 5 Best Printer Friendly WordPr…
    rtyecript on How can you get your blog inde…
    cp cheats on How can you get your blog inde…
    cp cheats on Ping-O-Matic is your one stop…
  • Archives

Google Bots- what types and what they search

Bots are what a search engine sends to search your website to rank it and is the key to how you rank and when you rank.  Ask your webmaster, they should be able to tell you when the bots last hit your website and how often to see the pattern.  You may have heard the term spiders that crawl the web, those are Bots.

Now why is that important?  If you are going to do a big launch and the bot(s) have  just come through, you may be a few weeks, to a few months before your changes are going to get noticed. Thus delaying any results of your efforts.  Also knowing  there are different types of bots looking for different things is also important and will keep a CMO up to date on this subject and up at night. 

 Quick Online Tips blog again has done a great job of defining that there are actually 5 different bots going through your website.   A bot is just not a generic bot,  you need to be sure that you site is ready to accept all 5 types of bots, which are:  Deep Bot, Fresh Bot, Media Bot, Image Bot and Ad Bot.

 “Different Types of Google Bots And How They Work
Posted: 05 Feb 2010 06:54 AM PST
Guest article by Indu.

Do you know how many types of Google bots there are? Google indexes millions of pages each and every day. These pages are crawled by a special Google algorithm called Google Bot, before each and every page in its database is indexed. In fact, Google uses a number of spiders to crawl the web. This article reveals the most important Google spiders and their functionality.Google Bots Types

 1. Google Bot: This is the bot used by Google to scour the web to identify new pages. It has two different versions. Deep bot and Fresh bot. As the name suggests, Deep bot tries to follow every link and downloads as many pages as possible. It tries to read minute details of a site including the internal structure.

Fresh bot crawls the web in search of fresh content. The Fresh bot crawls the already indexed pages in search of newly updated content. This way Google tries to give fresh and updated information in the search results. Hence it is important to have quality inbound links if you’d like Fresh bot crawling your site more and more often.
2. Media Bot: If you are wondering how Google places different relevant ads in your different pages, here is the answer. Media bot analyzes AdSense pages and decides which ads to be placed on different pages.
So if you want to allow Media bot to access your entire site put this code in robot.txt file.
User-agent: Mediapartners-Google*
Remember that ads will still be shown in your pages even if Media bot has not visited your site yet. In such a case, ads will be chosen based on the overall theme of your site.

 
3. Image Bot: Image bot is used to crawl the images and place them in Google’s image search. Images are ranked based on their file name, alt text, surrounding text and page title.  If your website is primarily image based, then you’d definitely want to tweak and optimize your images to receive extra traffic from Google image search results.
However, all the Google traffic may not convert into buyers as many people are just looking for images. So if you want to block Image Bot from accessing your images and save bandwidth, you can do it in your robot.txt file.
4. Ads Bot: It crawls and analyzes the advertising landing pages and determines the quality score that will be assigned to your ads. Along with this score, Google uses your bid amount to determine the position of your ads. Hence it is important to have quality content on the landing page of your advertisement. Sometimes Google positions high quality ads first even when others are willing to pay more. It is advised to give AdsBot complete access to your site.

By now you must have understood that it is important to give complete access to Google if you want to increase your search engine visibility. One way is to create a sitemap for your site. A sitemap tells Google about your most important, new and updated pages. Google inturn tells you the pages it was unable to crawl. This helps you pinpoint the problems and fix them as soon as possible with which you can gain increased traffic and exposure from search engine results.

 Google is ever-changing and Google spiders are becoming more advanced all the time. However, relevant, updated and quality content along with good inbound links make your site stand front in this every changing search engine world.”

Advertisements

One Response

  1. […]  Having a site map for your website it a key to getting searched by the various search engine bots that I have written about in a previous blog about the 5 kinds of  Search Bots.  Your webmaster […]

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: