Usman Farooq

Head of Digital Marketing | SEO Consultant

at the netizens meetup...

Facebook
RSS

how does a crawler or bot work?

Apr - 16 - 2011
SEO Specialist

This has been a question in peoples mind for years now, knowing that SEO can optimize website on search engines. How do these SEO (Search Engine Optimizers) manage to work with these crawlers?

A crawler can normally be explained as a request sender, or maybe a browser http request sender. The basic purpose of a crawler is to get the whole content of the page and report that information to the Data center where Google would determine its ranking through its own algorithm to see if the Data is worth and is relevant to the search term.

For e.g.: Please refer to the image attached below

How does a crawler or bot work?

How does a crawler or bot work?

Known that there is a lot more that happens during this process which I will explain in some of my upcoming post. I don’t need to tell anyone as an SEO who has the knowledge of his/her work would always know that what can and what will knowing such small details would do for his/her website.

5 Responses so far.

  1. Asad Anwer says:

    Bhai! You didn’t explained anything here.. Just wrote things with nothing explaining…

  2. Keisha says:

    A good many vluabales you’ve given me.

  3. link building service says:

    aloha http://www.usmanfarooq.com blogger discovered your blog via yahoo but it was hard to find and I see you could have more visitors because there are not so many comments yet. I have found website which offer to dramtically increase traffic to your website http://xrumerservice.org they claim they managed to get close to 1000 visitors/day using their services you could also get lot more targeted traffic from search engines as you have now. I used their services and got significantly more visitors to my website. Hope this helps :) They offer backlink checker free seo promotion backlinks 10000 backlinks Take care. John


You can now see mobile ad performance in Google Analytics.

Starting this week, some of you will see enhanced Analytics ...

Simplifying eCommerce reporting across international sites with multiple currencies

It’s quite common for organizations to have complex reporting requirements ...

Web Analytics TV #22 - The Automation episode

Welcome to another delightful episode of Web Analytics TV! Web ...

Grow your audience with Google+

Webmaster Level: All At Google, we help grow your audience ...

Email scheduler, PDF export, and a transition to the new Google Analytics interface

Two of the most requested features from the old version ...