60 Day Sandbox for Google & AskJeeves. MSN Quickest, Yahoo Next

Written by Mike Banks Valentine

Copyright July 18, 2005 Mike Banks Valentine

Search engine listing delays have come to be calledrepparttar Google Sandbox effect are actually true in practice at each of four top tier search engines in one form or another. MSN, it seems hasrepparttar 150099 shortest indexing delay at 30 days. This article isrepparttar 150100 second in a series followingrepparttar 150101 spiders through a brand new web site beginning on May 11, 2005 whenrepparttar 150102 site was first made live on that day under a newly purchased domain name. First Case Study Article

Previously we looked atrepparttar 150103 first 35 days and detailedrepparttar 150104 crawling behavior of Googlebot, Teoma, MSNbot and Slurp as they traversedrepparttar 150105 pages of this new site. We discoveredrepparttar 150106 each robot spider displays distinctly different behavior in crawling frequency and similarly differing indexing patterns.

For reference, there are about 15 to 20 new pages added torepparttar 150107 site daily, which are each linked fromrepparttar 150108 home page for a day. Site structure is non-traditional with no categories and a linking structure tied to author pages listing their articles as well as a "related articles" index varied by linking to relevant pages containing similar content.

So let's review where we are with each spider crawling and look at pages crawled and compare pages indexed by engine.

The AskJeeves spider, Teoma has crawled most ofrepparttar 150109 pages onrepparttar 150110 site, yet indexes no pages 60 days later at this writing. This is clearly a site aging delay that's modeled on Google's Sandbox behavior. Althoughrepparttar 150111 Teoma spider from Ask.com has crawled more pages on this site than any other engine over a 60 day period and appears to be tired of crawling as they've not returned since July 13 - their first break in 60 days.

Inrepparttar 150112 first two days, Googlebot gobbled up 250 pages and didn't return until 60 days later, but has not indexed even a single page in 60 days since they made that initial crawl. But Googlebot is showing a renewed interest in crawlingrepparttar 150113 site since this crawling case study article was published on several high traffic sites. Now Googlebot is looking at a few pages each day. So far no more than about 20 pages at a decidedly lackluster pace, a true "Crawl" that will keep it occupied for years if continued that slowly.

MSNbot crawled timidly forrepparttar 150114 first 45 days, looking over 30 to 50 pages daily, but not until they found a robots.txt file, which we'd neglected to post torepparttar 150115 site for a week and then bobbledrepparttar 150116 ball as we changed site structure, then failed to implement robots.txt in new subdomains until day 25 - and THEN MSNbot didn't return until day 30. If little else were discovered about initial crawls and indexing, we have seen that MSNbot relies heavily on that robots.txt file and proper implementation of that file will speed crawling.

MSNbot is now crawling with enthusiasm at anywhere between 200 to 800 pages daily. As a matter of fact, we had to use a "crawl-delay" command inrepparttar 150117 robots.txt file after MSNbot began hitting 6 pages per second last week. The MSN index now shows 4905 pages 60 days into this experiment. Cached pages change weekly. MSNbot has apparently found that it likes how we changedrepparttar 150118 page structure to include a new feature which links to questions from several other article pages.

5 hot tips to boost your website traffic using free tools

Written by Chris K.

The net is a truly remarkable place because there are so many ways of skinning a cat. The cat we are talking about here is traffic. Simply put,repparttar higherrepparttar 150098 traffic,repparttar 150099 more successfulrepparttar 150100 site.

Despiterepparttar 150101 fact that everybody strives for traffic, many webmasters pay out lots of cash only to end up with mediocre results. And yetrepparttar 150102 net provides free tools, some of them little known, most of them ignored. These tools can help improverepparttar 150103 volume of traffic headed to your blog or website.

Here is how you can use free tools to increase traffic.

a) Analyze your current traffic

The best place to start is by accessing free available research on your site. If you have not been tracking your visitor install one ofrepparttar 150104 many free traffic counters available online that also have tracking capabilities and collect data for a week or so.

This will give you lots of valuable information including where most of your traffic comes from, which arerepparttar 150105 most popular pages and so on.

b) Where do your clients congregate?

This information will answer a very important and crucial question. Where do your clients usually congregate onrepparttar 150106 net? Which sites do they frequentrepparttar 150107 most?

This information is worth its’ weight in gold as we shall see later in this article.

c) Launch a blog

Blogs tend to enjoy much higher traffic in general than websites do. One ofrepparttar 150108 reasons is their informal nature. By knowing where your clients congregate, you will know exactly what interests themrepparttar 150109 most and therefore how to attract them.

Blogs are simple to manage and maintain and what’s more you can set them up for free using any ofrepparttar 150110 many free blog hosting services. They can be extremely effective in directing traffic to your website

d) Write and post articles

Cont'd on page 2 ==>
ImproveHomeLife.com © 2005
Terms of Use