Google, Wherefore Art Thou Google? Sites Abandoned by Googlebot!

Written by Mike Banks Valentine

Continued from page 1

The solution to this dynamic URL problem has been discussed widely in search engine forums and solutions have been bandied about including software provided by SEO's, URL re-write techniques for dynamic pages on APACHE servers and PHP pages to generate search engine friendly URL's. Others recommend simply adding static HTML sitemap pages as alternatives forrepparttar search engine spiders.

In this instancerepparttar 127893 client's developer simply said "I can't do that (PHP solution) on this server". So we resorted to putting uprepparttar 127894 static HTML sitemap pages with hard-coded URLS torepparttar 127895 main 54 pages ofrepparttar 127896 site at This should get at least those fifty pages crawled by Googlebot, but Googles' spider appears not to be crawling this site at all.

How do we know this? See for yourself by usingrepparttar 127897 following query inrepparttar 127898 search box at Google: whererepparttar 127899 result page shows ONE page inrepparttar 127900 results. If you try that query on your own site (replace your own domain name for, you'll seerepparttar 127901 results lists ALL your pages.

The site home page was crawled by Google four months ago, when they took their "Cached Snapshot" ofrepparttar 127902 page. You can see this by visitingrepparttar 127903 Google cached page here: TF-8& whererepparttar 127904 date of this snapshot is "Apr 20, 2004 07:42:19 GMT" and they haven't been back since. The page in that snapshot has none ofrepparttar 127905 newly added links, an outdated title tag, and old content.

This problem is not unique to this site. One client we worked with two years ago had a dynamically generated, framed site! Those two site structures have always given search engines trouble. Their site was not crawled at all and onlyrepparttar 127906 front page showed up. Our solution was to create a second domain (owned byrepparttar 127907 client), which had static HTML pages that precisely mirroredrepparttar 127908 content ofrepparttar 127909 client's framed, dynamically generated site. Guess what happened after Googlebot crawledrepparttar 127910 static site? Google indexedrepparttar 127911 framed site in full and then bannedrepparttar 127912 static site fromrepparttar 127913 index!

Not an approach we advocate, butrepparttar 127914 one that worked for this client.

We're still searching for ways to get Googlebot back to before creating that new static site, but decided to share this odd experience withrepparttar 127915 SEO community before going to any extremes. Google provides over 70% of most search engine referred traffic to ALL of our clients and we realized we can't site idly by and see a major client languish because Googlebot didn't like what it found atrepparttar 127916 client site onrepparttar 127917 first visit four months ago.

This issue dogs newer sites in other places as well. The Open Directory Project has also become notoriously slow in adding new sites torepparttar 127918 directory and in this case, has not picked up this site even after 6 regular monthly submissions. The web playing field may have begun tilting toward older, established sites and away from new ones.

------------------------------------------------------------ Mike Banks Valentine is the SEO for Contact him at Improve Your Small Business Online at our Ecommerce Tutorial ------------------------------------------------------------

Personalized Search Versus Personal Choice

Written by Kevin Kantola

Continued from page 1


Google has a beta personalized search engine at: that is pretty interesting to test. You're told to click on Health, thenrepparttar General Health checkbox and search for "stanford." When searching forrepparttar 127892 word "bob" instead of "stanford" at repparttar 127893 Minimum Personalize settingrepparttar 127894 first three results are "Bobrepparttar 127895 Builder," "Bob Marley" and "Bob Dylan". The rest of this page has no health related information on it as well. But, whenrepparttar 127896 slider is pulled to Maximum Personalize, "Dr. Bob" hasrepparttar 127897 first two positions followedrepparttar 127898 other results mentioned above. Its obvious Google has a ways to go in developing this.

Personal Privacy

If personalized search is to succeed, then personal privacy issues need to be addressed and concerns held to a minimum. Will personalized search involve searching your hard drive to see what your interests are? Will your interests be stored in a cookie on your computer? What happens when multiple users share a computer - will someone else get hit with all sorts of Preparation H advertisements because of repparttar 127899 hemorrhoid treatment searches you wanted to keep private? And will children be affected by adult personalized searches?

These are all questions thatrepparttar 127900 SE's need to address so that people do not feel that their privacy is being violated or put at risk. The more control and choicerepparttar 127901 user has over personalized searchrepparttar 127902 more likely it has in succeeding forrepparttar 127903 search engines.

Copyright 2004 SEO Resource

Kevin Kantola is the CEO of SEO Resource, a California search engine optimization company, and has published many articles over the past 20 years.

    <Back to Page 1 © 2005
Terms of Use