What Are Search Engines?

A search engine is a database system designed to index and categorize internet addresses, otherwise known as URLs (for example, http://www.submittoday.com).

There are four basic types of search engines:

Automatic: These search engines are based on information that is collected, sorted and analyzed by software programs, commonly referred to as "robots", "spiders", or "crawlers". These spiders crawl through web pages collecting information which is then analyzed and categorized into an "index". When you conduct a search using one of these search engines, you are really searching index. The results of search will depend on contents of that index and its relevancy to your query.

Directories: A directory is a searchable subject guide of Web sites that have been reviewed and compiled by human editors. These editors decide which sites to list, and, in which categories.

Meta: Meta search engines use automated technology to gather information from a spider and then deliver a summary of that information as results of a search to end user.

Pay-per-click (PPC): A search engine that determines ranking according to dollar amount you pay for each click from that search engine to your site. Examples of PPC search engines are Overture.com and FindWhat.com. The highest ranking goes to highest bidder.

There are a few downfalls you should know about using PPCs:

1. The use of PPC search engines as part of your search engine optimization process will not improve your search engine positioning in regular editorial search results. Instead, they will most always appear in a "Sponsored" or "Featured" area located at top or side of regular search page results. Even though your paid listing will appear at top of search page, many users will not click on paid listings because they look at it as an advertisement. In past, people used to always click on banner ads, but now they are seen more of as a nuisance. Similarly, same thing is happening with PPC listings. Also, PPC listings are not always as relevant to a query as editorial search results.

In mid November of 2003, Google seriously revamped their ranking algorithm. As a result, many sites were dropped from their index, or fell dramatically in rank. This infuriated many Web site owners at height of holiday buying season.

Since that time, many accusations have been thrown at Google as to reasons why this happened. Some say it’s a plot to encourage people to buy Adwords listings. Others have even theorized WebPosition is somehow to blame. Still others cite more traditional causes.

As soon as Google changed their algorithm, many WebPosition Gold customers whose sites had dropped contacted me demanding an explanation. They wanted to make sure their sites were not dropped because they had used WebPosition Gold. I reassured them that this was not case. I went on to explain that many thousands of sites were dropped that don't even use WebPosition Gold.

Many of our customers even saw their rank increase. In addition, most of time site had not actually been banned from index. It had simply dropped in rank.

In this article, I will attempt to dispel many of pervasive myths regarding WebPosition Gold and Google. I’ve used WebPosition for years on my own site and for clients. I’ve also helped provide technical support to others using product. Therefore, I’ve been on both sides of fence, and thereby feel uniquely qualified to address most common questions that tend to come up:

1. Will running automated Reporter Missions on Google get my site banned?

No. Despite repeated rumors, when running a Reporter Mission, WebPosition Gold does not pass personal information, such as your name, address, email, Web site URL or domain name to Google. Instead, it conducts queries as a normal browser would, and then examines results offline. With that in mind, Google cannot determine if you're running a query relating to a specific domain. The only information that is passed to Google is your "IP" address. In most cases, your Web site's IP address is different than IP address of your ISP (Internet Service Provider). So, how can Google connect two? Simply put, it can't.

Google states on their FAQ page that they do not recommend automated queries to be run on their service because it utilizes server resources. Yet, most businesses find it impractical not to measure their search engine rankings at least occasionally. It’s also hardly reasonable to check ranking by hand in Internet Explorer, which for same keyword list, would yield same number of queries on Google anyway. Therefore, most businesses optimizing their Web sites find it impractical not to use some kind of automated tool to monitor their progress and to measure their visibility. Working as a search engine marketer myself for many years, I’ve found that best policy is to simply be sensitive to needs of search engines. Avoid being “abusive” in your practices, whether it is your optimization strategies, your submissions, or your rank management. Therefore, when using WebPosition, I often recommend following strategies: 1.Avoid excessive numbers of queries if you choose to check your rankings on Google. Most people do not have time to improve their rankings on hundreds of keywords. Therefore, there’s no need to rank check on hundreds of keywords if you don't have time to do anything about that many different rankings anyway. While your site won’t be banned from excessive queries, Google could block your IP address that you use to connect to Google, if it found your query volume to be excessive. This is true regardless of what tool you may use, even if it’s a browser.

It has been my experience that a blocked IP is extremely rare even among consultants conducting rank checks for dozens of clients. Presumably, Google would not want to accidentally block an IP that does a large volume of queries simply because its shared by many different users. Even so, it’s always a good idea to practice a little common sense. 2. If you choose to run queries, try to run most of your queries at night and during off-peak periods, which is something Google has suggested in past. This is when many of their servers are presumably standing idle, waiting to handle increased volume during peak periods. The WebPosition Scheduler makes this easy to do.

3. Do not run your queries more often than is really necessary. Since Google normally doesn't update their entire index more than once a month, there's limited benefit to checking your rankings more often than that.

4. As an alternative to Google, consider checking your Google rankings using Yahoo Web Matches or another Google “clone” engine in Reporter. Although these rankings can vary slightly from Google.com, they're normally close enough to give you a very good idea of your actual Google rankings without checking Google directly.

5. With WebPosition Gold 2, you can also use "Be courteous to search engines" feature on Options tab of Reporter so you don’t query their service so quickly. This gives you added peace of mind not found in many other automated tools, assuming you don't mind your missions taking longer to run. The Submitter has a similar feature to submit randomly at various time intervals.

2. Can I use WebPosition Gold to get my competitors' banned from Google? No. If running automated queries on Google with WebPosition Gold would result in your site being banned, you could use it to get your competitors' banned from Google. However this is not case.

Google even verifies this on their web site. They don't specifically name WebPosition Gold in this section; however, they do mention that there is nothing you can do to get your competitors' banned from Google. For more information on this, please see "Google Facts and Fiction" document at Google's site. http://www.google.com/webmasters/facts.html

3. Will over submitting my site get me banned?