Continued from page 1
Another company, Germany based brainbot technologies AG offers search engine technology for portals: < http://brainbot.com/ >
Brainbot robots are also spidering international domains: #UA gigabaz/3.14 (email@example.com; http://gigabaz.com/gigabaz/) mail.brainbot.com 184.108.40.206 #UA gigaBazV11.3 bazbrainbot.com; http://brainbot.com/gigabaz/ 220.127.116.11
One licensee making use of their cached results is geekbot: < http://www.geekbot.org > On their result pages you will find a "scan" function - this will display cached pages, albeit in a different format.
French search engine AntiSearch offers display of cached web pages, too: < http://www.antisearch.net/ >
AntiSearch operates following spiders: #UA antibot-V1.1/i586-linux-2.2 18.104.22.168 #UA antibot-V1.1/i586-linux-2.2 22.214.171.124 #UA antibot-V1.1/i586-linux-2.2 126.96.36.199 #UA antibot-V1.1/i586-linux-2.2 188.8.131.52 #UA antibot-V1.1/i586-linux-2.2 184.108.40.206
Finally, let's not forget German search engine Speedfind: < http://www.speedfind.de > Speedfind, too, offers display of cached pages.
Due to peculiar legal situation in Germany, which makes webmaster fully liable for links to third party pages unless they post an explicit disclaimer prominently on their site, Speedfind refuses all liability for pages thus displayed:
"SPEEDFIND DOCUMENT FROM CACHE VIEWER SPEEDFIND is in no way liable for content displayed below. All rights belong to respective page's author. We are only displaying a copy of said page." (Translated from German)
So while they do acknowledge authors' full rights, same authors' permission for display of copyrighted content is never requested - there is no indication in their terms of submission how to prevent page caching.
Speedfind operates following spiders:
#UA visual ramBot xtreme 7.0 proxy-gate.oberland.net 220.127.116.11 #UA speedfind ramBot xtreme 8.1 new.speedfind.de 18.104.22.168 #UA speedfind ramBot xtreme 8.1 eins.speedfind.de 22.214.171.124 #UA visual ramBot xtreme 7.0 c2.oberland.net 126.96.36.199 #UA visual ramBot xtreme 7.0 io.oberland.net 188.8.131.52
Rather than bother with minor players like Speedfind, AntiSearch and brainbot by excluding them from your submission process, you may want to consider blocking their spiders from access to your web site altogether (lest your competitors should submit your site behind your back!).
In this case, we would recommend using our fantomas multiBlocker(TM) for a professional blocker solution: < http://fantomaster.com/famultiblocker0.html >
Ralph Tegtmeier and Dirk Brockhausen are the co-founders and principals of fantomaster.com Ltd. (UK) and fantomaster.com GmbH (Belgium), < http://fantomaster.com/ > a company specializing in webmasters software development, industrial-strength cloaking and search engine positioning services. You can contact them at mailto:firstname.lastname@example.org