Ok! You've sketched a layout for your web page, learned some basic html, coded your web page, found your host with most (couldn't resist), and registered your URL (www.YourSite.com). Now it's time to upload (transfer) your file (web page ) to your host. To do this you need a FTP program. FTP stands for File Transfer Protocol. When using this application, there are usually two windows. The left window shows your computer files, and right window shows files stored on your host. For a good tutorial and to download a freeware FTP program, FTP Commander, go to http://www.nexcess.net/hosting/support/tutorials/ftp/ftpcommindex.php.

Now you should be up and running. But don't stop there. Continue to teak, add pages, learn to link to other pages and sites, and frequently add new content. Who knows, you could eventually learn to profit from your creation.

Here are some examples of a robots.txt file for redball.com

User-agent: * Disallow:

The above would let all spiders index all content.

Here another example

User-agent: * Disallow: /cgi-bin/

The above would block all spiders from indexing cgi-bin directory.

User-agent: googlebot Disallow:

User-agent: * Disallow: /admin.php Disallow: /cgi-bin/ Disallow: /admin/ Disallow: /stats/

In above example googlebot can index everything while all other spiders can not index admin.php, cgi-bin, admin, and stats directory. Notice that you can block single files like admin.php.