In this lesson topic include

1. Robot.txt and other meta tags
2. Dynamic Page - and what to do about Flash
3. Submitting to Directories
4. Submitting to Search Engines
5. Learn about Paid inclusion and paid placement

First off. How can you control what the crawler "spider" reads when visiting a web site? Robot.txt This is a text file that is placed on the server and link in the HTML that tells the crawler how to read the content of the site.

More info on Robot.txt

1. Heres a new link about the Robot tag basic Robot info.

What about Flash and other web technologies.

Flash is a great way to add animation sound and video to your web site but can the search engines read content of a Flash file?

1. What Google recommends - http://www.google.com/support/webmasters/bin/answer.py?answer=35267&ctx=sibling
2. http://blog.searchenginewatch.com/blog/071116-103407 - look at number 9 of this list.
3. http://wiki.novemberborn.net/sifr/What+is+sIFR
4. http://www.mezzoblue.com/archives/2004/10/26/sifr/
5. http://www.adobe.com/accessibility/products/flash/text.html - Add text reading to Flash movie

What about dynamic Pages - Web site that use program to create the pages, Example, Javascript, PHP, ASP

1. http://www.google.com/support/webmasters/bin/answer.py?answer=34431 - Consider place HTML pages as well as dynamic pages.

What if I don't want to be in the search engine.

1. One example - http://www.robotstxt.org/faq/prevent.html
2. Another way - http://www.robotstxt.org/meta.html

Lesson 4 - Submitting to Directories

OK you did all the stuff on the first page of this lesson - Now Submit

Submitting to Directories

Submitting to directories is much different than submitting to Search Engines. Usually the directory will ask for a category, description, URL, and an email address. Search engines will usually just ask for the URL and email address.

How

• Pay - most directories charge money to look at your web site.
• Cannot see the optimization of your web site. Directories don't look at things like meta tags or linking.
• Can submit by hand. No software will help.

Wow does Google have a directory - http://directory.google.com/

Open Directory Project - This directory is free. This directory provides information about web sites to many search engines.

Lesson 4 - Submitting to Search Engines

Submitting to search engines is a lot easier than submitting to directories. Most search engines ask only for a URL and an e-mail address. There is software you can buy to do the submitting. Search engines consider your optimization techniques. Also, you may submit repeatedly to search engines.

Links to submitting to Search Engines

http://www.google.com/addurl - add to google

http://search.yahoo.com/info/submit.html - submitting to yahoo