Web Global Net Web Application & Web Development Project Center

Business Topics => SEO - Search Engine Optimization => Topic started by: admin on December 20, 2006, 12:38: PM

Title: Controling Serach Engine Robots further
Post by: admin on December 20, 2006, 12:38: PM
You can actually tell a serach engine robot where not to go on your site and which search engine robots are not allowed.

Attached is an example of the robots.txt file that you need to place in the top level of your domain server. This one basically tells Google image not to index your site and also tells a few other image related search engines not to as well.

Also in the file are a list of directories you do not what index either.

Just change the Disallowed directories to your own.