Project / Support Center
Welcome, Guest. Please login or register. May 30, 2023, 09:36: PM
Home Help Search Login Register
D-Web Web Site Creator D - Web Web Site Creator On-line HTML Editor No Programming knowledge required. Web Global Net PayPal-Cart Shopping Cart System PayPal - Kart Shopping Cart System for E-Commerce over the internet, that's easy to use. Web Global Net Newsletter Manager Newsletter Manager On-line Newsletter Creator with Email Subscriber Management.
Ring Central Discount
Web Global Net Web Application & Web Development Project Center  |  Business Topics  |  SEO - Search Engine Optimization  |  Topic: Controling Serach Engine Robots further 0 Members and 1 Guest are viewing this topic. « previous next »
Pages: [1] Go Down Send this topic Print
Author Topic: Controling Serach Engine Robots further  (Read 11634 times)
admin
Guest
« on: December 20, 2006, 12:38: PM »

You can actually tell a serach engine robot where not to go on your site and which search engine robots are not allowed.

Attached is an example of the robots.txt file that you need to place in the top level of your domain server. This one basically tells Google image not to index your site and also tells a few other image related search engines not to as well.

Also in the file are a list of directories you do not what index either.

Just change the Disallowed directories to your own.


* robots.txt (0.53 KB - downloaded 1646 times.)
Report to moderator   Logged
Pages: [1] Go Up Send this topic Print 
Web Global Net Web Application & Web Development Project Center  |  Business Topics  |  SEO - Search Engine Optimization  |  Topic: Controling Serach Engine Robots further « previous next »
Jump to:  


Login with username, password and session length
Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2013, Simple Machines Valid XHTML 1.0! Valid CSS!