UGO Robots.txt Generator

UGO Design hits the target every time.
Where a business web presence is needed a professional web design services that concentrates on your business needs.

Robots.txt Generator

Robot text file is as it says a text file on your server that the search engines robots look for to index your pages. Another hidden server file is the sitemap.xml this file search engines like as it tells them which pages need indexing and how often.
Add directories/files you DO NOT want indexed

1: folderName Three Examples:
1: folderName/myPage.html
2: folderName/
3:myPage.html/myPage.html

Example .html

Heres a example of the code

Please VOTE for this page at:
ADD TO DEL.ICIO.US

INSTRUCTIONS
(please read carefully)

:
1. Select a user agent (robot) in the left column. The default is "ALL User Agents", then click on the "ADD USER AGENT" button.

2. Type in directories and/or web pages that you do not want indexed, then click on the "ADD" button. Make sure there is a forward "slash" in-between directories and pages, and at the end of directories (indicated in RED).

Repeat this step until you have added all of the files you want under the "User Agent". If you don't want a user agent to index ANY of your site, LEAVE THE TEXTFIELD BLANK and click on the "ADD" button. A "/" will appear after "Disallow:" in the code below.

3. Once step 2 is complete, you may repeat steps 1 & 2 again until you have added all of the "User Agents" you want, and files under each that you want to "Disallow".

4. When complete, click on "COPY CODE" to save the robots.txt code.