Robots.txt 1.1

Robots.txt - editor of standard search engine spider management files. A program to control how spider search agents browse your website and add information about it to search engine databases. This program has everything you need to manage and monitor the visits of search engine spiders indexing your website. Unlike other products, this program contains a standardized file editor for spider control Robots.txt .
Using the programRobots.txt you can:

• Visually generate standard files robots.txt ,
• Identify unwanted robots and prohibit them from accessing your site,
• Direct search robots to the corresponding pages of multilingual sites,
• Use filesRobots.txt to manage doorway pages,
• Prevent robots from entering the system areas of your site,
• Upload a properly formatted file robots.txt directly to your FTP server directly from the editorRobots.txt ,
• Track robot visits,
• Create reports on robot visits in HTML, Microsoft Excel CSV and XML formats.