Inside of Webmaster Tools, the Google Robots.txt Generator has been unveiled. The Robots.txt Generator will help webmasters travail the often misunderstood method of allowing or disallowing search engine robots from crawling files, folders and pages on a website. Inside of the tool, webmasters are offered the Action of allowing or blocking plus another pull-down menu [...]

Filed under: Google | 1 Comment »