Comments on: What is robots.txt file? http://www.drostdesigns.com/what-is-robotstxt-file/ Web Site Design, Hosting and Marketing Tips and Tricks Thu, 28 Aug 2008 11:51:08 +0000 http://wordpress.org/?v=2.5.1 By: Robots Meta Tag - How to Create and Top 7 Benefits-- Web Design Discussion http://www.drostdesigns.com/what-is-robotstxt-file/#comment-91121 Robots Meta Tag - How to Create and Top 7 Benefits-- Web Design Discussion Wed, 14 Nov 2007 15:22:08 +0000 http://www.drostdesigns.com/what-is-robotstxt-file/#comment-91121 [...] C. Rather than use the meta robots tag to not index a web page use the robots.txt file to block crawler access to pages. What is robots.txt file? [...] [...] C. Rather than use the meta robots tag to not index a web page use the robots.txt file to block crawler access to pages. What is robots.txt file? [...]

]]> By: Robots.txt file - Common formatting Mistakes to Avoid-- Web Design Discussion http://www.drostdesigns.com/what-is-robotstxt-file/#comment-33885 Robots.txt file - Common formatting Mistakes to Avoid-- Web Design Discussion Mon, 07 May 2007 12:32:58 +0000 http://www.drostdesigns.com/what-is-robotstxt-file/#comment-33885 [...] What is robots.txt file? [...] [...] What is robots.txt file? [...]

]]> By: How do you create a robots.txt file?-- Web Design Discussion http://www.drostdesigns.com/what-is-robotstxt-file/#comment-33314 How do you create a robots.txt file?-- Web Design Discussion Fri, 04 May 2007 12:35:34 +0000 http://www.drostdesigns.com/what-is-robotstxt-file/#comment-33314 [...] Please read What is a robots.txt file? [...] [...] Please read What is a robots.txt file? [...]

]]>