The Beta News

Bush’s Robots.txt Vs. Obama’s Robots.txt

If you run a blog or a website you probably know what a robots.txt file is, so you can skip the next line. It’s a small text file that tells search engine what to include and not to include in their indexing of your site. As you might have noticed or read www.whitehouse.gov has been given [...]

Continue reading...