Utterly Boring dot com

What does the White House have to hide?

Apparently a lot, according to their robots.txt file, which basically blocks the search engines from indexing everything. Why didn't they just set a wild card on everything, for cripes sakes? Why are they doing this? More than likely so that Google won't pick it up in its cache so we can't hold it against the government later for something they posted. Link via Waxy.

Posted by Jake on 10/27/03 @ 04:51 PM
Posted in Weird | Permalink

1 Trackback

Hiding Behind Robots.txt from Wasabi Wisdom on 10/27/03 @ 10:38 PM:
Jake recently noted that the robots.txt file of the White House website prevents indexing of most of the website. Mark has a bit more detail, including some historical background. For example, on April 15, 2003, the robots.txt file has 10... (Read More)

What are you doing down here? Don't you have something better to do? Like Go Back To The Top of the page, or even see who created this site? This site is © 2001 - 2018 by the Utterly Boring folks at UtterlyBoring.com. Steal my content, as I probably did, too, just link to my site or the original site. Batteries not included. One size fits all. Not for off-road use. Not for internal use. Do not taunt Happy Fun Ball.