The new whitehouse.gov web site embodies the openness and accessibility of Obama’s administration. There’s now an official white house blog, displayed prominently on the home page. The blog doesn’t allow comments, but that’s understandable, since it would be a huge target for comment spammers and would require constant monitoring.
In addition to the blog RSS feed, there are also RSS feeds for agenda articles, press office, photo gallery, and videos.
Unlike the old site, the new white house site is now open to search engines. Codeulate analyzes the robots.txt file. The current robots.txt consists of two lines, allowing search engines to visit the entire site, except the include directory containing the CSS & javascript code:
User-agent: * Disallow: /includes/
The Bush-era robots.txt was over 2300 lines long, blocking search engines from almost all of the site.