The White House’s robots.txt

Published
by
Pedro Timóteo
2 years, 11 months ago
in Fun stuff, Search engines and World Wide Web
.

Take a look at it.

“Crawlers? We don’t want no stinking crawlers around here!” :)

(seen on BlogSEO)

Related posts:

  1. Blogging tips #4: Making your blog search engine-friendly
  2. Blogging tips #5: Adding your blog to search engines and directories
  3. Rojo FeedShare
  4. A portable GameCube?
  5. AWStats fix for Portuguese search engines

1 Response to “The White House’s robots.txt”

Feed for this Entry Trackback Address
  1. 1 Gothic
    2 years, 11 months ago.

    Devias começar a ver primeiro os de cá… http://www.sapo.pt/robots.txt

    Não está standard.. já enviei para lá um e-mail há dias. =)

    É “User-agent” e não “User-Agent”.. hehe

Leave a Reply

Creative Commons Attribution-NonCommercial-NoDerivs 2.5 Portugal
Creative Commons Attribution-NonCommercial-NoDerivs 2.5 Portugal