The White House’s robots.txt

Take a look at it.

“Crawlers? We don’t want no stinking crawlers around here!” :)

(seen on BlogSEO)

No related posts.

One Response to “The White House’s robots.txt”

  1. Gothic says:

    Devias começar a ver primeiro os de cá… http://www.sapo.pt/robots.txt

    Não está standard.. já enviei para lá um e-mail há dias. =)

    É “User-agent” e não “User-Agent”.. hehe

Leave a Reply

Notify me of followup comments via e-mail. You can also subscribe without commenting.


Creative Commons Attribution-NonCommercial-NoDerivs 2.5 Portugal
This work by Pedro Timóteo is licensed under a Creative Commons Attribution-NonCommercial-NoDerivs 2.5 Portugal.