«
»

The White House’s robots.txt

Take a look at it.

“Crawlers? We don’t want no stinking crawlers around here!” :)

(seen on BlogSEO)

No related posts.

This entry was posted on Tuesday, December 13th, 2005 at 16:21 and is filed under Fun stuff, Search engines, World Wide Web. You can follow any responses to this entry through the RSS 2.0 feed. You can leave a response, or trackback from your own site.

One Response to “The White House’s robots.txt”

  1. Gothic says:
    December 13, 2005 at 18:06

    Devias começar a ver primeiro os de cá… http://www.sapo.pt/robots.txt

    Não está standard.. já enviei para lá um e-mail há dias. =)

    É “User-agent” e não “User-Agent”.. hehe

    Reply

Leave a Reply

Notify me of followup comments via e-mail. You can also subscribe without commenting.

Creative Commons Attribution-NonCommercial-NoDerivs 2.5 Portugal
This work by Pedro Timóteo is licensed under a Creative Commons Attribution-NonCommercial-NoDerivs 2.5 Portugal.