Sunday, May 1, 2011

robots.txt


User-agent: *
Allow: /feeds/posts/default
Allow: /
Disallow: /robots.txt

User-agent: Mediapartners-Google
Allow: /
Allow: /feeds/posts/default
Disallow: /robots.txt

User-agent: msnbot
Allow: /
Allow: /feeds/posts/default
Disallow: /robots.txt