Sitemap: http://www.100-beautiful-sites-in-the-world.com/2pVXg4Sa.xml User-agent: Googlebot Disallow: /dyn/ Disallow: /objects/ Crawl-delay: 30 User-agent: bingbot Disallow: /cgi-bin/ Disallow: /bin/ Disallow: /dyn/ Disallow: /objects/ Crawl-delay: 30 User-agent: msnbot Disallow: /cgi-bin/ Disallow: /bin/ Disallow: /dyn/ Disallow: /objects/ Crawl-delay: 30 User-agent: Slurp Disallow: /cgi-bin/ Disallow: /bin/ Disallow: /dyn/ Disallow: /objects/ Crawl-delay: 30 User-agent: * Disallow: /cgi-bin/ Disallow: /bin/ Disallow: /dyn/ Disallow: /objects/