Sitemap: http://www.funtouristattractions.com/sitemap.xml.gz User-agent: * Disallow: /b/submit/* Disallow: /u/new-review/* Disallow: /u/new-discussion/* Disallow: /u/reply-post/* Disallow: /s/privacy-policy Disallow: /s/contact-us Disallow: /u/login Disallow: /u/sign-up-new-user Disallow: /blog/wp-admin Disallow: /blog/wp-includes Disallow: /blog/wp-content/plugins Disallow: /blog/wp-content/cache Disallow: /blog/wp-content/themes Disallow: /blog/trackback Disallow: /blog/comments Disallow: /blog/category/* Disallow: /blog/tag/* Disallow: /blog/*/trackback Disallow: /blog/*/feed Disallow: /blog/*/comments Allow: /blog/wp-content/uploads User-agent: ia_archiver Disallow: / # See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file # # To ban all spiders from the entire site uncomment the next two lines: # User-Agent: * # Disallow: /