#Site map file for the kc site Sitemap: http://support.citrix.com/sitemapindex.xml #Allowed bots to crawl our site User-agent: GoogleBot Allow: /proddocs/sitemap*xml$ Disallow: /proddocs/*xml$ Disallow: /search/* User-agent: msnbot Allow: /proddocs/sitemap*xml$ Disallow: /proddocs/*xml$ Disallow: /search/* User-agent: Slurp Allow: /proddocs/sitemap*xml$ Disallow: /proddocs/*xml$ Disallow: /search/* User-agent: gsa-crawler Allow: /proddocs/sitemap*xml$ Disallow: /proddocs/*xml$ Disallow: /search/* #Disallow any other bots from crawling User-agent: * Disallow: /