User-agent: * Disallow: Crawl-delay: 20 Disallow: /handlers/ Sitemap: http://www.interflora.co.nz/gsm-thrive.cfm Sitemap: http://www.interflora.co.nz/interflora-sitemap.cfm # NOTE: Technically this is invalid Sitemap syntax (it should be an absolute # URL), but it is recognised by some crawlers so should do more good # than harm. Sitemap: /sitemap-index.cfm # NOTE: Technically this is invalid Sitemap syntax (it should be an absolute # URL), but it is recognised by some crawlers so should do more good # than harm. Sitemap: /sitemap-index.cfm