# set sitemap Sitemap: https://furniture123.co.uk/sitemaps/sitemap-index.xml # Exclude User-agent: * Disallow: /NoURL Disallow: /f/ Disallow: /fts/ Disallow: /Error/ Disallow: /Layouts/ Disallow: /commoncontent/ Disallow: /layouts/ Disallow: /Version/Printable/ Disallow: /basket/ Disallow: /Wishlist/ Disallow: /CustomerAccount/ Disallow: *?tref= User-agent: AhrefsBot Disallow: / # remove from wayback User-agent: ia_archiver Disallow: /