User-agent: GPTBot Disallow: /checkout/ User-agent: bingbot Disallow: /checkout/ User-agent: Applebot Disallow: /checkout/ User-agent: AhrefsBot Disallow: /checkout/ User-agent: * # Paths (clean URLs) Disallow: /index.php/ Disallow: /catalog/product_compare/ Disallow: /catalog/category/view/ # Disallowing this path is not recommended as many sitemaps will contain this path instead of a custom URL key. # Disallow: /catalog/product/view/ Disallow: /catalogsearch/ Disallow: /control/ Disallow: /contacts/ Disallow: /customer/ Disallow: /customize/ Disallow: /newsletter/ Disallow: /sendfriend/ Disallow: /wishlist/ Disallow: /review/product/listAjax/id/ # Do not index session ID Disallow: /*.php$ Disallow: /*?SID= #CMS Pages we don't want index Disallow: /home2 #Content sandboxes so we can preview stuff before adding blocks to many pages but don't want index. Disallow: /jacks-sandbox Disallow: /jakes-sandbox Sitemap: https://www.superbrightleds.com/media/sitemap.xml