# Disallow all crawlers access to certain pages. User-agent: * Allow: / Disallow: /checkout.asp Disallow: /add_cart.asp Disallow: /view_cart.asp Disallow: /error.asp Disallow: /shipquote.asp