User-agent: * Disallow: /old/ #backups and old versions Disallow: /lcd/ # last modified by Bob Sieber 2004-4-16 18:20. # jboubio Disallow: /cs/li/ Disallow: /cs/pol/ Disallow: /pblnet/ Disallow: /cs/main/ Disallow: /cs/li/ Disallow: /stratlit/ Disallow: /acwt/ Disallow: /asds/ Disallow: /nhcssp/ Disallow: /hd/ # Don't crawl shopping cart Disallow: /cs/we/cart Disallow: /cart/cart.csp # Don't crawl login pages Disallow: /cs/we/login Disallow: /cs/main/login # Don't crawl "apply for this position" links Disallow: /cs/we/create/hr_apply Disallow: /cs/smp/ Disallow: /csrd/ Disallow: */chks/view/rs_press/ Disallow: */view/u/2462 Disallow: */view/u/2944 Disallow: */view/u/2240 Disallow: */q/1211 # The WE calendar creates an infinite crawl space for search engines # which can be replicated by clicking through by month. # I'm suspicious there my be some syntax issues with the following, # which is why I've moved it to last place Disallow: *x-y=2012