User-agent: * - Disallow: /Acms/ - Disallow: /App_Code/ - Disallow: /App_Data/ - Disallow: /Bin/ Disallow: /Css/ - Disallow: /MasterPages/ - Disallow: /XS2/ Remove locations that do not have links in website - spiders can't find those anyway..