User-agent: * Disallow: /ads Disallow: /aspnet_client Disallow: /cgi-bin Disallow: /css Disallow: /forums.asp Disallow: /webalizer Disallow: /hcl User-agent: ia_archiver Disallow: /