User-agent: * Allow: /index.php Disallow: /* Allow: /index.shtml Disallow: /site Disallow: /site/ Disallow: /site/index.html Disallow: /site/index.htm Disallow: /site/*.* Disallow: /email Disallow: /email/ Disallow: /files Disallow: /files/ Disallow: /* Disallow: /TEMP Disallow: /TEMP/*.*