User-agent: * Disallow: admin.php Disallow: config Disallow: header Disallow: footer Disallow: pntables Disallow: referer Disallow: /images Disallow: /includes Disallow: /modules/NS- Disallow: /pnadodb Disallow: /themes User-agent: NPBot Disallow: / User-agent: grub-client Disallow: / User-agent: grub Disallow: / User-agent: crawl Disallow: / User-agent: fast Disallow: / User-agent: Jetbot Disallow: / User-agent: http://www.almaden.ibm.com/cs/crawler Disallow: / User-agent: Gigabot/2.0 Disallow: /