# robots.txt ... used to give directions to search engines and crawlers # - Allow all types of crawler # - don't tell code of bugtrack # - don't tell other code files User-agent: * Disallow: /bugtrack/* Disallow: /~* Disallow: *.inc Disallow: guestbook.php Disallow: /phpMyAdmin/* Disallow: /admin/* User-agent: Fasterfox Disallow: /