# entire site is crawlable User-agent: * Disallow: /admin # apart from the admin area