User-agent: * Disallow: Disallow: /cgi-bin Disallow: /db Disallow: /themyweb.com Disallow: /website