User-agent: * Disallow: arachne/ Disallow: art/ Disallow: files/ Disallow: software/ Disallow: /cgi-bin/