User-agent: * Disallow: /cgi-bin/ Disallow: /assets/ Disallow: /downloads/ Disallow: /reg/ Disallow: /register/ Disallow: /WordPress/