User-agent: * Disallow: *? Disallow: *.php Disallow: */comment-page* Disallow: */admin/* Disallow: */red/*