User-agent: * Disallow: /cgi-bin Disallow: /link/ Disallow: /redirect.php