User-agent: * Disallow: /*to_url* Disallow: /page.php* Disallow: /*.pdf$ Allow: /