# Yahoo News Crawler
User-agent: Yahoo-Newscrawler
Disallow: /cgi-bin/

User-agent: Mediapartners-Google*
Disallow: /cgi-bin/

User-agent: * 
Disallow: /cgi-bin/