User-agent: * Disallow: /www/earnings-disclaimer.htm # Robots.txt file updated Oct 03, 2008 # All robots will spider the domain User-agent: * Disallow: User-agent: * Disallow: /cd/ User-agent: * Disallow: /script/