# Robots.txt file for control of search engine spiders on http://www.biotivia.com # # All robots will be treated the same apart from the googlebot, where we are # able to exclude *.js, *.asp and *.css files. User-agent: * Disallow: /search.php Disallow: /it Disallow: /fr User-Agent: googlebot Disallow: /*.js$ Disallow: /*.css$ Disallow: /search.php Sitemap: http://www.biotivia.com/sitemap.xml