To all users of DSpace 1.5 and DSpace 1.5.1:<div><br></div><div>These versions of DSpace ship with a bad robots.txt file that prevents search engines such as Google Scholar or Yahoo from indexing any content on a DSpace site. To check if this applies to you: <div>
<br></div><div>- Visit your site's robots.txt -- <a href="http://your_dspace_hostname.edu/robots.txt">http://your_dspace_hostname.edu/robots.txt</a></div><div>- If you see the following line you have a bad robots.txt:</div>
<div><br></div><div>Disallow: /browse</div><div><br></div><div>It is important that you REMOVE this line from your robots.txt to ensure that your DSpace instance is correctly indexed by search engines. More info on ensuring your DSpace site is correctly indexed here:</div>
<div><br></div><div><a href="http://wiki.dspace.org/index.php?title=Ensuring_your_instance_is_indexed">http://wiki.dspace.org/index.php?title=Ensuring_your_instance_is_indexed</a><br></div><div><br></div><div>Robert Tansley / Google</div>
</div>