SUNScholar/Repository Website Metrics

Back to Web Analytics

Robots

For an example visit: http://scholar.sun.ac.za/robots.txt, then check the following.

• https://github.com/DSpace/DSpace/pull/498
• https://github.com/DSpace/DSpace/blob/master/dspace-xmlui/src/main/webapp/static/robots.txt

To enable, create a "robots.txt" file in the modules folder for the XMLUI as the logged in "dspace" user.

mkdir $HOME/source/dspace/modules/xmlui/src/main/webapp/static

nano $HOME/source/dspace/modules/xmlui/src/main/webapp/static/robots.txt

Copy and paste the contents of the github file mentioned above and modify as required. Then rebuild DSpace to activate.

---

NANO Editor Help

CTL+O	= Save the file and then press Enter
CTL+X	= Exit "nano"
CTL+K	= Delete line
CTL+U	= Undelete line
CTL+W	= Search for %%string%%
CTL+\	= Search for %%string%% and replace with $$string$$
CTL+C	= Show line numbers

More info = http://en.wikipedia.org/wiki/Nano_(text_editor)

---

HTML Head Tag Metadata

If you have heavily customized your metadata fields away from Dublin Core, you can modify the crosswalk that generates these elements by modifying:

[dspace]/config/crosswalks/xhtml-head-item.properties