SUNScholar/Repository Website Metrics/Robots

BACK TO REPOSITORY WEBSITE METRICS

For an example visit: http://scholar.sun.ac.za/robots.txt, then check the following.

• https://github.com/DSpace/DSpace/pull/498
• https://github.com/DSpace/DSpace/blob/master/dspace-xmlui/src/main/webapp/static/robots.txt

To enable, create a "robots.txt" file in the modules folder for the XMLUI as the logged in "dspace" user.

mkdir $HOME/source/dspace/modules/xmlui/src/main/webapp/static

nano $HOME/source/dspace/modules/xmlui/src/main/webapp/static/robots.txt

Copy and paste the contents of the github file mentioned above and modify as required.

Then rebuild DSpace to activate.