SUNScholar/Repository Website Metrics
Back to Web Analytics
Webometrics
Harvesters
Robots
For an example visit: http://scholar.sun.ac.za/robots.txt, then check the following.
- https://github.com/DSpace/DSpace/pull/498
- https://github.com/DSpace/DSpace/blob/master/dspace-xmlui/src/main/webapp/static/robots.txt
To enable, create a "robots.txt" file in the modules folder for the XMLUI as the logged in "dspace" user.
mkdir $HOME/source/dspace/modules/xmlui/src/main/webapp/static
nano $HOME/source/dspace/modules/xmlui/src/main/webapp/static/robots.txt
Copy and paste the contents of the github file mentioned above and modify as required. Then rebuild DSpace to activate.
- NANO Editor Help
| CTL+O | = Save the file and then press Enter |
| CTL+X | = Exit "nano" |
| CTL+K | = Delete line |
| CTL+U | = Undelete line |
| CTL+W | = Search for %%string%% |
| CTL+\ | = Search for %%string%% and replace with $$string$$ |
| CTL+C | = Show line numbers |
More info = http://en.wikipedia.org/wiki/Nano_(text_editor)
HTML Head Tag Metadata
If you have heavily customized your metadata fields away from Dublin Core, you can modify the crosswalk that generates these elements by modifying:
[dspace]/config/crosswalks/xhtml-head-item.properties
