Difference between revisions of "SUNScholar/Repository Website Metrics/Robots"
Jump to navigation
Jump to search
m |
m |
||
| Line 2: | Line 2: | ||
'''[[SUNScholar/Repository Website Metrics|BACK TO REPOSITORY WEBSITE METRICS]]''' | '''[[SUNScholar/Repository Website Metrics|BACK TO REPOSITORY WEBSITE METRICS]]''' | ||
</center> | </center> | ||
| − | For an example visit: '''<tt>http://scholar.sun.ac.za/robots.txt</tt>''' | + | ==Introduction== |
| − | To enable | + | A proper <tt>robots.txt</tt> file is essential in ensuring that web robots (Google, Bing etc..) have the right permissions to index your repository web site. |
| + | |||
| + | For an example visit: '''<tt>http://scholar.sun.ac.za/robots.txt</tt>'''. | ||
| + | |||
| + | ==Procedure== | ||
| + | ===Step 1=== | ||
| + | To enable a "robots.txt" file for the XMLUI, type the following: | ||
mkdir $HOME/{{Source}}/dspace/modules/xmlui/src/main/webapp/static | mkdir $HOME/{{Source}}/dspace/modules/xmlui/src/main/webapp/static | ||
nano $HOME/{{Source}}/dspace/modules/xmlui/src/main/webapp/static/robots.txt | nano $HOME/{{Source}}/dspace/modules/xmlui/src/main/webapp/static/robots.txt | ||
| − | |||
| + | See example below. | ||
| + | |||
| + | |||
| + | ===Step 2=== | ||
Then rebuild DSpace to activate. | Then rebuild DSpace to activate. | ||
Revision as of 15:07, 9 June 2015
BACK TO REPOSITORY WEBSITE METRICS
Introduction
A proper robots.txt file is essential in ensuring that web robots (Google, Bing etc..) have the right permissions to index your repository web site.
For an example visit: http://scholar.sun.ac.za/robots.txt.
Procedure
Step 1
To enable a "robots.txt" file for the XMLUI, type the following:
mkdir $HOME/source/dspace/modules/xmlui/src/main/webapp/static
nano $HOME/source/dspace/modules/xmlui/src/main/webapp/static/robots.txt
See example below.
Step 2
Then rebuild DSpace to activate.
