SUNScholar/Elastic Statistics/Import Logs - Revision history

Hgibson: /* Procedure */

2016-08-26T10:40:41Z

Procedure

2016-08-26T10:40:24Z

Step 2 - Import prepared log data to Elastic Statistics

2016-05-29T13:48:22Z

Import Utility

2015-03-27T12:17:37Z

PLEASE NOTE:

2015-03-27T12:16:42Z

PLEASE NOTE:

2015-03-27T12:16:19Z

2015-03-02T10:03:19Z

References

2015-01-25T07:12:33Z

PLEASE NOTE:

2015-01-25T07:11:45Z

PLEASE NOTE:

2015-01-24T21:47:01Z

Procedure

@@ Line 67: / Line 67: @@
 	echo "Importing stats for log file:... $i" > stats-import.log
 	$HOME/bin/dspace stats-log-importer -v -i $i
-         echo "Import of:... $i completed. Resting for a minute... Phew!" > stats-import.log
+         echo "Import of:... $i completed. Resting for a while!" > stats-import.log
          sleep 3
 done

@@ Line 68: / Line 68: @@
 	$HOME/bin/dspace stats-log-importer -v -i $i
          echo "Import of:... $i completed. Resting for a minute... Phew!" > stats-import.log
-         sleep 60
+         sleep 3
 done
 </pre>

← Older revision		Revision as of 13:48, 29 May 2016
Line 106:		Line 106:
	-v,--verbose display verbose output (useful for debugging)		-v,--verbose display verbose output (useful for debugging)
	</pre>		</pre>
		+	[[Category:Customisation]]

@@ Line 40: / Line 40: @@
 ===Step 2 - Import prepared log data to Elastic Statistics===
 ----
-====PLEASE NOTE:====
+====<font color="red">PLEASE NOTE:</font>====
 *''For a busy web site, the imports will take a long time. You will be updating a long history of visits in a very short space of time on the server. Please be patient, the import may take hours, maybe even days!''
 *You can speed up the imports on an Ubuntu server by installing a name server caching daemon, type: <tt>'''sudo apt-get install nscd'''</tt> before you start the imports.

@@ Line 5: / Line 5: @@
 To get a full statistical history after enabling Elastic Statistics, requires the import of old log data. Below are details to do just that.
 ===<font color="red">PLEASE NOTE:</font>===
-'''When importing records, try not to duplicate records.<br>For example:<br>If you enabled Elastic Statistics a month previously, then do not import the logs for the past month, because you will duplicate records from the period when you first enabled Elastic Statistics.'''
+When importing records, try not to duplicate records.
 ===Step 1 - Export old log data to suitable import format===

@@ Line 73: / Line 73: @@
 ===References===
 ====Export Utility====
 :'''$HOME/bin/dspace stats-log-converter'''

@@ Line 43: / Line 43: @@
 **https://en.wikipedia.org/wiki/GNU_Screen
 **https://en.wikipedia.org/wiki/Tmux
-*If the import should fail, then check the "stats-import.log" to see which imports succeeded. Then remove the import files that have been processed and begin the import again. Repeat this process until all the import files have been processed.
+*If the import should fail, then check the "stats-import.log" file to see which imports succeeded. Then remove the import files that have been processed and begin the import again. Repeat this process until all the import files have been processed.
 ====Procedure====