British Cave Monitoring Centre (Home)

Freshen the Data

This is an outline page - still to be formatted and expanded

View Uploaded Files & Technical: View STDOUT log (html) for last upload | View STDERR log for last upload

The logger data is uploaded automatically, on a scheule (details below). You can trigger a manual upload by clicking one of the buttons below.

An incremental upload of the CSV data files using TinyTag's 'restart' option.
A full upload of the 'raw' data files
For identification, the CSV files are named using the restart sequence number
A list of refreshes is available in the *.restart.txp files

Note that the 'fractured' nature of the incremental CSV files may make them difficult to use.

Technical note: this runs freshen.php

A full upload of the CSV data files
A full upload of the 'raw' data files

Note that *.csv files will be over-written, but the individual 'refresh' files already on the server will be left alone - although David Gibson might delete these manually as part of the ongoing development/debugging work.

Technical note: this runs freshen.php?restart=no

DEBUG: do not fetch any data files from the Gateway

Technical note: this runs freshen.php?debug=yes

Points to note...

When you ask to upload the logs, the process report appears on screen and is not stored in the log file
When you ask to upload the logs, the BCRA server will contact the TinyTag Gateway at Pooles Cavern and transfer the data to our storage here. This may take up to two minutes, during which time nothing much will happen, so please wait.
TinyTag provides the "freshen" option – which they refer to as a "restart" – because it is quicker, as only the changes to the CSV files are uploaded. However, the raw data files are also uploaded by my routine, and these do not have a 'freshen' option, so the upload is still going to take a while, whichever option you choose. Freshening the CSV files is useful for "real-time" access by humans but as we are running a CRON job, every hour, there is no useful purpose in freshening.

At the moment, a CRON setting causes the "Replace the Stored Logs" function (see buttons above) to be executed as follows (E&OE). Please check with David Gibson to see if the CRON settings quoted below are still current.

CRON settings:
Times: 22 1,13 * * * (that is, those minutes, past those hours, every day)
Command: curl http://bcra.org.uk/data/freshen.php?restart=no\&cron=yes
   >/home/bcra/public_html/data/logs/freshen_log.html 2>/dev/null

This page, http://bcra.org.uk/data/freshen.html was last modified on Sat, 20 Nov 2021 10:38:33 +0000
Server: britiac4.british-caving.org.uk (31.25.186.126)