Information Technology Reference
In-Depth Information
This data, for the UK and common programmes, is downloaded to the STFC archive
from the Kiruna web server and stored in a directory structure having one top-level
directory per year with file names consisting of the experiment name performed and
a timestamp.
As stated, this case study aims to capture processing information about the inte-
gration analysis performed, how it was done, whether a filter was used to detect
anomalies, the integration strategy, the analysis strategy and detail the software used.
It is also important to capture human information about who performed the analysis,
when, where and provide a trail of the origin of analysed files. Capturing the neces-
sary PDI fields for the EISCAT data follows the same process as for the WDC case
study. Through a thorough examination and discussion with the EISCAT archivist
stationed at STFC, four key events were identified.
13.7.6.2.1 The Events and the Capture Criteria
1. Receive and ingest raw data from the Kiruna archive - “In order for this
digital data to be accepted as EISCAT data of sufficient quality the reliability of
its source must be verified and the format of the received data must be recorded”
2. Perform data storage - “The storage of data in a directory name matching
<experiment_name>@<site>/yyyymmdd_hh will be checked and verified for
consistency”
Table 13.2 Events for each step - EISCAT example
Protocol/event
Step to record
Explanation
Receive and ingest raw data
from the Kiruna archive
Source of dataset
Capture evidence that this is
indeed the source
Checksum information
Record checksum
information about
received files
Archivist name and details
Capture credentials of
archivist
Perform data storage
Directory structure
Capture details of the
directory structure
Matlab file name
convention
Record consistency with the
file-naming convention
Check file contents for
consistency
Detail file parameters
Capture details of the
required file parameters
Compare with observation
details
Data parameters should be
consistent with the
observation, the date, the
site and the experiment
name
Perform integration and analysis
Data integration
Detail the integration
performed
Data analysis strategy
Detail the analysis strategy
used
 
Search WWH ::




Custom Search