Data management
Managing the wide range of data that are used in, and produced by, an integrated assessment can pose a serious challenge. The problem is not only to record carefully what data are used and generated, in order to monitor the progress of the assessment and provide a detailed audit trail, but also to ensure fitness for purpose - that the data and results are able to do the job for which they are needed. This is especially important because, during the course of an assessment, data may be fed through a series of different but linked models, and end up far from their original position or purpose. This inevitably raises dangers that data will be inappropriately used, and that the results will thus be flawed.
An effective system for data management and quality assurance is therefore vital. To be effective, this will comprise four key elements:
- Data standards (developed at the Design stage):
- A clear set of criteria specifying minimal requirements for data inclusion or data linkage;
- A clear set of tolerances, identifying the limits of uncertainty for the results - and thus the threshold for exclusion.
- Testing and validation
- Carefully specified requirements and procedures for testing and validation of data and results - both to ensure that they meet the relevant data standards and that inherent uncertainties are evaluated and reported;
- A series of approved reference data that can be used to test and validate models under controlled conditions.
- Metadata (information about the data)
- A rigorous and consistent procedure for recording metadata (including a Glossary of terms and definitions);
- An up-to-date and searchable data catalogue, containing all the metadata records;
- A feedback system, facilitating the reporting of newly discovered problems or issues with the data sets (whether by members of the assessment team or external users).
- Tracking and alert
- A quick and effective system for tracking who is using which data, as part of the assessment;
- A clear and simple system for reporting on any changes to current data sets, or any newly discovered data problems, to other members of the assessment team.

