Essnet STAND PREP WP1 Report
Total Page:16
File Type:pdf, Size:1020Kb
Essnet “Preparation of standardisation” Work package 1 Review of current international and methodological handbooks and guidelines Version 9 September 2011 1. Definition of a statistical standard and of guidance.........................................................................3 1.1. Introduction...............................................................................................................................3 1.2. Current use of the words “standard” (noun or adjective) and standardise/ standardisation in statistics............................................................................................................................................3 1.2.1. Method used.......................................................................................................................3 1.2.2. Some statistical references to standards as “sets of rules to be applied” and the corresponding clues......................................................................................................................5 1.2.3. The current use of the words standard and standardisation is not fully consistent..........10 1.3. Taking stock of standardisation in other domains ..................................................................11 1.3.1. Definition of a standard....................................................................................................11 1.3.2. How should this proposal be understood in the ESSnet STAND-PREP ? ......................13 2. Review and analysis of six methodological manuals.....................................................................16 2.1. A framework for the analysis..................................................................................................16 2.1.1. Conceptual scheme of the repository for the standards ...................................................17 2.1.2. The IT tool for the management of the repository.............................................................1 2.1.3. Procedure followed for the definition and refinement of repositories for single handbooks and for the construction of the unified repository ...................................................27 2.2. Analysis of the six methodological handbooks.......................................................................28 2.2.1. Eurostat sampling references guidelines..........................................................................29 2.2.2. Recommended practices for editing and imputation in cross-sectional business surveys (EDIMBUS)...............................................................................................................................33 2.2.3. Guidelines for statistical metadata on the Internet...........................................................41 2.2.4. ESS Handbook for Quality Reports.................................................................................45 2.2.5. Recommended practices for questionnaire design and testing ........................................52 2.2.6. Survey Methods and Practices .........................................................................................57 2.3. Description of the unified repository for methodological standards.......................................65 2.3.1. General description of the repository...............................................................................65 2.3.2. Examples of compared analyses of standards derived from different handbooks for the same GSBPM sub-processes......................................................................................................72 3. Review of support measures ..........................................................................................................82 3.1. Introduction.............................................................................................................................82 3.2. Support measures related to standards....................................................................................82 3.3. Overview of support measures................................................................................................83 3.3.1. Motivation for implementation ........................................................................................83 3.3.2. Making the implementation easy.....................................................................................84 3.3.3 Supporting right implementation ......................................................................................86 3.4. Summary.................................................................................................................................87 4. Quality of statistical standards and criteria for the assessment......................................................89 4.1. Introduction.............................................................................................................................89 4.2. The concept of quality of standards ........................................................................................89 4.2.1. Applicability.....................................................................................................................90 4.2.2. Effectiveness ....................................................................................................................91 4.2.3. Efficiency.........................................................................................................................91 4.3. Relations between the proposed quality criteria on methodological standards ......................92 4.4. Main problems connected with standards that may have quality character............................92 5. Conformity to standards.................................................................................................................94 5.1. Definition ................................................................................................................................94 5.2. Conformity assessment is considered during the development of standards..........................94 5.3. Standards in the EU and EU conformity assessment..............................................................96 5.3.1. Framework for EU standardisation..................................................................................96 5.3.2. Modules for conformity assessment ................................................................................97 5.4. How to assess conformity to methodological standards in statistics? ..................................101 5.4.1. Problem statement in the ESS........................................................................................101 5.4.2. Proposal for conformity assessment ..............................................................................103 Annex 1 - ISO/ IEC Guide 2 - Standardization and related activities - General vocabulary...........106 Annex 2 - Extracts referring to standards with another meaning ....................................................124 Annex 3 – Review of literature on standards...................................................................................126 2 1. Definition of a statistical standard and of guidance 1.1. Introduction The definition of a standard in the ESSnet STAND PREP is a concern that is felt to be important by all participants. This issue has been tackled several times (even when preparing the answer to the Eurostat “call for interest”!). This is an issue that deserves serious consideration both for this ESSnet but very probably as well for further discussions in the sponsorship and in the ESSC and PG that will discuss the reports of that sponsorship. This kind of work is not exceptional in the ESS: for instance, the statistical definition of “enterprise” was a lasting concern for several years in Business statistics. The definition of “quality” required some work as well. For these two examples, there were some pre-existing references in other domains or in other statistical offices that helped settle the debate relatively quickly. For the definition of “enterprise”, the existing definitions in national accounts and accounting standards helped a lot. As for the definition of quality in statistics, papers from the US Bureau of the Census, Statistics Canada and Statistics Sweden provided very useful references In the case of standards, the ESSnet has taken stock of the literature on the subject. Whereas there are many references on standards in domains other than statistics, we did not find references in statistical organisations that could help to solve the issue quickly. In this document, we refer to the practice in existing statistical texts using the word of “standard” in order to define the underlying agreed concept for statisticians. This method is used below. However, since the previous method does not bring useful results, we have then used the ISO vocabulary to propose a definition for the concept of “standard” and the corresponding definition of standardisation. 1.2. Current use of the words “standard” (noun or adjective) and standardise/ standardisation in statistics 1.2.1. Method used “Standards” are often referred to by statisticians, with different meanings. This is largely due to the fact that “standard” has several meanings in English. We should therefore select for our purpose only texts in which the meaning of “standard” used by the author refers to standards that are the result of the standardisation activity. In short, standardisation consists in developing standards. The definition