Research in Informal Settings: Some Reflections on Designs and Methodology

Total Page:16

File Type:pdf, Size:1020Kb

Research in Informal Settings: Some Reflections on Designs and Methodology Spring 1991 67 Research In Informal Settings: Some Reflections on Designs and Methodology John J. Koran, Jr. Jim Ellis Professor and Curator Research Assistant Science Education and Museum Studies Museum Studies Associate Dean, The Graduate School Florida Museum ofNatural History University ofFlorida Gainesville, FL 32611 Research in informalsettings can be experimental or naturalistic or a combination of methods, allofwhich canyield rich data. Research designs areselected to explore specific problems; however, even the most carefully thought-out designs and procedures have shortcomings. Frequently, research studies contribute to summative or formative evaluation objectives. All evaluation studies, however, do not necessarily adhere to the rigorous criteria required for research studies and consequently mayor may not be strictlydefined as ((research. "Thispaperfocuses on experimentaldesigns andthe review offour experimental studies, considering threats to internal and external validity. Internal validitydeals with whether the experimentaltreatmentsactuallyproduce the observed effects. External validity concernsgeneralizability ofstudyfindings to other settings, exhibits, andsubjects. Threats to validityinclude history, maturation, testing, instrumentation, regression, selection, mortality, and interactions. The studies selected for this analysis were all variations of experimental designs. In each case, the study could haveprofitedfrom stronger, morefocused research designs and methodology as well as from exit interviews ofthe subjects andfrom the collection of other types of naturalistic data. It is the authors' opinion that both experimental and naturalistic methods can often be used together to enrich the data base from which to make inferences and contribute to knowledge about learning in informal settings. 68 ILVS Review INTRODUCTION Research in informal settings can be experimental or naturalistic or a combination of methods, all of which can yield rich data. Regardless of the methods used, research designs are selected to explore specific issues and problems. However, even the most carefully thought-out designs and procedures can have some shortcom­ ings. This is especially true of field research, where control of variables is often difficult to achieve. While research studies can contribute to evaluation objectives, not all evaluation studies necessarily adhere to the rigorous criteria required for research studies. Consequendy, such studies mayor may not be stricdy defined as "re­ search." This paper will focus on experimental research designs and will critique four published studies. Experimental Designs: Some Basics Cook and Campbell (1979) suggest that the word "experiment" implies testing, causal relationships, deliberate manipulation, and inference. For clarity we will use the term to signify a treatment, an outcome measure, some form of randomization ofsubjects, and a method for comparison to determine the effects ofthe treatment. A treatment can involve any number ofpossible manipulations; however, for museums and other informal learning settings,l treatments frequendy involve having subjects (visitors, students) view or participate in some exhibit or program that includes a planned and/or sequenced set of informational or instructional materials. Outcome indicators or instruments generally take the form ofquestion­ naires, interviews, or other ways ofmeasuring knowledge, comprehension, inter­ ests, attitudes, etc. These instruments often measure combined outcomes (~.g., knowledge and attitude), although interactions between cognitive and affective questions can occur, making the results difficult to interpret. Other forms of measurement also are used, such as unobtrusive observation ofvisitors and coding ofpertinent visitor behavior. Dependingonthe problem they are studying, researchers often assign their subjects to several treatment groups and/or a control group. In order to enhance the ability ofthe researcher to make an inference about the change observed as a result ofa particular treatment, a randomization technique for subject selection and assignment should be utilized. Random selection from a given population assures the researcher that the subjects are representative of that population. Random 1. Informal learning settings can include zoological parks, botanical gardens, nature centers, national and state parks, aquaria, schoolbased nature trails, most field trip locations, and even many school laboratory activities. Spring 1991 69 assignment of subjects from a selected population to the treatment and control groups ensures that the study groups are equivalent in all factors other than those associated with the treatments (Cookand Campbell, 1979;Smith and Glass, 1987). Researchers should be aware that the unit ofanalysis is dependent on the method by which subjects are selected and assigned. If individual visitors are randomly assigned to treatments and control, the statistical unit to be analyzed is based on the number ofvisitors in the sample; however, ifone assigns groups of visitors (e.g., adult education classes), then the unit of analysis is based on the number of groups and not individuals. The latter would require a considerably larger sample size since small numbers ofintact groups generally must show robust treatment effects before the effects are measurable. Yet in some situations, class assignment may be easier than splitting up classes. Three Basic Research Designs Research designs vary according to researcher preferences and types of questions asked. Campbell and Stanley(1973) have written one of the best introductory texts on experimental research designs. Table 1 outlines three ofthe most basic designs. Design 1 is best suited when the researcher has a large or relatively homogeneous sample and has reason to believe that randomization will be effective in equating the treatment and control groups; hence a pretest to determine whether randomizationwas effective is not necessary. This type ofdesign would be suitable for many ofthe museum and informal settings that include the casual visitor as well as students in planned groupvisits. This design can be used with class (field trip) groups by randomly assigning each student in a particular class to a treatment or control group. The treatment group views an exhibit or otherwise participates in the treatment and then receives the post-test. The control group is first tested with the same post-test and then allowed to view the exhibit or receive the treatment; through this modified design, the control group can benefit from the exhibit or treatment while still serving as a control. Designs 2 and 3 are most suitable when the researcher has greater control ofthe subjects or groups because at least two testing periods are needed for each group. Laboratory type settings, classrooms, school groups, and other planned groupings associated with museums and informal settings mightlend themselves to this type ofdesign. Again, as these are experimental designs, random selection and assignment are used to offset both design threats and sources of bias in selecting subjects (Table 2). A pretest, given to ascertain if randomization was indeed effective, provides data on whether the group means and standard deviations were equal at the outset. Design 3 provides the researcher with the opportunity to study the effects ofpretesting on the treatment (interactions ofthe treatment and test) and the effects ofthe pretest on the post-test when no treatment intervenes. 70 ILVS Review Table 1 Experimental Research Designsfor Informal Settings Design Subject Pretest Treatment Post-test Assignment Design 1 Post-test Only treatment group random NO YES YES control group random NO NO YES Design 2 Pretest/Post-test treatment group random YES YES YES control group random YES NO YES Design 3* Solomon four-group treatment group random YES YES YES control group random YES NO YES treatment group random NO YES YES control group random NO NO YES *This design is particularly strong because it controls for most effects that may be caused by the test itself. Note: YES indicates that a test or treatment is done in the sequence presented. NO indicates that the particular aspect is not active in the design. (adapted from Campbell and Stanley, 1973) VJ Table 2 '"d ::I. ::l Design Threats to Validity CJQ I-' '0 '0 I-' Design History Maturation Testing Instrumentation Regression Mortality Interaction Design 1 Post-test Only + + + + + + with control group Design 2 Pretest/ post-test with + + + + + + control group Design 3 Solomon four- + + + + + + group Note: Plus (+) sign indicates threat is accounted for through random assignment in the design. Question mark (?) indicates that threats to validity may not be fully accounted for by random assignment. (adapted from Campbell and Stanley, 1973) '-J I-' 72 ILVS Review As illustrated in Table 2, a number ofpossible design threats or factors can hinder the interpretation of the results. Campbell and Stanley (1973), in their discussion of experimental and quasi-experimental designs for research, refer to these threats to validity as history (specific events occurring during the study), maturation (growth or change in the subjects during the study), testing (effects of the test on the subjects ofthe study), instrumentation (changes in rating scales or instruments during the study), regression (scores moving toward the mean regard­ less oftreatment because ofthe groups' extreme or unique nature), selection (biases based on placement ofsubjects
Recommended publications
  • A Unit-Error Theory for Register-Based Household Statistics
    A Service of Leibniz-Informationszentrum econstor Wirtschaft Leibniz Information Centre Make Your Publications Visible. zbw for Economics Zhang, Li-Chun Working Paper A unit-error theory for register-based household statistics Discussion Papers, No. 598 Provided in Cooperation with: Research Department, Statistics Norway, Oslo Suggested Citation: Zhang, Li-Chun (2009) : A unit-error theory for register-based household statistics, Discussion Papers, No. 598, Statistics Norway, Research Department, Oslo This Version is available at: http://hdl.handle.net/10419/192580 Standard-Nutzungsbedingungen: Terms of use: Die Dokumente auf EconStor dürfen zu eigenen wissenschaftlichen Documents in EconStor may be saved and copied for your Zwecken und zum Privatgebrauch gespeichert und kopiert werden. personal and scholarly purposes. Sie dürfen die Dokumente nicht für öffentliche oder kommerzielle You are not to copy documents for public or commercial Zwecke vervielfältigen, öffentlich ausstellen, öffentlich zugänglich purposes, to exhibit the documents publicly, to make them machen, vertreiben oder anderweitig nutzen. publicly available on the internet, or to distribute or otherwise use the documents in public. Sofern die Verfasser die Dokumente unter Open-Content-Lizenzen (insbesondere CC-Lizenzen) zur Verfügung gestellt haben sollten, If the documents have been made available under an Open gelten abweichend von diesen Nutzungsbedingungen die in der dort Content Licence (especially Creative Commons Licences), you genannten Lizenz gewährten Nutzungsrechte. may exercise further usage rights as specified in the indicated licence. www.econstor.eu Discussion Papers No. 598, December 2009 Statistics Norway, Statistical Methods and Standards Li-Chun Zhang A unit-error theory for register- based household statistics Abstract: The next round of census will be completely register-based in all the Nordic countries.
    [Show full text]
  • Statistical Units
    Statistical units Preface This chapter details the definitions of statistical units applicable in European business statistics, and is part of the online publication European Business Statistics manual. The statistical unit is the entity for which the required statistics are compiled. It is an analytical unit for which statistics are compiled. Statisticians create it by splitting or combining observation units with the help of estimations or imputations in order to supply more detailed and/or homogeneous data than would otherwise be possible. It is important to understand how it differs from the observation unit. The observation unit is the entity on which information is received. The observation unit and analytical unit may sometimes be the same. The reporting unit is the entity from which the recommended data items are collected. It will vary from sector to sector and from country to country, depending on institutional structures, the legal framework for data collection, traditions, national priorities and survey resources. It may or may not correspond to an observation unit and/or an analytical unit. Besides definitions and explanatory notes on each statistical unit, this chapter currently also includes more detailed operational rules. Whether to keep the full text version of the operational rules in this chapter or to include them merely as hyperlink will be investigated. Contents 1. Introduction 2. What's new 3. Enterprise 3.1 Definition 3.2 Explanatory note 3.3 Operational Rules 3.4 Operational rules for Head Offices, Holding Companies and Special Purpose Entities 4. Enterprise group 4.1 Definition 4.2 Explanatory notes 4.3 Additional explanations 4.4 Operational Rules 5.
    [Show full text]
  • Statistical Analysis of Real Manufacturing Process Data Statistické Zpracování Dat Z Reálného Výrobního Procesu
    View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by Digital library of Brno University of Technology BRNO UNIVERSITY OF TECHNOLOGY VYSOKÉ U ČENÍ TECHNICKÉ V BRN Ě FACULTY OF MECHANICAL ENGINEERING DEPARTMENT OF MATHEMATICS FAKULTA STROJNÍHO INŽENÝRSTVÍ ÚSTAV MATEMATIKY STATISTICAL ANALYSIS OF REAL MANUFACTURING PROCESS DATA STATISTICKÉ ZPRACOVÁNÍ DAT Z REÁLNÉHO VÝROBNÍHO PROCESU MASTER’S THESIS DIPLOMOVÁ PRÁCE AUTHOR Bc. BARBORA KU ČEROVÁ AUTOR PRÁCE SUPERVISOR Ing. JOSEF BEDNÁ Ř, Ph.D VEDOUCÍ PRÁCE BRNO 2012 Vysoké učení technické v Brně, Fakulta strojního inženýrství Ústav matematiky Akademický rok: 2011/2012 ZADÁNÍ DIPLOMOVÉ PRÁCE student(ka): Bc. Barbora Kučerová který/která studuje v magisterském navazujícím studijním programu obor: Matematické inženýrství (3901T021) Ředitel ústavu Vám v souladu se zákonem č.111/1998 o vysokých školách a se Studijním a zkušebním řádem VUT v Brně určuje následující téma diplomové práce: Statistické zpracování dat z reálného výrobního procesu v anglickém jazyce: Statistical analysis of real manufacturing process data Stručná charakteristika problematiky úkolu: Statistické zpracování dat z konkrétního výrobního procesu, předpokládá se využití testování hypotéz, metody ANOVA a GLM, analýzy způsobilosti procesu. Cíle diplomové práce: 1. Popis metodologie určování způsobilosti procesu. 2. Stručná formulace konkrétního problému z technické praxe (určení dominantních faktorů ovlivňujících způsobilost procesu). 3. Popis statistických nástrojů vhodných k řešení problému. 4. Řešení popsaného problému s využitím statistických nástrojů. Seznam odborné literatury: 1. Meloun, M., Militký, J.: Kompendium statistického zpracování dat. Academica, Praha, 2002. 2. Kupka, K.: Statistické řízení jakosti. TriloByte, 1998. 3. Montgomery, D.,C.: Introduction to Statistical Quality Control. Chapman Vedoucí diplomové práce: Ing.
    [Show full text]
  • A Guide to Writing a Good Codebook for Data Analysis Projects in Medicine
    Codebook cookbook A guide to writing a good codebook for data analysis projects in medicine 1. Introduction Writing a codebook is an important step in the management of any data analysis project. The codebook will serve as a reference for the clinical team; it will help newcomers to the project to rapidly have a flavor of what is at stake and will serve as a communication tool with the statistical unit. Indeed, when comes time to perform statistical analyses on your data, the statistician will be grateful to have a codebook that is readily usable, that is, a codebook that is easy to turn into code for whichever statistical analysis package he/she will use (SAS, R, Stata, or other). 2. Data preparation Whether you enter data in a spreadsheet such as Excel (as is currently popular in biomedical research) or a database program such as Access, there is much freedom in the way data can be entered. A few rules, however, should be followed, to make both the data entry and subsequent data analysis as smooth as possible. A specific example will be presented in Section 3, but first let‟s look at a few general suggestions. 2.1 Variables names A unique, unambiguous name should be given to each variable. Variables names MUST consist of one string only, consisting of letters and — when useful — numbers and underscores ( _ ). Spaces are not allowed in variables names in most statistical programs, even if data entry programs like Excel or Access will allow this. It is good practice to enter variables names at the top of each column.
    [Show full text]
  • Statistical Units in the System of National Accounts
    STATISTICAL UNITS IN THE SYSTEM OF NATIONAL ACCOUNTS Group of Experts on National Accounts Geneva, May 18 – 20, 2016 Jennifer Ribarsky Head of Section, OECD Introduction (1/2) • SNA 2008 distinguishes two different types of statistical units: – Establishment in supply and use tables – Institutional units in institutional sector accounts • Call for (re)considering statistical units, also call for possibly reconsidering classifications by industry • Going beyond the present standards of the 2008 SNA • Establishment of a Task Force on Statistical Units, looking at it from a more fundamental point of view 2 Introduction (2/2) SNA 2008, para. A4.21: “At the present there are two reasons to have the concept of establishment within the SNA. The first of these is to provide a link to source information when this is collected on an establishment basis. In cases where basic information is collected on an enterprise basis, this reason disappears. The second reason is for use in input-output tables. Historically, the rationale was to have a unit that related as far as possible to only one activity in only one location so that the link to the physical processes of production was as clear as possible. With the change of emphasis from the physical view of input-output to an economic view, and from product-by-product matrices to industry-by-industry ones, it is less clear that it is essential to retain the concept of establishment in the SNA”. 3 Why are establishments the preferred unit in the SNA 2008? • The premise in the SNA is that the establishment
    [Show full text]
  • Glossary of Terms
    Frascati Manual 2015 Guidelines for Collecting and Reporting Data on Research and Experimental Development © OECD 2015 ANNEX 2 Glossary of terms Accounting on an accruals basis recognises a transaction when the activity (decision) generating revenue or consuming resources takes place, regardless of when the associated cash is received or paid. See also accounting on a cash basis. Applied research is original investigation undertaken in order to acquire new knowledge. It is, however, directed primarily towards a specific, practical aim or objective. Appropriations are policy bills that provide / set aside money for specific government departments, agencies, programmes and/or functions. Appropria- tions provide legal authority to enter into obligations that will result in outlays. See also obligations and outlays. Authorisations are policy bills that establish, continue or modify govern- ment programmes and are often accompanied by spending ceilings or policy guidance for subsequent appropriations. However, an authorised funding level has no necessary link with an appropriated funding level. See also appropriations. Basic research is experimental or theoretical work undertaken primarily to acquire new knowledge of the underlying foundations of phenomena and observable facts, without any particular application or use in view. A branch campus abroad (BCA) is defined as a tertiary educational institution that is owned, at least in part, by a local higher education institution (i.e. resident inside the compiling country) but is located in the Rest of the world (resident outside the compiling country); operates in the name of the local higher education institution; engages in at least some face-to-face teaching; and provides access to an entire academic programme that leads to a credential awarded by the local higher education institution.
    [Show full text]
  • Statistical Analysis of Microarray Data in Sleep Deprivation
    Scholars' Mine Masters Theses Student Theses and Dissertations 2013 Statistical analysis of microarray data in sleep deprivation Stephanie Marie Berhorst Follow this and additional works at: https://scholarsmine.mst.edu/masters_theses Part of the Statistics and Probability Commons Department: Recommended Citation Berhorst, Stephanie Marie, "Statistical analysis of microarray data in sleep deprivation" (2013). Masters Theses. 7533. https://scholarsmine.mst.edu/masters_theses/7533 This thesis is brought to you by Scholars' Mine, a service of the Missouri S&T Library and Learning Resources. This work is protected by U. S. Copyright Law. Unauthorized use including reproduction for redistribution requires the permission of the copyright holder. For more information, please contact [email protected]. STATISTICAL ANALYSIS OF MICROARRAY DATA IN SLEEP DEPRIVATION by STEPHANIE MARIE BERHORST A THESIS Presented to the Faculty of the Graduate School of the MISSOURI UNIVERSITY OF SCIENCE AND TECHNOLOGY In Partial Fulfillment of the Requirements for the Degree MASTER OF SCIENCE IN APPLIED MATHEMATICS 2013 Approved by Gayla R. Olbricht, Advisor Matthew Thimgan Robert Paige iii ABSTRACT Microarray technology is a useful tool for studying the expression levels of thousands of genes or exons within a single experiment. Data from microarray experiments present many challenges for researchers since costly resources often limit the experimenter to small sample sizes and large amounts of data are generated. The researcher must carefully consider the appropriate statistical analysis to use that aligns with the experimental design employed. In this work, statistical issues are investigated and addressed for a microarray experiment that examines how expression levels change over time as individuals are sleep deprived.
    [Show full text]
  • LEGEND Glossary Let Evidence Guide Every New Decision
    LEGEND Glossary Let Evidence Guide Every New Decision A B C D E F G H I J K L M N O P Q R S T U V W X Y Z A Adverse Event An adverse outcome occurring during or after the use of a drug or other intervention Related Terms but not necessarily caused by it. Side Effect Serious Adverse Event Adverse Drug Event Source/Copyright © Bandolier Glossary & The Cochrane Collaboration Glossary Applicability The extent to which the study results or effects of the study are appropriate and Related Terms relevant for use in a particular patient situation External Validity Internal Validity (e.g., patient characteristics, clinical setting, resources, organizational issues) Validity Reference Population Source/Copyright © The Cochrane Collaboration Glossary Attrition The loss of participants during the course of a study due to withdrawals, dropouts, or Synonyms protocol deviations which potentially introduces bias by changing the composition of Dropout the sample. Related Terms Lost to Follow Up Source/Copyright © The Cochrane Collaboration Glossary & Portney, Leslie. G. & Watkins, Mary, P. Foundations of Clinical Research Application to Practice. 2nd Edition. 2000. Prentice Hall Health. Upper Saddle River, New Jersey 07458. B Baseline Data Data which measures the outcome of interest prior to initiating any change or Related Terms intervention Baseline Characteristics Source/Copyright © The Cochrane Collaboration Glossary & Portney, Leslie. G. & Watkins, Mary, P. Foundations of Clinical Research Application to Practice. 2nd Edition. 2000. Prentice Hall Health. Upper Saddle River, New Jersey 07458. C Case(s) A person having a particular disease, disorder, or condition Source/Copyright © International Epidemiological Association, Inc.: Porta, M., Greenland, S., & Last, J.
    [Show full text]
  • The Tyranny of Census Geography: Small-Area Data and Neighborhood Statistics
    Point of Contention: Defining Neighborhoods Guest Editor: Ron Wilson U.S. Department of Housing and Urban Development Neighborhoods are a natural construct widely used for analytical purposes in research, policymaking, and practice, but defining a neighborhood for these purposes has always been difficult. This Point of Contention offers four articles about precisely bounding this often fuzzy concept. The authors provide a range of perspectives, from practitioner to researcher, about the construction of neighborhoods and the complexity of what neighbor- hood really means. The Tyranny of Census Geography: Small-Area Data and Neighborhood Statistics Jonathan Sperling U.S. Department of Housing and Urban Development The opinions expressed in this article are those of the author and do not necessarily reflect those of the U.S. Department of Housing and Urban Development. Census-defined small-area geographies and statistics in the United States are highly accessible, rela- tively easy to use, and available across time and space. The singular and strict use of block groups, census tracts, or ZIP Codes as proxies for neighborhood, however, are often inappropriate and can result in flawed findings, poor public policy decisions, and even situations in which families or businesses are disqualified from place-based government programs. Perceptions of neighborhoods are social constructs and context dependent. Yet social science literature is replete with an unques- tioning use of these geographies to measure neighborhood effects, despite evidence that the use of alternative spatial scales and techniques can deliver very different results.1 Census small-area statistics are artifacts of the geographic boundaries created by the Census Bureau, often in collaboration with local stakeholders.
    [Show full text]
  • Best Practice Guidelines for Developing International Statistical Classifications
    Best Practice Guidelines for Developing International Statistical Classifications Andrew Hancock, Chair, Expert Group on International Statistical Classifications Best Practice Guidelines for Developing International Statistical Classifications November 2013 1 Abbreviations CPC Central Product Classification ICD International Classification of Diseases ILO International Labour Organization ISCO International Standard Classification of Occupations ISIC International Standard Industrial Classification of All Economic Activities ISO International Organisation for Standardisation UNESCO United Nations Educational, Scientific and Cultural Organisation UNSD United Nations Statistics Division WHO World Health Organization Best Practice Guidelines for Developing International Statistical Classifications November 2013 2 Contents Introduction ................................................................................................................................ 4 Background ................................................................................................................................ 4 Defining a statistical classification .............................................................................................. 5 Principles to consider when developing an international statistical classification ........................ 7 Components of a Classification .................................................................................................12 Other Issues/Definitions ............................................................................................................16
    [Show full text]
  • Milton Terris1
    American Journal of EPIDEMIOLOGY Volume 136 Copyright © 1992 by The Johns Hopkins University Number 8 School of Hygiene and Public Health October 15,1992 Sponsored by the Society for Epidemiologic Research SPECIAL SOCIETY FOR EPIDEMIOLOGIC RESEARCH (SER) ISSUE: Downloaded from PAPERS PRESENTED AT THE 25TH ANNUAL MEETING OF THE SER, MINNEAPOLIS, MINNESOTA, JUNE 9-12, 1992 INVITED ADDRESSES http://aje.oxfordjournals.org/ The Society for Epidemiologic Research (SER) and the Future of Epidemiology at Oxford University Press for SER Members on April 15, 2014 Milton Terris1 I appreciate very much this opportunity SOCIAL MEDICINE IN GREAT BRITAIN to help celebrate the 25th Anniversary of the In that same year, 1943, John A. Ryle, Society for Epidemiologic Research (SER). the Regius Professor of Medicine at Cam- I think it will be useful to present the histor- bridge, resigned his position to become the ical background to the Society's formation first Professor of Social Medicine in Great as a necessary prelude for discussing SER Britain, accepting the Chair which had just and the future of epidemiology. been established at Oxford University. This I was a student in 1943 at the Johns dramatic event signalized the leap from in- Hopkins School of Hygiene and Public fectious disease to noninfectious disease ep- Health, where Wade Hampton Frost had idemiology. As Ryle stated, "Public health served as the first Professor of Epidemiology. ... has been largely preoccupied with the Frost had defined epidemiology as "the sci- communicable diseases, their causes, distri- ence of the mass-phenomena of infectious bution, and prevention. Social medicine is diseases" (1), and the epidemiology courses concerned with all diseases of prevalence, at Hopkins were limited entirely to infec- including rheumatic heart disease, peptic ul- tious diseases.
    [Show full text]
  • TRANSPORT STATISTICS Content
    TRANSPORT STATISTICS Reference Metadata in Euro SDMX Metadata Structure (ESMS) INSTAT Content 1. Contact ............................................................................................................................................... 2 2. Metadata update ............................................................................................................................... 2 3. Statistical presentation ..................................................................................................................... 2 4. Unit of measure ................................................................................................................................. 4 5. Reference period ............................................................................................................................... 4 6. Institutional mandate ........................................................................................................................ 4 7. Confidentiality ................................................................................................................................... 4 8. Release policy .................................................................................................................................... 5 9. Frequency of dissemination ............................................................................................................. 5 10. Accessibility and clarity .................................................................................................................
    [Show full text]