Section 4.3 Good and Poor Ways to Experiment

Total Page:16

File Type:pdf, Size:1020Kb

Section 4.3 Good and Poor Ways to Experiment Chapter 4 Gathering Data Section 4.3 Good and Poor Ways to Experiment Copyright © 2013, 2009, and 2007, Pearson Education, Inc. Elements of an Experiment Experimental units: The subjects of an experiment; the entities that we measure in an experiment. Treatment: A specific experimental condition imposed on the subjects of the study; the treatments correspond to assigned values of the explanatory variable. Explanatory variable: Defines the groups to be compared with respect to values on the response variable. Response variable: The outcome measured on the subjects to reveal the effect of the treatment(s). 3 Copyright © 2013, 2009, and 2007, Pearson Education, Inc. Experiments ▪ An experiment deliberately imposes treatments on the experimental units in order to observe their responses. ▪ The goal of an experiment is to compare the effect of the treatment on the response. ▪ Experiments that are randomized occur when the subjects are randomly assigned to the treatments; randomization helps to eliminate the effects of lurking variables. 4 Copyright © 2013, 2009, and 2007, Pearson Education, Inc. 3 Components of a Good Experiment 1. Control/Comparison Group: allows the researcher to analyze the effectiveness of the primary treatment. 2. Randomization: eliminates possible researcher bias, balances the comparison groups on known as well as on lurking variables. 3. Replication: allows us to attribute observed effects to the treatments rather than ordinary variability. 5 Copyright © 2013, 2009, and 2007, Pearson Education, Inc. Component 1: Control or Comparison Group ▪ A placebo is a dummy treatment, i.e. sugar pill. Many subjects respond favorably to any treatment, even a placebo. ▪ A control group typically receives a placebo. A control group allows us the analyze the effectiveness of the primary treatment. ▪ A control group need not receive a placebo. Clinical trials often compare a new treatment for a medical condition, not with a placebo, but with a treatment that is already on the market. 6 Copyright © 2013, 2009, and 2007, Pearson Education, Inc. Component 1: Control or Comparison Group Experiments should compare treatments rather than attempt to assess the effect of a single treatment in isolation. ▪ Is the treatment group better, worse, or no different than the control group? Example: 400 volunteers are asked to quit smoking and each start taking an antidepressant. In 1 year, how many have relapsed? Without a control group (individuals who are not on the antidepressant), it is not possible to gauge the effectiveness of the antidepressant. 7 Copyright © 2013, 2009, and 2007, Pearson Education, Inc. Placebo Effect Placebo effect (power of suggestion). The “placebo effect” is an improvement in health due not to any treatment but only to the patient’s belief that he or she will improve. In some experiments, a control group may receive an existing treatment rather than a placebo. 8 Copyright © 2013, 2009, and 2007, Pearson Education, Inc. Component 2: Randomization To have confidence in our results we should randomly assign subjects to the treatments. In doing so, we ▪ eliminate bias that may result from the researcher assigning the subjects. ▪ balance the groups on variables known to affect the response. ▪ balance the groups on lurking variables that may be unknown to the researcher. 9 Copyright © 2013, 2009, and 2007, Pearson Education, Inc. Component 3: Replication Replication is the process of assigning several experimental units to each treatment. ▪ The difference due to ordinary variation is smaller with larger samples. ▪ We have more confidence that the sample results reflect a true difference due to treatments when the sample size is large. ▪ Since it is always possible that the observed effects were due to chance alone, replicating the experiment also builds confidence in our conclusions. 10 Copyright © 2013, 2009, and 2007, Pearson Education, Inc. Blinding the Experiment ▪ Ideally, subjects are unaware, or blind, to the treatment they are receiving. ▪ If an experiment is conducted in such a way that neither the subjects nor the investigators working with them know which treatment each subject is receiving, then the experiment is double-blinded. ▪ A double-blinded experiment controls response bias from the subject and experimenter. 11 Copyright © 2013, 2009, and 2007, Pearson Education, Inc. Define Statistical Significance If an experiment (or other study) finds a difference in two (or more) groups, is this difference really important? If the observed difference is larger than what would be expected just by chance, then it is labeled statistically significant. Rather than relying solely on the label of statistical significance, also look at the actual results to determine if they are practically significant. 12 Copyright © 2013, 2009, and 2007, Pearson Education, Inc. Generalizing Results Recall that the goal of experimentation is to analyze the association between the treatment and the response for the population, not just the sample. However, care should be taken to generalize the results of a study only to the population that is represented by the study. 13 Copyright © 2013, 2009, and 2007, Pearson Education, Inc. SUMMARY: Key Parts of a Good Experiment ▪ A good experiment has a control comparison group, randomization in assigning experimental units to treatments, blinding, and replication. The experimental units are the subjects—the people, animals, or other objects to which the treatments are applied. ▪ The treatments are the experimental conditions imposed on the experimental units. One of these may be a control (for instance, either a placebo or an existing treatment) that provides a basis for determining if a particular treatment is effective. The treatments correspond to values of an explanatory variable. 14 Copyright © 2013, 2009, and 2007, Pearson Education, Inc. SUMMARY: Key Parts of a Good Experiment ▪ Randomize in assigning the experimental units to the treatments. This tends to balance the comparison groups with respect to lurking variables. ▪ Replicating the treatments on many experimental units helps, so that observed effects are not due to ordinary variability but instead are due to the treatment. Repeat studies to increase confidence in the conclusions. 15 Copyright © 2013, 2009, and 2007, Pearson Education, Inc..
Recommended publications
  • Introduction to Biostatistics
    Introduction to Biostatistics Jie Yang, Ph.D. Associate Professor Department of Family, Population and Preventive Medicine Director Biostatistical Consulting Core Director Biostatistics and Bioinformatics Shared Resource, Stony Brook Cancer Center In collaboration with Clinical Translational Science Center (CTSC) and the Biostatistics and Bioinformatics Shared Resource (BB-SR), Stony Brook Cancer Center (SBCC). OUTLINE What is Biostatistics What does a biostatistician do • Experiment design, clinical trial design • Descriptive and Inferential analysis • Result interpretation What you should bring while consulting with a biostatistician WHAT IS BIOSTATISTICS • The science of (bio)statistics encompasses the design of biological/clinical experiments the collection, summarization, and analysis of data from those experiments the interpretation of, and inference from, the results How to Lie with Statistics (1954) by Darrell Huff. http://www.youtube.com/watch?v=PbODigCZqL8 GOAL OF STATISTICS Sampling POPULATION Probability SAMPLE Theory Descriptive Descriptive Statistics Statistics Inference Population Sample Parameters: Inferential Statistics Statistics: 흁, 흈, 흅… 푿ഥ , 풔, 풑ෝ,… PROPERTIES OF A “GOOD” SAMPLE • Adequate sample size (statistical power) • Random selection (representative) Sampling Techniques: 1.Simple random sampling 2.Stratified sampling 3.Systematic sampling 4.Cluster sampling 5.Convenience sampling STUDY DESIGN EXPERIEMENT DESIGN Completely Randomized Design (CRD) - Randomly assign the experiment units to the treatments
    [Show full text]
  • Experimentation Science: a Process Approach for the Complete Design of an Experiment
    Kansas State University Libraries New Prairie Press Conference on Applied Statistics in Agriculture 1996 - 8th Annual Conference Proceedings EXPERIMENTATION SCIENCE: A PROCESS APPROACH FOR THE COMPLETE DESIGN OF AN EXPERIMENT D. D. Kratzer K. A. Ash Follow this and additional works at: https://newprairiepress.org/agstatconference Part of the Agriculture Commons, and the Applied Statistics Commons This work is licensed under a Creative Commons Attribution-Noncommercial-No Derivative Works 4.0 License. Recommended Citation Kratzer, D. D. and Ash, K. A. (1996). "EXPERIMENTATION SCIENCE: A PROCESS APPROACH FOR THE COMPLETE DESIGN OF AN EXPERIMENT," Conference on Applied Statistics in Agriculture. https://doi.org/ 10.4148/2475-7772.1322 This is brought to you for free and open access by the Conferences at New Prairie Press. It has been accepted for inclusion in Conference on Applied Statistics in Agriculture by an authorized administrator of New Prairie Press. For more information, please contact [email protected]. Conference on Applied Statistics in Agriculture Kansas State University Applied Statistics in Agriculture 109 EXPERIMENTATION SCIENCE: A PROCESS APPROACH FOR THE COMPLETE DESIGN OF AN EXPERIMENT. D. D. Kratzer Ph.D., Pharmacia and Upjohn Inc., Kalamazoo MI, and K. A. Ash D.V.M., Ph.D., Town and Country Animal Hospital, Charlotte MI ABSTRACT Experimentation Science is introduced as a process through which the necessary steps of experimental design are all sufficiently addressed. Experimentation Science is defined as a nearly linear process of objective formulation, selection of experimentation unit and decision variable(s), deciding treatment, design and error structure, defining the randomization, statistical analyses and decision procedures, outlining quality control procedures for data collection, and finally analysis, presentation and interpretation of results.
    [Show full text]
  • Clinical Research Methodology
    Indian Journal of Pharmaceutical Education and Research Association of Pharmaceutical Teachers of India Clinical Research Methodology Purvi Gandhi* Department of Pharmacology, B. S. Patel Pharmacy College, Mehsana, India. ABSTRACT Submitted: 29/5/2010 Revised: 29/8/2010 Accepted: 04/10/2010 Medical trials occupy a greater part of clinical trials and exceed in number over other types of clinical trials. Although clinical researches or studies other than those falling under the category of trial, lack the commercial aspect, they may contribute to the betterment of clinical practice and may constitute a base for large-scale commercial trials. Explanatory clinical studies are the most widely accepted and executed type of clinical researches/ trials. They explain not only the therapeutic aspects of a drug but also provide with a detailed description on adverse events and pharmacovigilance. Any new drug to be marketed first requires proving its safety, efficacy and the need over existing product range by passing through various phases of clinical trial that follows animal studies. For this reason, randomized controlled trials (RCTs) with placebo- control and blinding fashion is the only accepted form of clinical trials with few exceptions. Besides explanatory, descriptive clinical research is also useful for certain types of studies such as epidemiological research. While conducting RCTs on humans (either healthy volunteers or patients), various components of the trials viz. study design, patient population, control group, randomization, blinding or non-blinding, treatment considerations and outcome measures are important to strengthen the outcomes of the trial. Similarly, proper utilization of statistics, for sample-size calculation, data collection, compilation and analysis by applying proper statistical tests, signifies the outcomes of the clinical research.
    [Show full text]
  • Llovera 1..10
    RESEARCH ARTICLE STROKE Results of a preclinical randomized controlled multicenter trial (pRCT): Anti-CD49d treatment for acute brain ischemia Gemma Llovera,1,2 Kerstin Hofmann,1,2 Stefan Roth,1,2 Angelica Salas-Pérdomo,3,4 Maura Ferrer-Ferrer,3,4 Carlo Perego,5 Elisa R. Zanier,5 Uta Mamrak,1,2 Andre Rex,6 Hélène Party,7 Véronique Agin,7 Claudine Fauchon,8 Cyrille Orset,7,8 Benoît Haelewyn,7,8 Maria-Grazia De Simoni,5 Ulrich Dirnagl,6 Ulrike Grittner,9 Anna M. Planas,3,4 Nikolaus Plesnila,1,2 Denis Vivien,7,8 Arthur Liesz1,2* Numerous treatments have been reported to provide a beneficial outcome in experimental animal stroke models; however, these treatments (with the exception of tissue plasminogen activator) have failed in clinical trials. To improve the translation of treatment efficacy from bench to bedside, we have performed a preclinical randomized controlled multicenter trial (pRCT) to test a potential stroke therapy under circumstances closer to the design and rigor of a Downloaded from clinical randomized control trial. Anti-CD49d antibodies, which inhibit the migration of leukocytes into the brain, were previously investigated in experimental stroke models by individual laboratories. Despite the conflicting results from four positive and one inconclusive preclinical studies, a clinical trial was initiated. To confirm the preclinical results and to test the feasibility of conducting a pRCT, six independent European research centers investigated the efficacy of anti-CD49d antibodies in two distinct mouse models of stroke in a centrally coordinated, randomized, and blinded approach. The results pooled from all research centers revealed that treatment with CD49d-specific antibodies signif- http://stm.sciencemag.org/ icantly reduced both leukocyte invasion and infarct volume after the permanent distal occlusion of the middle cerebral artery, which causes a small cortical infarction.
    [Show full text]
  • Understanding Replication of Experiments in Software Engineering: a Classification Omar S
    Understanding replication of experiments in software engineering: A classification Omar S. Gómez a, , Natalia Juristo b,c, Sira Vegas b a Facultad de Matemáticas, Universidad Autónoma de Yucatán, 97119 Mérida, Yucatán, Mexico Facultad de Informática, Universidad Politécnica de Madrid, 28660 Boadilla del Monte, Madrid, Spain c Department of Information Processing Science, University of Oulu, Oulu, Finland abstract Context: Replication plays an important role in experimental disciplines. There are still many uncertain-ties about how to proceed with replications of SE experiments. Should replicators reuse the baseline experiment materials? How much liaison should there be among the original and replicating experiment-ers, if any? What elements of the experimental configuration can be changed for the experiment to be considered a replication rather than a new experiment? Objective: To improve our understanding of SE experiment replication, in this work we propose a classi-fication which is intend to provide experimenters with guidance about what types of replication they can perform. Method: The research approach followed is structured according to the following activities: (1) a litera-ture review of experiment replication in SE and in other disciplines, (2) identification of typical elements that compose an experimental configuration, (3) identification of different replications purposes and (4) development of a classification of experiment replications for SE. Results: We propose a classification of replications which provides experimenters in SE with guidance about what changes can they make in a replication and, based on these, what verification purposes such a replication can serve. The proposed classification helped to accommodate opposing views within a broader framework, it is capable of accounting for less similar replications to more similar ones regarding the baseline experiment.
    [Show full text]
  • Double Blind Trials Workshop
    Double Blind Trials Workshop Introduction These activities demonstrate how double blind trials are run, explaining what a placebo is and how the placebo effect works, how bias is removed as far as possible and how participants and trial medicines are randomised. Curriculum Links KS3: Science SQA Access, Intermediate and KS4: Biology Higher: Biology Keywords Double-blind trials randomisation observer bias clinical trials placebo effect designing a fair trial placebo Contents Activities Materials Activity 1 Placebo Effect Activity Activity 2 Observer Bias Activity 3 Double Blind Trial Role Cards for the Double Blind Trial Activity Testing Layout Background Information Medicines undergo a number of trials before they are declared fit for use (see classroom activity on Clinical Research for details). In the trial in the second activity, pupils compare two potential new sunscreens. This type of trial is done with healthy volunteers to see if the there are any side effects and to provide data to suggest the dosage needed. If there were no current best treatment then this sort of trial would also be done with patients to test for the effectiveness of the new medicine. How do scientists make sure that medicines are tested fairly? One thing they need to do is to find out if their tests are free of bias. Are the medicines really working, or do they just appear to be working? One difficulty in designing fair tests for medicines is the placebo effect. When patients are prescribed a treatment, especially by a doctor or expert they trust, the patient’s own belief in the treatment can cause the patient to produce a response.
    [Show full text]
  • Observational Studies and Bias in Epidemiology
    The Young Epidemiology Scholars Program (YES) is supported by The Robert Wood Johnson Foundation and administered by the College Board. Observational Studies and Bias in Epidemiology Manuel Bayona Department of Epidemiology School of Public Health University of North Texas Fort Worth, Texas and Chris Olsen Mathematics Department George Washington High School Cedar Rapids, Iowa Observational Studies and Bias in Epidemiology Contents Lesson Plan . 3 The Logic of Inference in Science . 8 The Logic of Observational Studies and the Problem of Bias . 15 Characteristics of the Relative Risk When Random Sampling . and Not . 19 Types of Bias . 20 Selection Bias . 21 Information Bias . 23 Conclusion . 24 Take-Home, Open-Book Quiz (Student Version) . 25 Take-Home, Open-Book Quiz (Teacher’s Answer Key) . 27 In-Class Exercise (Student Version) . 30 In-Class Exercise (Teacher’s Answer Key) . 32 Bias in Epidemiologic Research (Examination) (Student Version) . 33 Bias in Epidemiologic Research (Examination with Answers) (Teacher’s Answer Key) . 35 Copyright © 2004 by College Entrance Examination Board. All rights reserved. College Board, SAT and the acorn logo are registered trademarks of the College Entrance Examination Board. Other products and services may be trademarks of their respective owners. Visit College Board on the Web: www.collegeboard.com. Copyright © 2004. All rights reserved. 2 Observational Studies and Bias in Epidemiology Lesson Plan TITLE: Observational Studies and Bias in Epidemiology SUBJECT AREA: Biology, mathematics, statistics, environmental and health sciences GOAL: To identify and appreciate the effects of bias in epidemiologic research OBJECTIVES: 1. Introduce students to the principles and methods for interpreting the results of epidemio- logic research and bias 2.
    [Show full text]
  • Design of Experiments and Data Analysis,” 2012 Reliability and Maintainability Symposium, January, 2012
    Copyright © 2012 IEEE. Reprinted, with permission, from Huairui Guo and Adamantios Mettas, “Design of Experiments and Data Analysis,” 2012 Reliability and Maintainability Symposium, January, 2012. This material is posted here with permission of the IEEE. Such permission of the IEEE does not in any way imply IEEE endorsement of any of ReliaSoft Corporation's products or services. Internal or personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution must be obtained from the IEEE by writing to [email protected]. By choosing to view this document, you agree to all provisions of the copyright laws protecting it. 2012 Annual RELIABILITY and MAINTAINABILITY Symposium Design of Experiments and Data Analysis Huairui Guo, Ph. D. & Adamantios Mettas Huairui Guo, Ph.D., CPR. Adamantios Mettas, CPR ReliaSoft Corporation ReliaSoft Corporation 1450 S. Eastside Loop 1450 S. Eastside Loop Tucson, AZ 85710 USA Tucson, AZ 85710 USA e-mail: [email protected] e-mail: [email protected] Tutorial Notes © 2012 AR&MS SUMMARY & PURPOSE Design of Experiments (DOE) is one of the most useful statistical tools in product design and testing. While many organizations benefit from designed experiments, others are getting data with little useful information and wasting resources because of experiments that have not been carefully designed. Design of Experiments can be applied in many areas including but not limited to: design comparisons, variable identification, design optimization, process control and product performance prediction. Different design types in DOE have been developed for different purposes.
    [Show full text]
  • Comparison of Response Surface Designs in a Spherical Region
    World Academy of Science, Engineering and Technology International Journal of Mathematical and Computational Sciences Vol:6, No:5, 2012 Comparison of Response Surface Designs in a Spherical Region Boonorm Chomtee, John J. Borkowski Abstract—The objective of the research is to study and compare Where X is the design matrix, p is the number of model response surface designs: Central composite designs (CCD), Box- parameters, N is the design size, σ 2 is the maximum of Behnken designs (BBD), Small composite designs (SCD), Hybrid max designs, and Uniform shell designs (USD) over sets of reduced models f′′(x)( X X )−1 f (x) approximated over the set of candidate when the design is in a spherical region for 3 and 4 design variables. points. The values of the two criteria were calculated using The two optimality criteria ( D and G ) are considered which larger Matlab software [1]. values imply a better design. The comparison of design optimality criteria of the response surface designs across the full second order B. Reduced Models model and sets of reduced models for 3 and 4 factors based on the The set of reduced models is consistent with the definition two criteria are presented. of weak heredity given in Chipman [2]. That is, (i) a quadratic 2 Keywords—design optimality criteria, reduced models, response xi term is in the model only if the xi term is also in the model surface design, spherical design region and (ii) an interaction xi x j term is in the model only if the xi or x or both terms are also in the model.
    [Show full text]
  • A Randomized Control Trial Evaluating the Effects of Police Body-Worn
    A randomized control trial evaluating the effects of police body-worn cameras David Yokuma,b,1,2, Anita Ravishankara,c,d,1, and Alexander Coppocke,1 aThe Lab @ DC, Office of the City Administrator, Executive Office of the Mayor, Washington, DC 20004; bThe Policy Lab, Brown University, Providence, RI 02912; cExecutive Office of the Chief of Police, Metropolitan Police Department, Washington, DC 20024; dPublic Policy and Political Science Joint PhD Program, University of Michigan, Ann Arbor, MI 48109; and eDepartment of Political Science, Yale University, New Haven, CT 06511 Edited by Susan A. Murphy, Harvard University, Cambridge, MA, and approved March 21, 2019 (received for review August 28, 2018) Police body-worn cameras (BWCs) have been widely promoted as The existing evidence on whether BWCs have the anticipated a technological mechanism to improve policing and the perceived effects on policing outcomes remains relatively limited (17–19). legitimacy of police and legal institutions, yet evidence of their Several observational studies have evaluated BWCs by compar- effectiveness is limited. To estimate the effects of BWCs, we con- ing the behavior of officers before and after the introduction of ducted a randomized controlled trial involving 2,224 Metropolitan BWCs into the police department (20, 21). Other studies com- Police Department officers in Washington, DC. Here we show pared officers who happened to wear BWCs to those without (15, that BWCs have very small and statistically insignificant effects 22, 23). The causal inferences drawn in those studies depend on on police use of force and civilian complaints, as well as other strong assumptions about whether, after statistical adjustments policing activities and judicial outcomes.
    [Show full text]
  • Randomized Controlled Trials, Development Economics and Policy Making in Developing Countries
    Randomized Controlled Trials, Development Economics and Policy Making in Developing Countries Esther Duflo Department of Economics, MIT Co-Director J-PAL [Joint work with Abhijit Banerjee and Michael Kremer] Randomized controlled trials have greatly expanded in the last two decades • Randomized controlled Trials were progressively accepted as a tool for policy evaluation in the US through many battles from the 1970s to the 1990s. • In development, the rapid growth starts after the mid 1990s – Kremer et al, studies on Kenya (1994) – PROGRESA experiment (1997) • Since 2000, the growth have been very rapid. J-PAL | THE ROLE OF RANDOMIZED EVALUATIONS IN INFORMING POLICY 2 Cameron et al (2016): RCT in development Figure 1: Number of Published RCTs 300 250 200 150 100 50 0 1975 1980 1985 1990 1995 2000 2005 2010 2015 Publication Year J-PAL | THE ROLE OF RANDOMIZED EVALUATIONS IN INFORMING POLICY 3 BREAD Affiliates doing RCT Figure 4. Fraction of BREAD Affiliates & Fellows with 1 or more RCTs 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 1980 or earlier 1981-1990 1991-2000 2001-2005 2006-today * Total Number of Fellows and Affiliates is 166. PhD Year J-PAL | THE ROLE OF RANDOMIZED EVALUATIONS IN INFORMING POLICY 4 Top Journals J-PAL | THE ROLE OF RANDOMIZED EVALUATIONS IN INFORMING POLICY 5 Many sectors, many countries J-PAL | THE ROLE OF RANDOMIZED EVALUATIONS IN INFORMING POLICY 6 Why have RCT had so much impact? • Focus on identification of causal effects (across the board) • Assessing External Validity • Observing Unobservables • Data collection • Iterative Experimentation • Unpack impacts J-PAL | THE ROLE OF RANDOMIZED EVALUATIONS IN INFORMING POLICY 7 Focus on Identification… across the board! • The key advantage of RCT was perceived to be a clear identification advantage • With RCT, since those who received a treatment are randomly selected in a relevant sample, any difference between treatment and control must be due to the treatment • Most criticisms of experiment also focus on limits to identification (imperfect randomization, attrition, etc.
    [Show full text]
  • Interpreting Study Results: How Biased Am I? January 29, 2020
    WELCOME Interpreting Study Results: How Biased Am I? January 29, 2020 www.aacom.org/aogme Copyright © 2019 American Association of Colleges of Osteopathic Medicine. All Rights Reserved. HOUSEKEEPING NOTES • This webinar is being recorded, recording will be shared with participants and posted on the AOGME’s web page • Webinar participants are in listen-only mode • For technical issues, please use the chat feature and raise your hand and we will assist you • You may submit questions anytime during this live webinar using the chat feature, if time remains, questions will be addressed either during or at the end of the presentation. SPEAKERS Mark R. Speicher, PhD, MHA Senior Vice President for Medical Education and Research American Association of Colleges of Osteopathic Medicine (AACOM) Suporn Sukpraprut-Braaten, MSc, MA, PhD Graduate Medical Director of Research Unity Health In research, types of studies depend on the purpose of the study, data collection strategy, and other factors. Types of Study: Weaker Evidence I. Observational study (Cohort Study) 1.1 Cross-sectional study 1.2 Case-control study Prospective Observational Study 1.3 Observational study Retrospective Observational Study II. Non-randomized Controlled Trial Randomized Controlled Trial (Clinical Trial) . Phase I . Phase II . Phase III . Phase IV III. Systematic Review and Meta-analysis Stronger Evidence HIERARCHY OF RESEARCH EVIDENCE Strongest evidence Weakest evidence DIAGRAM 1 OVERVIEW OF TEST HYPOTHESES ANOVA – Analysis of variance ANCOVA – Analysis of covariance Source: Suporn Sukpraprut. Biostatistics: Specific Tests. American College of Preventive Medicine (ACPM) Board Review Course Material (Copyright) 6 DIAGRAM 2: TEST HYPOTHESES FOR CONTINUOUS OUTCOME Source: Suporn Sukpraprut.
    [Show full text]