Study Designs in Biomedical Research
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
The Very Process of Taking a Pill May Create Expectations in a Patient Which May Affect Reactions to the Pill
Ch 1 Pause for Thought Questions p. 36 1- Why is it important to use placebos and a double-blind approach in some studies? The very process of taking a pill may create expectations in a patient which may affect reactions to the pill. To help eliminate the role of patient expectation during testing, a placebo (or fake medicine) is used on subjects in a control group. A researcher’s expectations may also affect results. Therefore, double-blind studies are often used. In such studies, neither the researcher nor the participants know which group is which. 2- Assume that researchers find that people’s memories are sharpest right after they’ve eaten lunch. What hidden variables may have affected these results? Other variables that may play a role (hidden variables): Time of Day Type of food eaten Meaning of “lunch” - May mean “time away from work” - Subjective State of feeling free (not food) helps memory. Socializing at lunch may make a person more alert and then able to take-in more info and retain it longer. 3- How might you use the scientific method to study factors that affect obedience? Devise a simple study, and identify the following: hypothesis, subjects, independent variable, dependent variable, experimental group, and control group. Hypothesis: If employee fears/believes they will be punished if they don’t follow directives, then they will be obedient to directives of bosses/people in “higher” positions than themselves in the workplace. Subjects: Employees Independent Variable: Directive given with harsh consequences for not following through. Dependent Variable: Obedience (Level of) Experimental Group: Group with “harsh” bosses (very by the book; give extreme consequences) present during their work day. -
Removing Hidden Confounding by Experimental Grounding
Removing Hidden Confounding by Experimental Grounding Nathan Kallus Aahlad Manas Puli Uri Shalit Cornell University and Cornell Tech New York University Technion New York, NY New York, NY Haifa, Israel [email protected] [email protected] [email protected] Abstract Observational data is increasingly used as a means for making individual-level causal predictions and intervention recommendations. The foremost challenge of causal inference from observational data is hidden confounding, whose presence cannot be tested in data and can invalidate any causal conclusion. Experimental data does not suffer from confounding but is usually limited in both scope and scale. We introduce a novel method of using limited experimental data to correct the hidden confounding in causal effect models trained on larger observational data, even if the observational data does not fully overlap with the experimental data. Our method makes strictly weaker assumptions than existing approaches, and we prove conditions under which it yields a consistent estimator. We demonstrate our method’s efficacy using real-world data from a large educational experiment. 1 Introduction In domains such as healthcare, education, and marketing there is growing interest in using observa- tional data to draw causal conclusions about individual-level effects; for example, using electronic healthcare records to determine which patients should get what treatments, using school records to optimize educational policy interventions, or using past advertising campaign data to refine targeting and maximize lift. Observational datasets, due to their often very large number of samples and exhaustive scope (many measured covariates) in comparison to experimental datasets, offer a unique opportunity to uncover fine-grained effects that may apply to many target populations. -
Confounding Bias, Part I
ERIC NOTEBOOK SERIES Second Edition Confounding Bias, Part I Confounding is one type of Second Edition Authors: Confounding is also a form a systematic error that can occur in bias. Confounding is a bias because it Lorraine K. Alexander, DrPH epidemiologic studies. Other types of can result in a distortion in the systematic error such as information measure of association between an Brettania Lopes, MPH bias or selection bias are discussed exposure and health outcome. in other ERIC notebook issues. Kristen Ricchetti-Masterson, MSPH Confounding may be present in any Confounding is an important concept Karin B. Yeatts, PhD, MS study design (i.e., cohort, case-control, in epidemiology, because, if present, observational, ecological), primarily it can cause an over- or under- because it's not a result of the study estimate of the observed association design. However, of all study designs, between exposure and health ecological studies are the most outcome. The distortion introduced susceptible to confounding, because it by a confounding factor can be large, is more difficult to control for and it can even change the apparent confounders at the aggregate level of direction of an effect. However, data. In all other cases, as long as unlike selection and information there are available data on potential bias, it can be adjusted for in the confounders, they can be adjusted for analysis. during analysis. What is confounding? Confounding should be of concern Confounding is the distortion of the under the following conditions: association between an exposure 1. Evaluating an exposure-health and health outcome by an outcome association. -
Design of Prospective Studies
Design of Prospective Studies Kyoungmi Kim, Ph.D. June 14, 2017 This seminar is jointly supported by the following NIH-funded centers: Seminar Objectives . Discuss about design of prospective longitudinal studies . Understand options for overcoming shortcomings of prospective studies . Learn to determine how many subjects to recruit for a follow-up study What is a prospective study? Study subjects of disease‐free at enrollment are followed for a period of time and periodically checked for progress to see who/when gets the outcome in question ‐thus be able to establish a temporal relationship between exposure & outcome. What is a prospective study? During the follow‐up, data is collected on the factors of interest, including: •When the subject develops the condition •When they drop out of the study or become “lost” •When they exposure status changes •When they die Example: Framingham Study . An original cohort of 5,209 subjects from Framingham, MA between the ages of 30 and 62 years of age was recruited and followed up for 20 years. A number of hypotheses were generated and described by Dawber et al. in 1980 listing various presupposed risk factors such as increasing age, increased weight, tobacco smoking, elevated blood pressure and cholesterol and decreased physical activity. It is largely quoted as a successful longitudinal study owing to the fact that a large proportion of the exposures chosen for analysis were indeed found to correlate closely with the development of cardiovascular disease. Example: Framingham Study . Biases exist: – It was a study carried out in a single population in a single town, brining into question the generalizability and applicability of this data to different groups. -
Beyond Controlling for Confounding: Design Strategies to Avoid Selection Bias and Improve Efficiency in Observational Studies
September 27, 2018 Beyond Controlling for Confounding: Design Strategies to Avoid Selection Bias and Improve Efficiency in Observational Studies A Case Study of Screening Colonoscopy Our Team Xabier Garcia de Albeniz Martinez +34 93.3624732 [email protected] Bradley Layton 919.541.8885 [email protected] 2 Poll Questions Poll question 1 Ice breaker: Which of the following study designs is best to evaluate the causal effect of a medical intervention? Cross-sectional study Case series Case-control study Prospective cohort study Randomized, controlled clinical trial 3 We All Trust RCTs… Why? • Obvious reasons – No confusion (i.e., exchangeability) • Not so obvious reasons – Exposure represented at all levels of potential confounders (i.e., positivity) – Therapeutic intervention is well defined (i.e., consistency) – … And, because of the alignment of eligibility, exposure assignment and the start of follow-up (we’ll soon see why is this important) ? RCT = randomized clinical trial. 4 Poll Questions We just used the C-word: “causal” effect Poll question 2 Which of the following is true? In pharmacoepidemiology, we work to ensure that drugs are effective and safe for the population In pharmacoepidemiology, we want to know if a drug causes an undesired toxicity Causal inference from observational data can be questionable, but being explicit about the causal goal and the validity conditions help inform a scientific discussion All of the above 5 In Pharmacoepidemiology, We Try to Infer Causes • These are good times to be an epidemiologist -
Design of Engineering Experiments Blocking & Confounding in the 2K
Design of Engineering Experiments Blocking & Confounding in the 2 k • Text reference, Chapter 7 • Blocking is a technique for dealing with controllable nuisance variables • Two cases are considered – Replicated designs – Unreplicated designs Chapter 7 Design & Analysis of Experiments 1 8E 2012 Montgomery Chapter 7 Design & Analysis of Experiments 2 8E 2012 Montgomery Blocking a Replicated Design • This is the same scenario discussed previously in Chapter 5 • If there are n replicates of the design, then each replicate is a block • Each replicate is run in one of the blocks (time periods, batches of raw material, etc.) • Runs within the block are randomized Chapter 7 Design & Analysis of Experiments 3 8E 2012 Montgomery Blocking a Replicated Design Consider the example from Section 6-2 (next slide); k = 2 factors, n = 3 replicates This is the “usual” method for calculating a block 3 B2 y 2 sum of squares =i − ... SS Blocks ∑ i=1 4 12 = 6.50 Chapter 7 Design & Analysis of Experiments 4 8E 2012 Montgomery 6-2: The Simplest Case: The 22 Chemical Process Example (1) (a) (b) (ab) A = reactant concentration, B = catalyst amount, y = recovery ANOVA for the Blocked Design Page 305 Chapter 7 Design & Analysis of Experiments 6 8E 2012 Montgomery Confounding in Blocks • Confounding is a design technique for arranging a complete factorial experiment in blocks, where the block size is smaller than the number of treatment combinations in one replicate. • Now consider the unreplicated case • Clearly the previous discussion does not apply, since there -
Chapter 5 Experiments, Good And
Chapter 5 Experiments, Good and Bad Point of both observational studies and designed experiments is to identify variable or set of variables, called explanatory variables, which are thought to predict outcome or response variable. Confounding between explanatory variables occurs when two or more explanatory variables are not separated and so it is not clear how much each explanatory variable contributes in prediction of response variable. Lurking variable is explanatory variable not considered in study but confounded with one or more explanatory variables in study. Confounding with lurking variables effectively reduced in randomized comparative experiments where subjects are assigned to treatments at random. Confounding with a (only one at a time) lurking variable reduced in observational studies by controlling for it by comparing matched groups. Consequently, experiments much more effec- tive than observed studies at detecting which explanatory variables cause differences in response. In both cases, statistically significant observed differences in average responses implies differences are \real", did not occur by chance alone. Exercise 5.1 (Experiments, Good and Bad) 1. Randomized comparative experiment: effect of temperature on mice rate of oxy- gen consumption. For example, mice rate of oxygen consumption 10.3 mL/sec when subjected to 10o F. temperature (Fo) 0 10 20 30 ROC (mL/sec) 9.7 10.3 11.2 14.0 (a) Explanatory variable considered in study is (choose one) i. temperature ii. rate of oxygen consumption iii. mice iv. mouse weight 25 26 Chapter 5. Experiments, Good and Bad (ATTENDANCE 3) (b) Response is (choose one) i. temperature ii. rate of oxygen consumption iii. -
The Impact of Other Factors: Confounding, Mediation, and Effect Modification Amy Yang
The Impact of Other Factors: Confounding, Mediation, and Effect Modification Amy Yang Senior Statistical Analyst Biostatistics Collaboration Center Oct. 14 2016 BCC: Biostatistics Collaboration Center Who We Are Leah J. Welty, PhD Joan S. Chmiel, PhD Jody D. Ciolino, PhD Kwang-Youn A. Kim, PhD Assoc. Professor Professor Asst. Professor Asst. Professor BCC Director Alfred W. Rademaker, PhD Masha Kocherginsky, PhD Mary J. Kwasny, ScD Julia Lee, PhD, MPH Professor Assoc. Professor Assoc. Professor Assoc. Professor Not Pictured: 1. David A. Aaby, MS Senior Stat. Analyst 2. Tameka L. Brannon Financial | Research Hannah L. Palac, MS Gerald W. Rouleau, MS Amy Yang, MS Administrator Senior Stat. Analyst Stat. Analyst Senior Stat. Analyst Biostatistics Collaboration Center |680 N. Lake Shore Drive, Suite 1400 |Chicago, IL 60611 BCC: Biostatistics Collaboration Center What We Do Our mission is to support FSM investigators in the conduct of high-quality, innovative health-related research by providing expertise in biostatistics, statistical programming, and data management. BCC: Biostatistics Collaboration Center How We Do It Statistical support for Cancer-related projects or The BCC recommends Lurie Children’s should be requesting grant triaged through their support at least 6 -8 available resources. weeks before submission deadline We provide: Study Design BCC faculty serve as Co- YES Investigators; analysts Analysis Plan serve as Biostatisticians. Power Sample Size Are you writing a Recharge Model grant? (hourly rate) Short Short or long term NO collaboration? Long Subscription Model Every investigator is (salary support) provided a FREE initial consultation of up to 2 hours with BCC faculty of staff BCC: Biostatistics Collaboration Center How can you contact us? • Request an Appointment - http://www.feinberg.northwestern.edu/sites/bcc/contact-us/request- form.html • General Inquiries - [email protected] - 312.503.2288 • Visit Our Website - http://www.feinberg.northwestern.edu/sites/bcc/index.html Biostatistics Collaboration Center |680 N. -
Why Do We Need Longitudinal Survey Data?
HEATHER JOSHI University College London, UK Why do we need longitudinal survey data? Knowing people’s history helps in understanding their present state and where they are heading Keywords: life chances, inequality, mobility, gender, cohort, panel studies ELEVATOR PITCH Work experiences of men and women explain little of the Information from longitudinal surveys transforms gap in their hourly pay in the UK Cohorts snapshots of a given moment into something with a Born 1946 time dimension. It illuminates patterns of events within Age 26 31 an individual’s life and records mobility and immobility 43 Born 1958 between older and younger generations. It can track Age 23 33 the different pathways of men and women and people 42 of diverse socio-economic background through the life Born 1970 Gap explained by differences Age 26 in work experience & education course. It can join up data on aspects of a person’s life, 30 Unexplained gap 34 health, education, family, and employment and show how 0510 15 20 25 30 35 40 45 these domains affect one another. It is ideal for bridging Men’s pay minus women’s pay as % of men’s pay the different silos of policies that affect people’s lives. Source: [1]; Table 7.12. KEY FINDINGS Pros Cons Longitudinal surveys form a record of Longitudinal survey data are expensive to collect continuities and transitions of a life as they and challenging to analyze. happen, information not reliably gained through Data must be collected over a long timeframe to recollection or cross-section surveys. show relevant, long-term results. -
Internal Validity Page 1
Internal Validity page 1 Internal Validity If a study has internal validity, then you can be confident that the dependent variable was caused by the independent variable and not some other variable. Thus, a study with high internal validity permits conclusions of cause and effect. The major threat to internal validity is a confounding variable: a variable other than the independent variable that 1) often co-varies with the independent variable and 2) may be an alternative cause of the dependent variable. For example, if you want to investigate whether smoking cigarettes causes cancer, you will need to somehow control for other possible causes of cancer that tend to vary with smoking. Each of these other possible causes is a potential confounding variable. If people who smoke more also tend to experience greater stress, and stress is known to contribute to cancer, then stress could be a confounding variable. Not every variable that tends to co-vary with the independent variable is an equally plausible confounding variable. People who smoke may also strike more matches, but if striking matches is not plausibly linked to cancer in any way, then it is generally not worth considering as a serious threat to internal validity. Random assignment. The most common procedure to reduce the risk of confounding variables (and thus increase internal validity) is random assignment of participants to levels of the independent variable. This means that each participant in a study has an equal probability of being assigned to any of the levels of the independent variable. For the smoking study, random assignment would require some participants to be randomly assigned to smoke more than others. -
Causality, Confounding and the Counterfactual Framework
Causality, confounding and the counterfactual framework Erica E. M. Moodie Department of Epidemiology, Biostatistics, & Occupational Health McGill University Montreal, QC, Canada [email protected] Session goals • What is a cause, and what is causal inference? • How can causation be established? • How can we make the statistical study of causation formal? 2 Road map 1. Causality and etiology 2. The counterfactual framework I A causal model I Causal estimands 3. Confounding and exchangeability I Randomized trials I Confounding I Exchangeability 3 Causality • According to Miettinen & Karp (2012, p. 35), “Epidemiological research is, almost exclusively, concerned with etiology of illness”. • Knowledge of etiology, defined as (Miettinen 2011, p. 12) Concerning a case of an illness, or a rate of occurrence of an illness, its causal origin (in the case of a disease or defect, specifically, the causation of the inception and/or progression of its pathogenesis); also: concerning a sickness or an illness in general (in the abstract), its causal origin in general, is particularly important for the practice of epidemiology. 4 Causality Messerli (2012), New England Journal of Medicine 5 Causality 6 Causality 7 Causality • Some of the earliest, and best known, ideas in epidemiology on causality are the criteria for causality given by Sir Austin Bradford-Hill in 1965: 1. Strength 2. Consistency (reproducibility) 3. Specificity 4. Temporality 5. Biological gradient 6. Plausibility 7. Coherence 8. Experiment 9. Analogy • A group of minimal conditions needed to establish causality. • But are they all equally convincing? Sufficiently formal? 8 Causality • There is no agreement on the definition of causality, or even whether it exists in the objective physical reality. -
Confounding and Interaction What Is Confounding?
Confounding and interaction Biometry 755 Spring 2009 Confounding and interaction – p. 1/19 What is confounding? Confounding is a distortion of the true relationship between exposure and disease by the influence of one or more other factors. These “other factors” are known as confounders. Confounding variables are nuisance variables, in that they “get in the way” of the relationship of interest. It is therefore desirable to remove their effects. Confounding and interaction – p. 2/19 Identifying potential confounders Under what circumstances does a variable confound an exposure-disease relationship? 1. When the factor is associated with the exposure, but is not believed to be a result of the exposure. 2. When the factor is a risk-factor for the disease, in that it is either (a) a cause of the disease, (b) a correlate of the disease, or (c) influential in the recognition or diagnosis of the disease. Confounding and interaction – p. 3/19 Example A woman’s risk of breast cancer is directly correlated with her age at the time of birth of her first child. When evaluating the association between total number of births and breast cancer risk, should maternal age at first birth be controlled? Potential confounder Age at first birth Exposure Total number of births Disease Breast cancer Age at first birth (POT. CONF) is associated with total number of births (EXP), but age at first birth (POT. CONF) is not a result of total number of births (EXP). Age at first birth (POT. CONF) is a known risk-factor for BrCa (DIS). Therefore, we need to control for age at first birth (POT.