The Practice of Causal Inference in Cancer Epidemiology
Total Page:16
File Type:pdf, Size:1020Kb
Vol. 5. 303-31 1, April 1996 Cancer Epidemiology, Biomarkers & Prevention 303 Review The Practice of Causal Inference in Cancer Epidemiology Douglas L. Weedt and Lester S. Gorelic causes lung cancer (3) and to guide causal inference for occu- Preventive Oncology Branch ID. L. W.l and Comprehensive Minority pational and environmental diseases (4). From 1965 to 1995, Biomedical Program IL. S. 0.1. National Cancer Institute, Bethesda, Maryland many associations have been examined in terms of the central 20892 questions of causal inference. Causal inference is often practiced in review articles and editorials. There, epidemiologists (and others) summarize evi- Abstract dence and consider the issues of causality and public health Causal inference is an important link between the recommendations for specific exposure-cancer associations. practice of cancer epidemiology and effective cancer The purpose of this paper is to take a first step toward system- prevention. Although many papers and epidemiology atically reviewing the practice of causal inference in cancer textbooks have vigorously debated theoretical issues in epidemiology. Techniques used to assess causation and to make causal inference, almost no attention has been paid to the public health recommendations are summarized for two asso- issue of how causal inference is practiced. In this paper, ciations: alcohol and breast cancer, and vasectomy and prostate we review two series of review papers published between cancer. The alcohol and breast cancer association is timely, 1985 and 1994 to find answers to the following questions: controversial, and in the public eye (5). It involves a common which studies and prior review papers were cited, which exposure and a common cancer and has a large body of em- causal criteria were used, and what causal conclusions pirical evidence; over 50 studies and over a dozen reviews have and public health recommendations ensued. Fourteen appeared. The association between vasectomy and prostate published reviews on alcohol and breast cancer and 6 cancer also involves a common exposure and a common cancer. published reviews on vasectomy and prostate cancer were It is a relatively recent controversy with a smaller empirical examined. For both series of reviews, nearly all available literature and relatively few reviews. published studies were cited except for ecological studies The intent of this “review of reviews” is not to criticize and prior reviews. Sources of causal criteria were often individual reviewers nor to make judgments regarding associ- not provided. When they appeared, all citations were ations. The limitations of making summary statements from either the 1964 Surgeon General’s report or works of small selected samples are recognized. Recommendations for Austin Bradford Hill. Reviews often excluded and possible improvements to the practice of causal inference are sometimes altered criteria without giving reasons for offered. These are based upon the summary findings and upon these changes. The criteria of consistency and strength of our understanding of two areas of related research: the methods association were almost always used accompanied by and theory of causal inference and the scientific quality of dose-response and biological plausibility in a majority of review papers. reviews. The criterion of temporality, considered by many methodologists to be a necessary causal condition, was infrequently used. Confounding and bias were often Materials and Methods added considerations. Public health recommendations were not discussed in nearly one-half of the reviews. The MEDLINE and CANCERLIT data bases were searched from 1977 through June 1994, using the keywords “alcohol and breast cancer” and “vasectomy and prostate cancer.” Reference Introduction lists of primary research studies and reviews identified were What causes cancer? How much and what kinds of evidence perused for mention of relevant articles. Tables of contents lead to causal conclusions? When should public health recom- from major medical, cancer, public health, and epidemiology mendations be made? These are central questions of causal journals available at the libraries of the NIH were also inference in cancer epidemiology. Causal inference has been an examined. important methodological focus for at least half a century (1, 2). For both associations, three types of review papers were A classic point of reference is the mid- I 960s, when two papers, found: editorials in which a review of existing literature was one by a committee appointed by the Surgeon General (3) and included and either cause or public health recommendations the other by Austin Bradford Hill (4), listed what are usually were considered, reviews devoted to the specific association, called causal criteria. These criteria are shown in Table I . At and “mini-reviews” subsumed within reviews of more general the time, they were used to support the claim that smoking issues. Typically, these mini-reviews were relatively brief sec- tions in papers on alcohol and cancer, diet and cancer, breast (and prostate) cancer epidemiology, and male sterilization. Received 5/23/95; revised I 2/4/95; accepted I 2/5/95. Only editorials and reviews devoted solely to the specific The costs of publication of this article were defrayed in part by the payment of associations are included in this paper, with one exception, an page charges. This article must therefore be hereby marked advertisement in IARC monograph on alcohol and cancer with a review of the accordance with 18 U.S.C. Section 1734 solely to indicate this fact. alcohol and breast cancer literature (6). To whom requests for reprints should be addressed, at National Cancer Institute, EPS T-4I, 9000 Rockville Pike, Bethesda, MD 20892. Phone: (301) 496-8640; Editorials and reviews are subsequently referred to as Fax: (3))l ) 402-0863. “reviews.” For each, the following questions were addressed: Downloaded from cebp.aacrjournals.org on September 27, 2021. © 1996 American Association for Cancer Research. .304 Review: Causal Inference in Cancer Epidemiology Table I Causal criteria as described by A. B. Hill (4) and by the Surgeon (3); in both, the original five criteria were used. The remaining General’s committee (3) four reviews cited works of Austin Bradford Hill (4, 97). In only one instance was a list of nine criteria used in the assess- Consistency” ment (80), although “epidemiological sense” replaced the cri- Strength” Dose-response tenon ofcoherence ofHill. Chu (76) cited Hill (4) but used only Biological plausibility four of his nine criteria: consistency, strength, biological cred- Specificity” ibility (i.e., plausibility), and experimentation. Longnecker (63) Temporality” also cited Hill (4) and used a subset comprising consistency, Experimentation strength, dose-response, and biological plausibility. Lowenfels Coherence’ et a!. (75) cited Hill (97) and used five criteria. In the eight Analogy reviews in which no source for criteria is cited, the number of “ Criteria described by the Surgeon General’s committee (3). criteria used varied from one (consistency; Ref. 72) to six of the original nine of Hill (4, 77). Overall Use of Causal Criteria and Other Considerations. Because the 1964 Surgeon General’s list ofcausal criteria form K Which studies are included? (Asked as a check for a subset of the 1965 criteria of Hill, and because reviewers systematic exclusion.) citing no source nevertheless used many of the same criteria, ( Which causal criteria are used and what sources for the overall use of criteria can be examined. Table 3 shows that these criteria are cited? the criterion of consistency was always used and strength of ( Are other considerations (e.g. , study design, bias, and association was nearly always used in this series of reviews. confounding) featured? Dose-response and biological plausibility were also used rela- ( What causal conclusions and public health recommen- tively frequently. In only 4 of 14 reviews was the criterion of dations are made? temporality discussed. The need for a randomized trial and its K What is the relationship of a conclusion or recommen- ethical and practical feasibility was considered in 3 of the 14 dation to the results of original research studies published by reviews. Coherence and analogy were rarely used. Table 2 the same author? reveals that bias (7 of 14) and confounding (I I of 14) were the K Do reviewers cite the methods, conclusions, or recom- most common additional considerations in this series. mendations of earlier reviews? Causal Conclusions. The question of cause was addressed in 10 of 14 reviews. None claimed cause. Conclusions included Results reasonably clear rejections of the idea (78, 80, 81) and those Akohol and Breast Cancer that left the issue undecided (70, 73, 74, 77, 82). Two reviewers The consumption of alcoholic beverages has been linked with appeared to lean in the direction of concluding cause. Long- breast cancer since 1974 (7). In the ensuing two decades, ecolog- necker (63) for example, argued that the “evidence appears to ical studies (8-1 1), case-control studies (12-50), and cohort stud- be growing stronger. “ Hiatt (79) argued that the data were “not ies (5 1-60) have been published, representing a total ofjust over yet sufficient to conclude .. causation.” 50 studies. Metaanalyses have also appeared (61-63). Reports Public Health Recommendations. Public health recommen- from a workshop (64-67) and papers discussing aspects of pub- dations were addressed in 8 of 14 reviews.