594 Postgrad Med J 2000;76:594–595 Postgrad Med J: first published as 10.1136/pmj.76.899.594 on 1 September 2000. Downloaded from Multiple choice questions in evidence based medicine

Wai-Ching Leung

Questions 1–3 Questions 4–7 A psychiatrist devised a short screening test for A total of 360 patients participated in a depression. An independent blind comparison randomised controlled trial designed to com- was made with a for diagnosis of pare the eVectiveness of drug X in reducing depression among 200 psychiatric outpatients. deaths with a placebo. Out of 120 patients in Among the 50 outpatients found to be the treatment group, 12 patients died within depressed according to the gold standard, 35 three years. Out of 240 patients in the control patients were positive for the test. Among 150 group, 48 patients died within three years. patients found not to be depressed according to the gold standard, 30 patients were found to be 4. The following measures for the risk of death positive for the test. within three years (correct to the nearest 1 decimal place) are true: (A) The event rate in the control group is 0.3 1. Corrected to the nearest decimal place: (B) The event rate in the treatment group is (A) The sensitivity was 80% 0.1 (B) The specificity was 80% (C) The (of treatment compared (C) The positive predictive value was 70% with control group) is 0.25 (D) The negative predictive value was 88.9% (D) The is 67% (to the (E) The of depression was 25% nearest %) A general practitioner decides to use the (E) The to prevent 1 screening test for his patients. The prevalence death is 10 of depression among his patients is estimated to be 5%. 5. The following measures used for evaluating the level of clinical significance are independent of the patient’s expected event rate: 2. The following measures are identical whether (A) Odd ratios the test is applied to general practice patients or to (B) Relative risks the psychiatric outpatients: (C) Relative risk reduction (A) Prevalence of depression (D) Absolute risk reduction (B) Sensitivity (E) Numbers needed to treat

(C) Specificity http://pmj.bmj.com/ (D) Positive predictive value (E) Negative predictive value 6. In a randomised controlled trial, the following Northern Region types of biases are reduced by randomisation: Public Health (A) Ascertainment Medicine Training 3. Applying to a patient seen in general practice (B) Scheme with a positive test: (C) Recall bias (A) The pre-test for depression is 1 in (D) Publication bias Correspondence to:

Dr Wai-Ching Leung, 20 (E) Bias in handling dropouts on September 28, 2021 by guest. Protected copyright. and Public (B) The pre-test for depression is Health, 1st floor, Milvain 1in19 7. The conclusions of a meta-analysis may be Building, Newcastle General Hospital, Westgate Road, (C) The likelihood ratio for a positive test is rendered invalid by: Newcastle-upon-Tyne 3.5 (A) Clinical heterogeneity NE4 6BE, UK (email: (D) The post-test odds for depression is 7 in (B) Statistical heterogeneity [email protected]) 38 (C) Database bias Submitted 1 February 2000 (E) The post-test probability for depression is (D) Symmetrical funnel plot Accepted 19 April 2000 7in45 (E) English language bias

www.postgradmedj.com Multiple choice questions 595 Postgrad Med J: first published as 10.1136/pmj.76.899.594 on 1 September 2000. Downloaded from

Table 1 A 2 × 2 table 5. (A) true, (B) true, (C) true, (D) false, (E) false Depression , relative risk, and relative risk Present Absent reduction are independent of the patient’s expected event rate. These measures quoted in Test +353065studies are directly applicable to any group of − 15 120 135 patients. However, the absolute risk reduction 50 150 200 increases, while the numbers needed to treat decreases, with patient’s expected event rate. Answers 1. (A) false, (B) true, (C) false, (D) true, (E) true 6. (A) false, (B) true, (C) false, (D) false, (E) A2×2 table can be constructed as shown in false table 1. Subjects are randomised in a randomised con- Sensitivity = the proportion of subjects with trolled trial to ensure that the groups are iden- the correctly diagnosed by the test = tical apart from the intervention. Randomisa- 35/50 = 70%. Specificity = the proportion of tion that each subject has a subjects without the disease correctly excluded predetermined chance of being allocated to by the test = 120/150 = 80%. Positive each group, but the group to be allocated can- predictive value = the proportion of subjects not be predicted. This will minimise any selec- with a positive test who have the disease = tion bias. Ascertainment bias occurs when the 35/65 = 53.8%. Negative predictive value = the results of a trial are systematically distorted by proportion of subjects with a negative test who knowledge of which intervention each partici- do not have the disease = 120/135 = 88.9%. pant is receiving. This type of bias is minimised Prevalence of depression = 50/200 = 25% by blinding of researchers, clinicians, and patients. Bias caused by dropouts occur 2. (A) false, (B) true, (C) true, (D) false, (E) because characteristics of subjects who left the false trial before completion may be diVerent from The prevalence of depression in general those who do not. This type of bias is practice (5%) is lower than among the psychi- minimised by appropriate analysis (for exam- atric outpatients (25%). Sensitivity and specifi- ple, intention to treat analysis, worst case city are characteristics of a diagnostic test and scenario analysis). Recall bias occurs when the do not change with prevalence of the popula- subjects’ recall of past events is distorted by tion. Positive predictive value increases with subsequent events. This type of bias occurs the prevalence, while negative predictive value mainly in retrospective studies (for example, decreases with the test. case control studies) rather than randomised controlled trials. Publication bias occurs dur- 3. (A) false, (B) false, (C) true, (D) true, (E) ing the dissemination of the results. true

Odds is the ratio of events to non-events. A http://pmj.bmj.com/ prevalence of 5% means that for every patient 7. (A) true, (B) true, (C) true, (D) false, (E) who is depressed, there are 19 non-depressed true patients. Hence, the pre-test odds is 1 in 19. The conclusions of a meta-analysis may be The pre-test probability is 1 in 20. The rendered invalid if the results in the primary likelihood ratio for a positive test is a trials are statistically incompatible with one characteristic of the test and does not change another (statistical heterogeneity) or if the with prevalence. Likelihood ratio = sensitivity/ research participants diVer significantly from

(1−specificity) = 70%/(1−80%) = 3.5. one another (clinical heterogeneity). If statisti- on September 28, 2021 by guest. Protected copyright. Post-test odds = pre-test odds × likelihood cal or clinical heterogeneity occur, the results in ratio for positive test = 1/19 × 3.5=7in38. the primary trials cannot be validly combined Hence, post-test probability=7in(7+38) = 7 together mathematically. Bias may also occur if in 45. the selection of primary studies is incomplete and biased. This occurs mainly because 4. (A) false, (B) true, (C) false, (D) false, (E) compared with studies with negative results, true studies with positive results are more likely to Event rate in the control group (CER) = be published, published in English, and appear 48/240 = 0.2. in databases. The funnel plot may be used to Event rate in the experimental group (EER) = assess the presence of publication bias.1 The 12/120 = 0.1. sample size of each primary study is plotted Absolute risk reduction (ARR) = CER−EER against its eVect size. An asymmetrical funnel = 0.2−0.1 = 0.1. plot suggests that publication bias is present. Relative risk reduction (RRR) = ARR/CER = 0.1/0.2 = 50%. 1 Egger M, Smith GD, Schneider M, et al. Bias in Numbers needed to treat (NNT) = 1/ARR meta-analysis detected by a simple, graphical test. BMJ = 10. 1997;315:629–34.

www.postgradmedj.com