Practical Aspects of Signal Detection in Pharmacovigilance
Total Page:16
File Type:pdf, Size:1020Kb
CIOMS Practical Aspects of Signal Detection CIOMS publications may be obtained directly from CIOMS, c/o World Health Organization, Avenue Appia, 1211 Geneva 27, Practical Switzerland or by e-mail to [email protected] Aspects of Signal Both CIOMS and WHO publications are distributed by the World Health Organization, Marketing and Dissemination, Detection in Avenue Appia, 1211 Geneva 27, Switzerland and are available from booksellers through the network of WHO sales agents. Pharmacovigilance A list of these agents may be obtained from WHO by writing to the above address. Report of CIOMS Working Group VIII in Pharmacovigilance 2010 Geneva 2010 ggroup8_COVER.inddroup8_COVER.indd 1 009.06.109.06.10 111:111:11 PRACTICAL ASPECTS OF SIGNAL DETECTION IN PHARMACOVIGILANCE Report of CIOMS Working Group VIII Geneva 2010 ggroup8.inddroup8.indd 1 009.06.109.06.10 111:121:12 Copyright © 2010 by the Council for International Organizations of Medical Sciences (CIOMS) ISBN 92 9036 082 8 ggroup8.inddroup8.indd 2 009.06.109.06.10 111:121:12 Acknowledgements he Council for International Organizations of Medical Sciences (CIOMS) gratefully T acknowledges the contributions of the members of the CIOMS Working Group VIII on Practical Aspects of Signal Detection in Pharmacovigilance. Moreover, CIOMS recognizes the generous support of the drug regulatory authorities, pharmaceutical companies and other organizations and institutions which provided their expertise and the resources that resulted in this publication. Each member participated actively in the discussions, drafting and redrafting of texts and their review, which enabled the Work- ing Group to bring the entire project to a successful conclusion. CIOMS thanks especially those members who chaired the meetings of the Work- ing Group VIII for their dedication and capable leadership. Each of the meetings had a nominated rapporteur and CIOMS acknowledges their professional contributions. The editorial group, comprising Drs June Raine, Philippe Close, Gerald Dal Pan, Ralph Edwards, Bill Gregory, Manfred Hauben, Atsuko Shibata, June Almenoff, Lynn Macdonald and Stephen Klincewicz, merits special mention and thanks. CIOMS wishes to express special appreciation to Dr June Raine as Chief Editor of the fi nal report. The contribution by the CIOMS/WHO Working Group on Vaccine Pharmacovigi- lance of the Points to Consider in Appendix 5 is gratefully acknowledged. CIOMS and the Working Group are grateful for important input received on sev- eral points of the report from senior experts outside the Group who made valuable suggestions: Professor Stephen Evans, Dr Toshiharu Fujita, Dr David Madigan, Dr Niklas Norén, Dr Hironori Sakai, Professor Saad Shakir, Dr Hugh Tilson and Dr Patrick Waller. Geneva, December 2009 Gottfried Kreutz, Juhana E. Idänpään-Heikkilä, Dr. med., Dipl.-Chem. MD, PhD, Professor Secretary-General, CIOMS Senior Adviser, CIOMS 3 ggroup8.inddroup8.indd 3 009.06.109.06.10 111:121:12 4 ggroup8.inddroup8.indd 4 009.06.109.06.10 111:121:12 Table of Contents Preface .................................................................................................................... 7 I Introduction and scope of CIOMS VIII ............................................................... 9 II Background – pharmacovigilance and key defi nitions ....................................... 13 a. Need for pharmacovigilance after regulatory approval..................................... 13 b. Defi nition of pharmacovigilance ....................................................................... 14 c. Defi nition and taxonomy of drug safety signals ............................................... 14 d. Conclusions and recommendations .................................................................. 16 III Overview of approaches to signal detection ........................................................ 19 a. Traditional approaches ...................................................................................... 20 b. Emergence of statistical data mining methods.................................................. 21 c. Conceptual framework for integrating traditional and statistical data mining methods ......................................................................................... 22 d. Interpretation of data mining results within an integrated approach ................ 23 e. Conclusions and recommendations .................................................................. 23 IV Spontaneously reported drug safety-related information .................................. 25 a. Defi nitions of adverse event and reaction ......................................................... 25 b. Data elements in a spontaneous reporting system ............................................ 25 c. Mechanisms for reporting ................................................................................. 27 d. Patient and consumer reporting ........................................................................ 28 e. Limitations and challenges of spontaneous data ............................................... 30 f. Reporting in special populations ...................................................................... 32 g. Conclusions and recommendations .................................................................. 32 V Databases that support signal detection .............................................................. 35 a. Spontaneous reporting databases ...................................................................... 36 b. Other datasets that can be used for signal detection ......................................... 37 c. Data quality ....................................................................................................... 39 d. Pharmacoepidemiology resources .................................................................... 39 e. Conclusions and recommendations .................................................................. 40 VI Traditional methods of signal detection ............................................................... 43 a. Case and case series review .............................................................................. 43 b. Simple analyses of larger datasets .................................................................... 45 c. Conclusions and recommendations .................................................................. 47 VII More complex quantitative signal detection methods ......................................... 49 a. History .............................................................................................................. 49 b. Disproportionality analysis – general concepts and caveats ............................. 49 c. Theory of disproportionality analysis ............................................................... 53 • Basic methodologies and metrics ................................................................ 53 • Bayesian methodologies .............................................................................. 55 • Frequentist versus Bayesian approaches ..................................................... 59 • Evaluating data mining performance .......................................................... 59 d. Disclosure and review of potential confl ict of interest ..................................... 62 e. Conclusions and recommendations .................................................................. 62 VIII How to develop a signal detection strategy .......................................................... 67 a. Stakeholder perspectives ................................................................................... 67 • Expectations of consumers ......................................................................... 67 • Expectations of prescribers ......................................................................... 68 • Expectations of government regulators ....................................................... 68 • Expectations for pharmaceutical companies (sponsors) ............................. 68 b. Regulatory considerations and international guidance ..................................... 69 5 ggroup8.inddroup8.indd 5 009.06.109.06.10 111:121:12 • Pre-marketing signal detection ................................................................... 69 • Post-marketing surveillance ........................................................................ 70 c. Value added for integrating data mining methods into a signal detection program .... 70 d. Practical, technical and strategic points to consider ......................................... 71 • Selection of data types and sources ............................................................ 71 • Attributes of the data ................................................................................... 73 • Attributes of drugs under monitoring ......................................................... 75 • Attributes of patient populations under monitoring .................................... 76 • Choosing specifi cations for a quantitative signalling approach .................. 76 e. Operational model and organizational infrastructure ....................................... 79 • Guiding principles ....................................................................................... 79 • Design and implementation of data management systems ......................... 79 f. Quality assurance for the signal detection program .......................................... 82 • Guiding principles ......................................................................................