Methodological Challenges in Post-Licensure Vaccine Safety Studies Using Large Routinely Collected Datasets

Total Page:16

File Type:pdf, Size:1020Kb

Methodological Challenges in Post-Licensure Vaccine Safety Studies Using Large Routinely Collected Datasets Methodological challenges in post-licensure vaccine safety studies using large routinely collected datasets by Julia Margaret Toffa-Stowe A thesis submitted in partial fulfilment of the requirements of the Manchester Metropolitan University for the degree of Doctor of Philosophy by Published Work (Route 2) Manchester Metropolitan University 2017 Table of Contents 1. Abstract 2. Acknowledgments 3. Introduction 3.1 Vaccine safety concerns past and present 3.2 Routinely collected health data 3.3 Pre-Licensure 3.4 Post-Licensure 3.4.1 Signal detection 3.4.2 Signal Strengthening 3.4.3 Individual Causality Assessment 3.4.4 Hypothesis Testing 3.4.5 Statistical Methods 3.5 Ethical and Legal framework 3.6 Summary 4. Critical account of Published Works 4.1 Study 1: Intussusception / Rotavirus vaccination 4.2 Study 2: Narcolepsy in adults / Pandemic Influenza vaccine 4.3 Study 3: Convulsions / Pandemic and Seasonal Influenza vaccine 4.4 Study 4: Bacterial and Viral Infections / Measles Mumps and Rubella vaccine 4.5 Study 5: Guillain-Barré syndrome / Seasonal Influenza vaccine 4.6 Study 6: Idiopathic Thrombocytopenic Purpura / second dose of Measles Mumps and Rubella Vaccine 4.7 Study 7: Bell’s Palsy / Seasonal Influenza vaccine 5. Methodological Challenges in Post-Licensure Vaccine Safety Studies 5.1 Setting up the study 5.2 Study design and dealing with confounding 5.3 Case identification 5.4 Defining index data 5.5 Cleaning Data 5.6 Media attention 5.7 Validation 5.8 Publication 5.9 The communication of risk 6. Conclusions 7. Published works 8. References 9. Tables 10. Appendix 1 List of abbreviations BMJ British Medical Journal CHIS Child Health Information System CTV Clinical Terms Version DTP Diphtheria, Tetanus, Pertussis Vaccine EHR Electronic Health Record EMA European Medicines Agency FDA Food and Drug Administration GBS Guillain-Barre syndrome GP General Practitioner GRPD General Practice Research Database HES Hospital Episode Statistics HPA Health Protection Agency HPV Human Papillomavirus HSCIC Health and Social Care Information Centre ICD International Classification of Diseases ICSD International Classification of Sleep Disorders ITP Idiopathic Thrombocytopenia Purpura MHRA Medicines and Healthcare Products Regulatory Agency MMR Measles, Mumps and Rubella Vaccine MSLT Multi Sleep Latency Test NHS National Health Service OPCS Classification of Intervention and Procedures PbR Payment by Results PHE Public Health England PRISM Post-Licensure Rapid Immunization Safety Monitoring Program QOF Quality Outcomes Framework SCCS Self-Controlled Case-Series VAERS The Vaccine Adverse Event Reporting System VSD Vaccine Safety Datalink WHO World Health Organisation 2 Glossary Reports which have been proactively sought. Registers and Active Reporting data linkage techniques can be used to identify adverse events. An event which follows the administration of a drug or a Adverse event vaccine but is not necessarily caused by that event Reports where no active measures have been taken to Passive reporting encourage the reporting of safety concerns Activities relating to the detection, assessment, understanding Pharmacovigilance and prevention of adverse effects Part of the healthcare system which is accessed through a patient’s general practice surgery which can be the first point Primary care of contact for patients. The GP coordinates day to day and ongoing care that a patient may need. Electronic data that is collected for purposes other than for Routinely collected data scientific research. An example of this is the hospital administration database which schedules appointments. Services that are based at hospital and patient access the Secondary care services either by Accident and Emergency departments or by referral from General Practice or other specialities. The suggestion of a relationship between a drug/vaccine and a condition which has not been documented previously. The Signal information should be from multiple sources and judged to be sufficient for further investigation 3 1. Abstract Robust and responsive epidemiological post-licensure vaccine safety studies are the backbone to having confidence in a vaccination programme. Consideration must be given to the unique methodological challenges inherent when assessing a potential causal association between a vaccine and the condition of interest; these can be present from setting up the study through to communicating the results. Public Health England (PHE) has addressed a number of vaccine safety concerns since the 1990’s using routinely collected healthcare data and methods specific to the disease and vaccine under scrutiny. This thesis comprises of seven published post-licensure vaccine safety studies which were carried out in response to a number of different pertinent safety concerns relevant to the UK’s immunisation schedule. As a background to these studies the history of routinely collected data is examined in the context of how we use the data today along with a description of the pre and post-licensure vaccine safety activities which often precede the epidemiological studies. By bringing together the methodological issues of these seven studies and demonstrating the different ways in which these issues have been handled it has created a blueprint for addressing vaccine safety concerns in the future. The seven studies are i) Intussusception and Rotavirus vaccination ii) Narcolepsy in adults and Pandemic Influenza vaccine iii) Convulsions and Pandemic and Seasonal Influenza vaccine iv) Bacterial and Viral Infections and Measles Mumps and Rubella vaccine v) Guillain-Barré syndrome and Seasonal Influenza vaccine vi) Idiopathic Thrombocytopenic Purpura and the second dose of Measles Mumps and Rubella vaccine vii) Bell’s Palsy and Seasonal Influenza vaccine. In conclusion the methodological approaches employed in these studies can be used in the future to assess potential adverse events and the access to routinely collected health data is an essential element of this. 4 2. Acknowledgements First and foremost I would like to thank Professor Liz Miller and Professor Nick Andrews who have been wonderful mentors and roles models for me over the years. Both are immensely knowledgeable, kind and patient and have always given me the opportunity to be involved in the great many challenging and exciting studies on vaccine safety which has allowed me to develop in my work. I would also like to thank Professor Brent Taylor for my first experiences in this field and for his humour, expertise and support throughout the years. I will be forever thankful to Angela Bridge for introducing me to the wonders of hospital data and for teaching me so much. I would like to especially acknowledge my co-authors from the seven papers that make this thesis, for all their individual expertise and their contributions to these studies. My grateful thanks go to Dr Kath Whitehead and Professor Ray Borrow from MMU who have steered me in the right direction during my time with the university. Profound gratitude goes to my husband Dr Samuel Toffa who has always encouraged me to pursue my career and has made it possible for me to complete this work over the past ten years. Finally special thanks go to my parents for their unfailing support in whatever I do in my life. I would also like to thank Florence and William who everyday inspire me to strive towards my goal. 5 3. Introduction The safety of vaccines attracts great interest from both public and scientific communities through media stories and scientific debate. Established methods are in place to assess the safety of vaccines from the development stage through to the pharmacovigilance activities after licensure. These post-licensure activities range from the passive reporting of adverse events to full epidemiological studies to quantify a risk. Key to the post-licensure epidemiological safety study is the ability to identify and use the appropriate data and methods. This thesis will present seven epidemiological studies that were carried out by Public Health England from 2006 to 2016 and use a number of different data sources and methods which all address pertinent vaccine safety concerns. Chapter 3 briefly describes the history of vaccine safety and its relevance today, the data sources and statistical methods used in the studies and their development and also discuss the ethical and legal frame work which is so critical in the ability to carry out this work. Chapter 4 summarises the seven published studies which this thesis is based on and presents a systematic review of the published evidence on each adverse event under study at the time the research was carried out. Chapter 5 discusses the methodical challenges from setting up a study to communicating the results. This includes a discussion on the many sources of potential bias that are possible when studying such complex conditions in challenging settings and the statistical methods developed to address specific issues in vaccine safety. 3.1 Vaccine safety concerns past and present There is no doubt that vaccination is one of the most significant health interventions ever developed, successfully controlling many serious diseases and saving countless lives globally. However, as with any medical treatment or drug, vaccination can never be risk-free in terms of unwanted side-effects. Another important factor unique to vaccination is that 6 unlike therapeutic drugs, vaccines are given prophylactically to healthy individuals, often young children. From the patient’s or parent’s perspective this changes the benefit to harm balance as the possibility and consequences of a certain serious adverse event occurring outweighs the benefits of being protected by the vaccine from a disease which they know little about. For example, a patient would accept a high incidence of drug-related morbidity in the treatment of cancer but would not tolerate anywhere near this level of distress from a vaccination for a disease which they think will never affect them. The assessment of the risk from an event occurring shortly after vaccination may be incorrect as there may be events that occur in time shortly after vaccination, which would have happened by chance without vaccination.
Recommended publications
  • Response from NHS Digital
    1 Trevelyan Square Boar Lane Leeds LS1 6AE FAO: Joanne Andrews North East Kent Coroners Cantium House Country Hall Sandling Road Maidstone Kent ME14 1XD By Email Only: [email protected] Your ref: Our ref: 4 February 2021 Dear Ms Andrews Inquest into the death of Mr Ronald Richard Tilley I am writing in response to the Regulation 28 report received from HM Coroner dated 4 December 2020. This follows the death of Ronald Richard Tilley, who sadly died on 23 October 2019. This was followed by an investigation and inquest which concluded on 29 October 2020. I would like to express my sincerest condolences to Mr Tilley’s family. NHS Digital provided written statements in advance of the inquest, but did not attend the inquest. NHS Digital is a non-departmental public body created by the Health and Social Care Act 2012 and is the national information and technology partner for the health and care system. We use technology to support the NHS and social care. NHS Digital operates and maintains the Personal Demographics Service (‘PDS’) under the Spine Services No.2 Directions issued by the Secretary of State for Health and Social Care to maintain a register of NHS patients in England. PDS is the national electronic database of NHS patient details such as name, address, date of birth and NHS Number (known as demographic data). It also records the primary care registration (i.e. the GP practice with which the patient is registered for general medical services1) held by each registered patient and as notified through other NHS systems.
    [Show full text]
  • Annual Report
    Our 2018/19 Annual Report Health and high quality care for all, now and for future generations HC 2293 NHS England Annual Report and Accounts 2018/19 NHS England is legally referred to as the National Health Service Commissioning Board. Presented to Parliament pursuant to the National Health Service Act 2006 (as amended by the Health and Social Care Act 2012). Ordered by the House of Commons to be printed 11 July 2019 HC 2293 © Crown copyright 2019 This publication is licensed under the terms of the Open Government Licence v3.0 except where otherwise stated. To view this licence, visit nationalarchives.gov.uk/doc/open-government-licence/version/3 Where we have identified any third party copyright information you will need to obtain permission from the copyright holders concerned. This publication is available at www.gov.uk/official-documents Any enquiries regarding this publication should be sent to us at: NHS England, Quarry House, Quarry Hill, Leeds, LS2 7UE. ISBN 978-1-5286-1036-0 CCS0219647926 07/19 Printed on paper containing 75% recycled fibre content minimum Printed in the UK by the APS Group on behalf of the Controller of Her Majesty’s Stationery Office Contents A view from Lord David Prior, Chair ............................................................................7 About NHS England ......................................................................................................9 Performance Report ......................................................................................................13 Chief Executive’s
    [Show full text]
  • Care Quality Commission
    A picture of the national audit office logo Report by the Comptroller and Auditor General Care Quality Commission Care Quality Commission – regulating health and social care HC 409 SESSION 2017–2019 13 OCTOBER 2017 Our vision is to help the nation spend wisely. Our public audit perspective helps Parliament hold government to account and improve public services. The National Audit Office scrutinises public spending for Parliament and is independent of government. The Comptroller and Auditor General (C&AG), Sir Amyas Morse KCB, is an Officer of the House of Commons and leads the NAO. The C&AG certifies the accounts of all government departments and many other public sector bodies. He has statutory authority to examine and report to Parliament on whether departments and the bodies they fund have used their resources efficiently, effectively, and with economy. Our studies evaluate the value for money of public spending, nationally and locally. Our recommendations and reports on good practice help government improve public services, and our work led to audited savings of £734 million in 2016. Care Quality Commission Care Quality Commission – regulating health and social care Report by the Comptroller and Auditor General Ordered by the House of Commons to be printed on 11 October 2017 This report has been prepared under Section 6 of the National Audit Act 1983 for presentation to the House of Commons in accordance with Section 9 of the Act Sir Amyas Morse KCB Comptroller and Auditor General National Audit Office 4 October 2017 HC 409 | £10.00 This report examines whether the Care Quality Commission is taking appropriate action to address the risks to people’s care.
    [Show full text]
  • Health Research Authority Board Meeting Agenda Part 1 – Public Session
    Page 1 of 63 HEALTH RESEARCH AUTHORITY BOARD MEETING AGENDA PART 1 – PUBLIC SESSION Date: Tuesday 24 July 2018 Time: 1.30pm – 3.15pm Venue: etc venues, Avonmouth House, 6 Avonmouth Street, London SE1 6NX Item Item details Time Attachment Page (mins) no 1. Apologies Verbal - Janet Messer Janet Wisely 2. Conflicts of interest Verbal - 3. Minutes of the last meeting 10 - 16 May 2018 A 4. Matters arising Verbal - Including: - HRA Annual Report and Accounts 2017-18 published 5. Update from Chair 5 Verbal - 6. Chief Executive update 10 To be tabled - 7. HRA Directorate update 5 To be tabled - 8. Transformation Programme update 10 B Including: - SIP Proportionality project 10 C 9. Update on progress of research transparency work 5 Verbal - 10. Pilot proposal for an HRA Accountable Centre Model for 15 D improvement evaluations Page 1 of 2 HRA Board Meeting Agenda – Part 1 (2018.07.24) Page 2 of 63 11. Finance report: April – June 2018 10 E Items for information 12. Annual Freedom of Information Report (2017/18) F 13. Annual Complaints Report (2017/18) G 14. Summary of 06.06.2018 Audit & Risk Committee meeting H 15. Out of session business conducted / External areas of Verbal interest since previous meeting 10 - Update regarding recruitment of Nick Hirst to support Research System Programme circulated 07 June 2018 - Statement issued by NIHR regarding Improving Performance in Initiating and Delivering Clinical Research circulated 07 June 2018 - Update regarding two studies to be published circulated 17 June 2018 16. Any other business 5 Verbal - (Any AOB items should be notified to the Head of Corporate Governance no later than 24 hours prior to the Board meeting barring exceptional circumstances) 17.
    [Show full text]
  • Saving and Improving Lives: the Future of UK Clinical Research Delivery
    Saving and Improving Lives: The Future of UK Clinical Research Delivery Published 23 March 2021 Saving and Improving Lives: The Future of UK Clinical Research Delivery Contents Ministerial foreword ....................................................................................................................... 3 The value of clinical research ....................................................................................................... 5 Our lifeline during COVID-19 ....................................................................................................... 5 Our opportunity to grow, adapt and improve ............................................................................... 6 Our hope for the future ................................................................................................................. 7 Our chance to help others ............................................................................................................ 8 Our time to act is now .................................................................................................................. 9 Our vision for UK clinical research delivery ............................................................................. 12 Clinical research delivery embedded in the NHS ...................................................................... 12 Patient-centred research ............................................................................................................ 12 Streamlined, efficient and innovative clinical
    [Show full text]
  • UNDERSTANDING the NEW NHS a Guide for Everyone Working and Training Within the NHS 2 Contents 3
    England UNDERSTANDING THE NEW NHS A guide for everyone working and training within the NHS 2 Contents 3 NHS ENGLAND INFORMATION READER BOX Introduction 4 Directorate ◆ The NHS belongs to us all Medical Operations Patients and information Nursing Policy Commissioning development Foreword (Sir Bruce Keogh) 5 Finance Human resources NHS values 6 Publications Gateway Reference: 01486 ◆ NHS values and the NHS Constitution Document purpose Resources ◆ An overview of the Health and Social Care Act 2012 Document name Understanding The New NHS Structure of the NHS in England 8 Author NHS England ◆ The structure of the NHS in England Publication date 26 June 2014 ◆ Finance in the NHS: your questions answered Target audience Running the NHS 12 ◆ Commissioning in the NHS Additional circulation Clinicians working and training within the NHS, allied ◆ Delivering NHS services list health professionals, GPs ◆ Health and wellbeing in the NHS Description An updated guide on the structure and function of Monitoring the NHS 17 the NHS, taking into account the changes of the Health and Social Care Act 2012 ◆ Lessons learned and taking responsibility ◆ Regulation and monitoring in the NHS Action required None Contact details for Dr Felicity Taylor Working in the NHS 20 further information National Medical Director's Clinical ◆ Better training, better care Fellow, Medical Directorate Skipton House NHS leadership 21 80 London Road SE1 6LH ◆ Leading healthcare excellence www.england.nhs.uk/nhsguide/ Quality and innovation in the NHS 22 ◆ High-quality care for all Document status This is a controlled document. While this document may be printed, the The NHS in the United Kingdom 24 electronic version posted on the intranet is the controlled copy.
    [Show full text]
  • Joint Framework: Commissioning and Regulating Together
    With support from NHS Clinical Commissioners Regulation of General Practice Programme Board Joint framework: Commissioning and regulating together A practical guide for staff January 2018 Publications Gateway Reference: 07488 Contents 1. This framework ..................................................................................................... 3 1.1 Purpose of the framework .................................................................................... 3 1.2 Who this framework is for ..................................................................................... 3 1.3 The Regulation of General Practice Programme Board ....................................... 4 1.4 Our principles ....................................................................................................... 4 1.5 Changing landscape of primary care .................................................................... 4 2. Collaborative working arrangements ................................................................. 6 2.1 Benefits of collaboration ....................................................................................... 6 2.2 Routine information sharing ................................................................................. 6 2.3 Local meetings ..................................................................................................... 8 2.4 Support for improvement ...................................................................................... 8 2.5 Emerging and urgent concerns (non-routine) ......................................................
    [Show full text]
  • NHS England's Responsibilities for Quality
    OFFICIAL Paper: PB.07.03.2018/10 NHS ENGLAND – BOARD PAPER Title: NHS England’s responsibilities for quality Lead Directors: Jane Cummings, Chief Nursing Officer Steve Powis, NHS England Medical Director Purpose of Paper: For Information This paper sets out NHS England’s functions relating to service quality. It outlines an initial map of the functions and processes in place, and how this translates into actions to improve service quality. The paper also suggests areas where we could ensure consistency of practice across these functions and the wider organisation, whilst recognising that our impending running cost cuts means overall we are going to have to do less, not more, as an organisation. The Board is invited to: Note the functions, processes and governance in place across the organisation, and how we work across NHS England in order to take action; and Note our work with NHSI and other ALBs to strengthen improvement capabilities across the NHS Page 1 of 14 OFFICIAL NHS England’s responsibilities for quality Purpose 1. This paper maps out NHS England’s formal functions relating to service quality. It gives an outline of the processes in place and how this translates into actions to improve service quality. The paper also suggests areas where we could ensure consistency of practice across these functions and the wider organisation. Background 2. The Health and Social Care Act 2012 states that NHS England has a duty to continually drive improvements in the quality of care across a comprehensive health service. Quality is defined in statute as having three dimensions: safety, clinical effectiveness and patient experience.
    [Show full text]
  • The Impact of Covid-19 on the Use of Digital Technology in the NHS
    Briefing August 2020 The impact of Covid-19 on the use of digital technology in the NHS Rachel Hutchings Key points • The Covid-19 pandemic has resulted in the rapid adoption of digital technology in the NHS and significant changes in the delivery of services more widely – to free up space and capacity in acute hospitals, enable remote working and reduce the risk of infection transmission in NHS settings. Primary care in particular has seen a huge increase in remote appointments. • There has also been a surge in patients’ uptake of remote health services, including registrations for the NHS App, NHS login and e-prescription services. • These changes have happened at an incredible pace. Central bodies have taken steps to enable the changes to occur, providing guidance on information governance and fast-track procurement frameworks, for example. Meanwhile, health care professionals have had to respond innovatively to continue to provide services to patients. • But despite the undeniable progress that has been made, it is important to proceed with caution. Especially when changes happen at such a pace, there are possible risks and downsides. • It is essential that we understand – through robust evaluation and research – what the impact of the rapid shift towards digital technology has been on clinical practice, patients’ access to and quality of care, and the experiences of patients and staff. Studies in these areas remain limited, so more work is needed to learn from the experience and determine whether we need to revisit existing priorities. • To embed the positive work that has been done during the pandemic and ensure that it is sustainable in the future, it needs to be underpinned by adequate funding, infrastructure and the necessary workforce.
    [Show full text]
  • NHS Leeds CCG Annual Report 2019-2020
    Annual Report and Accounts 2019-20 Contents About our annual report ...................................................................................................... 2 A note about abbreviations .................................................................................................. 2 Chair and chief executive’s foreword .................................................................................... 3 1 Performance report ............................................................................................... 4 1.1 Performance overview ........................................................................................ 4 1.1.1 Purpose of overview section ........................................................................................ 4 1.1.2 Statement from the chief executive .............................................................................. 4 1.1.3 The nature and purpose of our organisation ................................................................ 6 1.1.4 Our business model ..................................................................................................... 6 1.1.5 Our strategy ................................................................................................................ 7 1.1.6 Financial performance during 2019-20 ......................................................................... 8 1.1.7 Financial outlook ......................................................................................................... 9 1.1.8 Key issues and risks
    [Show full text]
  • NHS Long Term Plan V1.2 August 2019
    Long-Term Plan Long-Term Plan Long-Term The NHS Long Term Plan Plan Long-Term Plan #NHSLongTermPlan www.longtermplan.nhs.uk [email protected] www.longtermplan.nhs.uk #NHSLongTermPlan January 2019 The NHS Long Term Plan 3 Contents THE NHS LONG TERM PLAN – OVERVIEW AND SUMMARY 6 CHAPTER 1: A NEW SERVICE MODEL FOR THE 21ST CENTURY 11 1. We will boost ‘out-of-hospital’ care, and finally dissolve the historic divide 13 between primary and community health services A new NHS offer of urgent community response and recovery support 14 Primary care networks of local GP practices and community teams 14 Guaranteed NHS support to people living in care homes 15 Supporting people to age well 16 2. The NHS will reduce pressure on emergency hospital services 18 Pre-hospital urgent care 19 Reforms to hospital emergency care – Same Day Emergency Care 21 Cutting delays in patients being able to go home 23 3. People will get more control over their own health and more personalised 24 care when they need it 4. Digitally-enabled primary and outpatient care will go mainstream 25 across the NHS 5. Local NHS organisations will increasingly focus on population health – 29 moving to Integrated Care Systems everywhere CHAPTER 2: MORE NHS ACTION ON PREVENTION AND HEALTH INEQUALITIES 33 Smoking 34 Obesity 36 Alcohol 38 Air pollution 38 Antimicrobial resistance 39 Stronger NHS action on health inequalities 39 CHAPTER 3: FURTHER PROGRESS ON CARE QUALITY AND OUTCOMES 44 A strong start in life for children and young people 45 Maternity and neonatal services 46 Children
    [Show full text]
  • Information Governance Operating Model 2020-2022
    INFORMATION GOVERNANCE OPERATING MODEL 2020 - 2022 Corporate Information Governance, NHS England and NHS Improvement Information Governance Policy Team, NHSX NHS England and NHS Improvement Enabling a lawful and ethical culture for the use of information to deliver and improve our high-quality patient care Contents 1. Executive summary ......................................................................................................................................... 3 2. Introduction ....................................................................................................................................................... 4 3. IG responsibility scope .................................................................................................................................. 5 4. Joint working .................................................................................................................................................. 10 5. Corporate IG team ......................................................................................................................................... 11 6. IG Policy team (NHSX) .................................................................................................................................. 19 7. Governance framework ................................................................................................................................ 22 Appendix A – Corporate IG structure ..............................................................................................................
    [Show full text]