Mt-Isa Et Al, Review of Visualisation Methods for the Representation Of
Total Page:16
File Type:pdf, Size:1020Kb
Pharmacoepidemiological Research on Outcomes of Therapeutics by a European ConsorTium Review of visualisation methods for the representation of benefit-risk assessment of medication: Stage 2 of 2 Shahrul Mt-Isa,1 Christine E. Hallgreen,2 Alex Asiimwe,3 Gerry Downey,4 Georgy Genov,5 Richard Hermann,6 Diana Hughes,7 Alfons Lieftucht,8 Rebecca Noel,3 Ruth Peters,1 Lawrence D. Phillips,5 Susan Shepherd,4 Alain Micaleff,9 Deborah Ashby,1 Ioanna Tzoulaki.1 On behalf of the PROTECT Work Package 5 participants 1 School of Public Health, Imperial College London, London, United Kingdom 2 Novo Nordisk A/S, Søborg, Denmark 3 Eli Lilly, Surrey, UK / Eli Lilly and Company, USA 4 Amgen Limited, Uxbridge, United Kingdom 5 European Medicines Agency, London, United Kingdom 6 AstraZeneca AB, Macclesfield, United Kingdom 7 Pfizer Inc., New York, USA 8 GlaxoSmithKline Research and Development LTD, Middlesex, United Kingdom 9 Merck KGaA, Geneva, Switzerland Version 1 Date: 15 Feb 2013 Date of any subsequent amendments Person making below amendments Brief description of amendments 09 Apr 2013 S Mt-Isa Added a reference (Beyer et al., 2013) Disclaimer: The processes described and conclusions drawn from the work presented herein relate solely to the testing of methodologies and representations for the evaluation of benefit and risk of medicines. This report neither replaces nor is intended to replace or comment on any regulatory decisions made by national regulatory agencies, nor the European Medicines Agency Acknowledgements: The research leading to these results was conducted as part of the PROTECT consortium (Pharmacoepidemiological Research on Outcomes of Therapeutics by a European ConsorTium, www.imi- protect.eu) which is a public-private partnership coordinated by the European Medicines Agency. The PROTECT project has received support from the Innovative Medicines Initiative Joint Undertaking (www.imi.europa.eu) under Grant Agreement n° 115004, resources of which are composed of financial contribution from the European Union's Seventh Framework Programme (FP7/2007-2013) and EFPIA companies’ in kind contribution Pharmacoepidemiological Research on Outcomes of Therapeutics by a European ConsorTium Executive summary Background Pharmacoepidemiological Research on Outcomes of Therapeutics in a European Consortium (PROTECT) is a project, set up under the Innovative Medicines initiative, with the aim of strengthening the monitoring of the benefit-risk of medicines in Europe. The evaluation of the balance between benefits and risks of drugs is fundamental to all stakeholders involved in the development, registration and use of drugs including patients, health care providers, regulators and pharmaceutical companies. There are many ways in which benefits and risks are presented and communicated. There is an absence of a consensus on which visual representations are most suitable to display benefit-risk profiles. The visual representation of benefits and risks review is conducted in two stages. This report is the second of a two- part review. The first part provided a level of evaluation as to the suitability of visuals presented in the application of benefit-risk approaches in PROTECT methodology review. However, external circumstances such as the intended audience, complexity of the benefit-risk problem, time in drug lifecycle, and other factors that are not related to the benefit-risk methodology may influence the type of visual representation to use. This review explores and identifies suitable visuals to communicate benefits and risks to different stakeholders in different situations. This includes the use of visualisations in dynamic and interactive settings. Objective The aim of this review is to illustrate and to propose appropriate visualisation techniques for the communication of benefits and risks to various stakeholders leading to the development of prototypes for interactive and dynamic visualisations of benefits and risks. In this review, we focus on the design aspect and comprehension of the benefit- risk visualisations. Literature search strategy Systematic searches were performed for the period after year 2000 on Scopus, PubMed, Web of Knowledge and Psychinfo using the following search terms: “benefit”, “risk”, “harm”, “efficacy”, “safety”, “visualise”, “represent”, “communication”, “assessment”, and “decision”. The identified articles must present or discuss one or more visual to communicate risk information, or information in connection to benefit-risk assessment. We manually searched the references of the identified articles for relevant materials and extracted them as support documents. We also supplemented the review with work carried out by PROTECT members and other initiatives, materials from other known published literature, materials from scientific conferences, and materials from the internet. Appraisal strategy Distinct types of visualisation were identified from the literature and classified as appropriate into generic visualisation types. Strengths and weaknesses of each visual type that were discussed in the literature were pulled together to form coherent discussion points. The appraisals are structured around the intended audience, the intended message, the knowledge required to understand visualisations, any unintentional message that may be associated with visual types, any missing information that may be needed to understand the visualisations, and some potentially useful software to reproduce these visuals. Additionally, we also review and discuss non-graphical communication of benefits and risks, and the factors that may affect visual comprehension. i Pharmacoepidemiological Research on Outcomes of Therapeutics by a European ConsorTium Results of appraisal Individual’s perception and comprehension of visualisations can be affected by various factors such as cognitive functions, emotions and feelings, as well as gender. Perceptual tasks (what is asked of the individuals to perceive) may also affect the accuracy, the consistency and the perception of visual representation of the benefit-risk balance. Understanding the limitations of long-term memory and short-term memory may help in designing more effective visualisations. Perceived risks are also affected by individual’s dread or fear of certain risk event; and therefore may serve as an “early-warning” system during the decision-making process. Visualisations may be used throughout the whole benefit-risk process to enhance the transparency and the clarity of tasks and decisions to be made. The naïve stages in benefit-risk process involve planning, evidence gathering and data preparation, analysis, exploration, decision and dissemination. A different set of visualisations may be more helpful at different stages of the process, but obviously these visualisations are propagated and revisited at later stages. Whilst dynamic and interactive visualisations may appear superior to their static counterparts, the same design principles still apply. There may be a need for multiple visualisations to communicate a message successfully, and the dashboard design principles may be adopted to achieve an efficient layout for communicating benefits and risks. Visual representations of benefits and risks are not only limited to graphics, but also include the use of emotive language (verbal labels) and numerical presentations. Whilst the use of verbal labels may trigger emotive response, they should not be presented without numerical representations. Numerical literacy plays huge role in visual perception of benefits and risks, and is associated with better comprehension. There is no one visualisation type that triumphs in all situations, therefore alternatives should be offered to account for the variation in stakeholders’ characteristics and preferences. Recommendations The recommendations have several facets: they provide a set of principles for generating visuals for benefit-risk assessment, they propose visuals for the key stages in the benefit-risk assessment and they propose visuals for the common questions associated with benefit-risk assessment. These facets are intended to provide readers with easy- to-follow guidelines when considering visualisations in benefit-risk assessments. We recommend the following: General principles for visualisations Recommendation 1: Determine the audience-visual compatibility prior to generating visuals to ensure that the visuals satisfactorily meet the principles outlined in Recommendation 2 and Recommendation 3 below and are suitable for use in the communication of benefits and risks to the intended audience. Recommendation 2: The Wickens’ Principles of Display Design should be taken into account when generating benefit- risk visualisations to facilitate users’ understanding Recommendation 3: The GSK Graphics Principles should be used as guidelines to generating graphs for the purpose of data communication having considered the general human factors for understanding visual in Wickens’ Principles of Display Design. ii Pharmacoepidemiological Research on Outcomes of Therapeutics by a European ConsorTium Key stages in benefit-risk assessment Recommendation 4: At the planning stage when structuring a decision problem, visualise the structure using a tree diagram to indicate the hierarchy, and prepare a table template (‘effects table’ or ‘source table’) to represent the data that are required to be collected. Recommendation 5: At the evidence gathering and data preparation stage when gathering data, the table template must be completed highlighting