2006; 12 10: No. Vol. HTA Health Technology Assessment Assessment Technology Health Health Technology Assessment Health Technology Programme NHS R&D HTA A series of systematic reviews to of systematic reviews A series for sampling decision analysis inform a foot infected diabetic and treating ulcers D Craig, C Iglesias, EA Nelson, S O’Meara, Bell-Syer, J Dalton, K Claxton, SEM S Golder, P O’Hare Gadsby, E Jude, C Dowson, R and J Powell April 2006
Health Technology Assessment 2006; Vol. 10: No. 12 A decision analysis for sampling and treating infected diabetic foot ulcers ISSN 1366-5278 Feedback your views about this report. us to transfer them to the website. We look forward to hearing from you. look forward We The Correspondence Page on the HTA website on the HTA The Correspondence Page (http://www.hta.ac.uk) is a convenient way to publish (http://www.hta.ac.uk) to the address below, telling us whether you would like to the address below, The HTA Programme and the authors would like to know Programme The HTA your comments. If you prefer, you can send your comments you can send your comments your comments. If you prefer, The National Coordinating Centre for Health Technology Assessment, The National Coordinating Centre for Health Technology Mailpoint 728, Boldrewood, University of Southampton, Southampton, SO16 7PX, UK. Fax: +44 (0) 23 8059 5639http://www.hta.ac.uk Email: [email protected] HTA
How to obtain copies of this and other HTA Programme reports. An electronic version of this publication, in Adobe Acrobat format, is available for downloading free of charge for personal use from the HTA website (http://www.hta.ac.uk). A fully searchable CD-ROM is also available (see below). Printed copies of HTA monographs cost £20 each (post and packing free in the UK) to both public and private sector purchasers from our Despatch Agents. Non-UK purchasers will have to pay a small fee for post and packing. For European countries the cost is £2 per monograph and for the rest of the world £3 per monograph. You can order HTA monographs from our Despatch Agents: – fax (with credit card or official purchase order) – post (with credit card or official purchase order or cheque) – phone during office hours (credit card only). Additionally the HTA website allows you either to pay securely by credit card or to print out your order and then post or fax it.
Contact details are as follows: HTA Despatch Email: [email protected] c/o Direct Mail Works Ltd Tel: 02392 492 000 4 Oakwood Business Centre Fax: 02392 478 555 Downley, HAVANT PO9 2NP, UK Fax from outside the UK: +44 2392 478 555 NHS libraries can subscribe free of charge. Public libraries can subscribe at a very reduced cost of £100 for each volume (normally comprising 30–40 titles). The commercial subscription rate is £300 per volume. Please see our website for details. Subscriptions can only be purchased for the current or forthcoming volume.
Payment methods Paying by cheque If you pay by cheque, the cheque must be in pounds sterling, made payable to Direct Mail Works Ltd and drawn on a bank with a UK address. Paying by credit card The following cards are accepted by phone, fax, post or via the website ordering pages: Delta, Eurocard, Mastercard, Solo, Switch and Visa. We advise against sending credit card details in a plain email. Paying by official purchase order You can post or fax these, but they must be from public bodies (i.e. NHS or universities) within the UK. We cannot at present accept purchase orders from commercial companies or from outside the UK.
How do I get a copy of HTA on CD? Please use the form on the HTA website (www.hta.ac.uk/htacd.htm). Or contact Direct Mail Works (see contact details above) by email, post, fax or phone. HTA on CD is currently free of charge worldwide.
The website also provides information about the HTA Programme and lists the membership of the various committees. A series of systematic reviews to inform a decision analysis for sampling and treating infected diabetic foot ulcers
EA Nelson,1* S O’Meara,1 D Craig,2 C Iglesias,1 S Golder,2 J Dalton,1 K Claxton,3 SEM Bell-Syer,1 E Jude,4 C Dowson,5 R Gadsby,6 P O’Hare7 and J Powell8
1 Department of Health Sciences, University of York, UK 2 Centre for Reviews and Dissemination, University of York, UK 3 Department of Economics and Centre for Health Economics, University of York, UK 4 Tameside General Hospital, Ashton-under-Lyne, UK 5 Department of Biological Sciences, University of Warwick, UK 6 Warwick Diabetes Care, University of Warwick, UK 7 Warwick Medical School, University of Warwick, UK 8 Faculty of Medicine, Imperial College, London, UK
* Corresponding author
Declared competing interests of authors: none
Published April 2006
This report should be referenced as follows:
Nelson EA, O’Meara S, Craig D, Iglesias C, Golder S, Dalton J, et al. A series of systematic reviews to inform a decision analysis for sampling and treating infected diabetic foot ulcers. Health Technol Assess 2006;10(12).
Health Technology Assessment is indexed and abstracted in Index Medicus/MEDLINE, Excerpta Medica/EMBASE and Science Citation Index Expanded (SciSearch®) and Current Contents®/Clinical Medicine. NHS R&D HTA Programme
he research findings from the NHS R&D Health Technology Assessment (HTA) Programme directly Tinfluence key decision-making bodies such as the National Institute for Health and Clinical Excellence (NICE) and the National Screening Committee (NSC) who rely on HTA outputs to help raise standards of care. HTA findings also help to improve the quality of the service in the NHS indirectly in that they form a key component of the ‘National Knowledge Service’ that is being developed to improve the evidence of clinical practice throughout the NHS. The HTA Programme was set up in 1993. Its role is to ensure that high-quality research information on the costs, effectiveness and broader impact of health technologies is produced in the most efficient way for those who use, manage and provide care in the NHS. ‘Health technologies’ are broadly defined to include all interventions used to promote health, prevent and treat disease, and improve rehabilitation and long-term care, rather than settings of care. The HTA Programme commissions research only on topics where it has identified key gaps in the evidence needed by the NHS. Suggestions for topics are actively sought from people working in the NHS, the public, service-users groups and professional bodies such as Royal Colleges and NHS Trusts. Research suggestions are carefully considered by panels of independent experts (including service users) whose advice results in a ranked list of recommended research priorities. The HTA Programme then commissions the research team best suited to undertake the work, in the manner most appropriate to find the relevant answers. Some projects may take only months, others need several years to answer the research questions adequately. They may involve synthesising existing evidence or conducting a trial to produce new evidence where none currently exists. Additionally, through its Technology Assessment Report (TAR) call-off contract, the HTA Programme is able to commission bespoke reports, principally for NICE, but also for other policy customers, such as a National Clinical Director. TARs bring together evidence on key aspects of the use of specific technologies and usually have to be completed within a short time period. Criteria for inclusion in the HTA monograph series Reports are published in the HTA monograph series if (1) they have resulted from work commissioned for the HTA Programme, and (2) they are of a sufficiently high scientific quality as assessed by the referees and editors. Reviews in Health Technology Assessment are termed ‘systematic’ when the account of the search, appraisal and synthesis methods (to minimise biases and random errors) would, in theory, permit the replication of the review by others.
The research reported in this monograph was commissioned by the HTA Programme as project number 01/05/02. The contractual start date was in July 2002. The draft report began editorial review in June 2004 and was accepted for publication in August 2005. As the funder, by devising a commissioning brief, the HTA Programme specified the research question and study design. The authors have been wholly responsible for all data collection, analysis and interpretation, and for writing up their work. The HTA editors and publisher have tried to ensure the accuracy of the authors’ report and would like to thank the referees for their constructive comments on the draft document. However, they do not accept liability for damages or losses arising from material published in this report. The views expressed in this publication are those of the authors and not necessarily those of the HTA Programme or the Department of Health. Editor-in-Chief: Professor Tom Walley Series Editors: Dr Peter Davidson, Dr Chris Hyde, Dr Ruairidh Milne, Dr Rob Riemsma and Dr Ken Stein Managing Editors: Sally Bailey and Sarah Llewellyn Lloyd
ISSN 1366-5278 © Queen’s Printer and Controller of HMSO 2006 This monograph may be freely reproduced for the purposes of private research and study and may be included in professional journals provided that suitable acknowledgement is made and the reproduction is not associated with any form of advertising. Applications for commercial reproduction should be addressed to NCCHTA, Mailpoint 728, Boldrewood, University of Southampton, Southampton, SO16 7PX, UK. Published by Gray Publishing, Tunbridge Wells, Kent, on behalf of NCCHTA. Printed on acid-free paper in the UK by St Edmundsbury Press Ltd, Bury St Edmunds, Suffolk. G Health Technology Assessment 2006; Vol. 10: No. 12
Abstract
A series of systematic reviews to inform a decision analysis for sampling and treating infected diabetic foot ulcers EA Nelson,1* S O’Meara,1 D Craig,2 C Iglesias,1 S Golder,2 J Dalton,1 K Claxton,3 SEM Bell-Syer,1 E Jude,4 C Dowson,5 R Gadsby,6 P O’Hare7 and J Powell8
1 Department of Health Sciences, University of York, UK 2 Centre for Reviews and Dissemination, University of York, UK 3 Department of Economics and Centre for Health Economics, University of York, UK 4 Tameside General Hospital, Ashton-under-Lyne, UK 5 Department of Biological Sciences, University of Warwick, UK 6 Warwick Diabetes Care, University of Warwick, UK 7 Warwick Medical School, University of Warwick, UK 8 Faculty of Medicine, Imperial College, London, UK * Corresponding author
Objectives: To review systematically the evidence on Eight studied intravenous antibiotics, five oral the performance of diagnostic tests used to identify antibiotics, four different topical agents such as infection in diabetic foot ulcers (DFUs) and of dressings, four subcutaneous granulocyte colony interventions to treat infected DFUs. To use estimates stimulating factor (G-CSF), one evaluated oral and derived from the systematic reviews to create a topical Ayurvedic preparations and one compared decision analytic model in order to identify the most topical sugar versus antibiotics versus standard care. effective method of diagnosing and treating infection The majority of trials were underpowered and were and to identify areas of research that would lead to too dissimilar to be pooled. There was no strong large reductions in clinical uncertainty. evidence for recommending any particular antimicrobial Data sources: Electronic databases covering period agent for the prevention of amputation, resolution of from inception of the database to November 2002. infection or ulcer healing. Topical pexiganan cream may Review methods: Selected studies were assessed be as effective as oral antibiotic treatment with against validated criteria and described in a narrative ofloxacin for the resolution of local infection. Ampicillin review. The structure of a decision analytic model was and sulbactam were less costly than imipenem and derived for two groups of patients in whom diagnostic cilastatin, a growth factor (G-CSF) was less costly than tests were likely to be used. standard care and cadexomer iodine dressings may be Results: Three studies that investigated the less costly than daily dressings. A decision analytic performance of diagnostic tests for infection on model was derived for two groups of people, those for populations including people with DFUs found that whom diagnostic testing would inform treatment – there was no evidence that single items on a clinical people with ulcers which do not appear infected but examination checklist were reliable in identifying whose ulcer is not progressing despite optimal infection in DFUs, that wound swabs perform poorly concurrent treatment – and those in whom a first against wound biopsies, and that semi-quantitative course of antibiotics (prescribed empirically) have analysis of wound swabs may be a useful alternative to failed. There was insufficient information from the quantitative analysis. However, few people with DFUs systematic reviews or interviews with experts to were included, so it was not possible to tell whether populate the model with transition probabilities for the diagnostic performance differs for DFUs relative to sensitivity and specificity of diagnosis of infection in wounds of other aetiologies. Twenty-three studies DFUs. Similarly, there was insufficient information on investigated the effectiveness (n = 23) or cost- the probabilities of healing, amputation or death in the effectiveness (n = 2) of antimicrobial agents for DFUs. intervention studies for the two populations of interest. iii
© Queen’s Printer and Controller of HMSO 2006. All rights reserved. Abstract
Therefore, we were unable to run the model to particular agent is more effective. Limited evidence inform the most effective diagnostic and treatment suggests that both G-CSF and cadexomer iodine strategy. dressings may be less expensive than ‘standard’ care, Conclusions: The available evidence is too weak to be that ampicillin/sulbactam may be less costly than able to draw reliable implications for practice. This imipenem/cilastatin, and that an unlicensed cream means that, in terms of diagnosis, infection in DFUs (pexiganan) may be as effective as oral ofloxacin. cannot be reliably identified using clinical assessment. Further research is needed to ascertain the This has implications for determining which patients characteristics of infection in people with DFUs that need formal diagnostic testing for infection, on whether influence healing and amputation outcomes, to empirical treatment with antibiotics (before the results determine whether detecting infection prior to of diagnostic tests are available) leads to better treatment offers any benefit over empirical therapy, outcomes, and on identifying the optimal methods of and to establish the most effective and cost-effective diagnostic testing. With respect to treatment, it is not methods for detecting infection, as well as the relative known whether treatment with systemic or local effectiveness and cost-effectiveness of antimicrobial antibiotics leads to better outcomes or whether any interventions for DFU infection.
iv Health Technology Assessment 2006; Vol. 10: No. 12
Contents
List of abbreviations ...... vii Strengths and weaknesses of the review .... 68 Integration of this review with previous Executive summary ...... ix work ...... 69 Decision analytic model ...... 69 1 Background ...... 1 The impact of diabetic foot ulcers ...... 1 6 Conclusions ...... 71 Quality of life ...... 1 Implications for clinical practice ...... 71 General management of DFU ...... 2 Implications for research ...... 71 Wound infection and healing ...... 2 Management of infection in DFU ...... 3 Acknowledgements ...... 73 Methods used in this project ...... 5 Initial representation of pathway of References ...... 75 care ...... 5 Appendix 1 Search strategies ...... 87 2 Research questions ...... 9 Appendix 2 Expert advisory panel ...... 113 3 Review methods ...... 11 Search strategy ...... 11 Appendix 3 Data extraction forms ...... 115 Study selection ...... 13 Data extraction ...... 15 Appendix 4 Data extraction tables ...... 125 Critical appraisal of included studies ...... 15 Data analysis ...... 17 Appendix 5 Quality assessment ...... 199 Decision analytic model ...... 17 Appendix 6 Summary of excluded 4 Results ...... 19 studies ...... 203 Literature search results ...... 19 Studies included in the diagnostic review ... 19 Appendix 7 Experts’ views on definition Results of diagnostic review ...... 19 and management of clinically infected Effectiveness studies ...... 26 diabetic foot ulcers ...... 211 Overall summary ...... 47 Decision analytic modelling ...... 48 Health Technology Assessment reports published to date ...... 223 5 Discussion ...... 61 Diagnostic studies ...... 61 Health Technology Assessment Effectiveness studies ...... 64 Programme ...... 235
v
Health Technology Assessment 2006; Vol. 10: No. 12
List of abbreviations
A/C amoxycilin and clavulanate NICE National Institute for Health and Clinical Excellence A/S ampicillin and sulbactam NPV negative predictive value CCT controlled clinical trial P/C piperacillin and clindamycin CFU colony-forming unit P/T piperacillin and tazabacam CI confidence interval PCR polymerase chain reaction CONSORT Consolidated Standards of Reporting Trials PPV positive predictive value
CRD Centre for Reviews and QALY quality-adjusted life-year Dissemination QUADAS Quality Assessment of Studies of DFU diabetic foot ulcer Diagnostic Accuracy Included in Systematic Reviews DNA deoxyribonucleic acid QUOROM Quality of Reporting of Meta- DNPU diabetic neuropathic plantar ulcer Analyses
DPN diabetic peripheral neuropathy RCT randomised controlled trial
EQ-5D EuroQol quality of life rh-G-CSF recombinant human granulocyte questionnaire colony-stimulating factor
G-CSF granulocyte colony-stimulating rhPDGF recombinant human platelet- factor derived growth factor
HEED Health Economics Evaluation ROC receiver operating characteristic Database RR relative risk HRQoL health-related quality of life RVP retrograde venous perfusion I/C imipenem and cilastatin SD standard deviation LR likelihood ratio SEK Swedish kroner +LR positive likelihood ratio SPSS Statistics Package for Social Sciences –LR negative likelihood ratio STARD Standards for Reporting of Staphylococcus MRSA methicillin-resistant Diagnostic Accuracy aureus T/C ticarcillin and clavulanate NHS EED National Health Service Economic Evaluation Database VAS visual analogue scale
All abbreviations that have been used in this report are listed here unless the abbreviation is well known (e.g. NHS), or it has been used only once, or it is a non-standard abbreviation used only in figures/tables/appendices in which case the abbreviation is defined in the figure legend or at the end of the table. vii
© Queen’s Printer and Controller of HMSO 2006. All rights reserved.
Health Technology Assessment 2006; Vol. 10: No. 12
Executive summary
Background Effectiveness Randomised controlled trials (RCTs) or controlled Around 6% of people with diabetes have a foot clinical trials (CCTs) of the effect of ulcer or have a history of one. Diabetic foot ulcers microbiological analysis or antimicrobial agents in (DFUs) are associated with increased mortality, people with DFUs. illness and reduced quality of life. Diagnosing infection in DFU accurately and administering Cost-effectiveness antibiotics may be important as infection can lead Economic evaluations of eligible interventions to amputation. However, using antimicrobial studied in which costs and effectiveness were agents inappropriately could be costly, and lead to synthesised. increased bacterial resistance. This review concentrates on the diagnosis of infection and the Modelling management of DFUs with antimicrobial agents. Economic or decision analytic models in which the progress of patients with DFUs was described in sufficient detail to allow replication of the Objectives model. The objectives of this study were: Data extraction Quality checklists and data extraction forms for To review systematically the evidence on the each study design were completed by one reviewer performance of diagnostic tests used to identify and checked by a second. Interviews were held infection in DFUs and of interventions to treat with experts to inform gaps in the evidence. infected DFUs. To use estimates derived from the systematic Data synthesis reviews to create a decision analytic model in Studies were described in a narrative review. The order to identify the most effective method of structure of a decision analytic model was derived diagnosing and treating infection and to for two groups of patients in whom diagnostic tests identify areas of research that would lead to were likely to be used. large reductions in clinical uncertainty. Results Methods Diagnosis Three studies investigated the performance of Data sources diagnostic tests for infection on populations Electronic searches were made of 19 databases including people with diabetic foot ulcers. One covering the period from inception of each database study investigated the performance of clinical to November 2002. In addition, handsearches of assessment, another investigated the performance book chapters, conference proceedings, a journal of punch biopsy versus wound swab and and bibliographies of retrieved studies were carried quantitative analysis and the third compared out. Internet searches were also made. quantitative and semi-quantitative wound swabs in people with chronic wounds, including DFUs, for Study selection the identification of infection. These studies, all of Studies that dealt with the following areas were which looked at identifying infection in chronic selected. wounds, found that:
Diagnosis There was no evidence that single items on a Studies of the diagnosis of infection in people with clinical examination checklist were reliable in DFUs or venous leg ulceration where a reference identifying infection in DFUs. standard was compared with an alternative Wound swabs performed poorly against wound assessment. biopsies. ix
© Queen’s Printer and Controller of HMSO 2006. All rights reserved. Executive summary