DOCSLIB.ORG

A Knowledge-Based Assessment of Compliance to the Longitudinal Application of Clinical Guidelines

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
A Knowledge-Based Assessment of Compliance to the Longitudinal Application of Clinical Guidelines A Knowledge-Based Assessment of Compliance to the Longitudinal Application of Clinical Guidelines Thesis submitted in partial fulfillment of the requirements for the degree of “DOCTOR OF PHILOSOPHY” by Avner Hatsek Submitted to the Senate of Ben-Gurion University of the Negev November 2014 Beer-Sheva A Knowledge-Based Assessment of Compliance to the Longitudinal Application of Clinical Guidelines Thesis submitted in partial fulfillment of the requirements for the degree of “DOCTOR OF PHILOSOPHY” by Avner Hatsek Submitted to the Senate of Ben-Gurion University of the Negev Approved by the advisor__________ Approved by the Dean of the Kreitman School of Advanced Graduate Studies__________ November 2014 Beer-Sheva This work was carried out under the supervision of Prof. Yuval Shahar In the Department: Information System Engineering Faculty: Engineering Acknowledgments I would like to thank to those who supported and encouraged me in completing this research. My academic supervisor, Professor Yuval Shahar, who guided me for several years, in which he shared much of his infinite knowledge with me, and granted me with an opportunity to learn and to develop my skills in many new areas. I would like to thank Dr. Irit Hochberg, Dr. Deeb Daoud and Prof. Aya Biderman who participated in this research and donated from their time and knowledge to assist me in evaluating the system I developed in this research, and to better understand the implications of such systems to real clinical settings. My colleges at the Ben Gurion University Medical Informatics Research Center, Erez Shalom, Denis Klimov, Ayelet Goldstein, Elior Ariel, Mata Lion and all the others, whom I was lucky to share many experiences and develop new ideas, and who never hesitated to assist when any help was needed. I would like to thank the Department of Information System Engineering and the Faculty of Engineering at Ben Gurion University, where I studied, taught and researched for many years, for assisting me financially, and mainly, for providing me the environment to acquire so much knowledge and so many skills. I would also like to thank the Israeli Ministry of Science Office and the "GERTNER" National Institute for research in health-care policy, who supported in part of the funding for my research. This work is dedicated to my wife Merav, who I really love, and together expecting a first son to arrive very soon… I Abstract Clinical guidelines are developed by professional medical associations as a tool to standardize medical care. These guidelines are published by the associations in order to assist clinicians in basing their medical decisions on state of the art, research-based evidence. Although these guidelines are in general, accessible to clinicians, it is almost impossible for busy clinicians to constantly follow every new guideline that is published, and to comply with all of the current recommendations. Several methods were presented in the past for the development of automated systems for clinical-guideline-based plan recognition, critiquing, and quality assessment. However, additional work is still needed in order for such systems to be widely accepted in healthcare. In this study, I designed, implemented, and evaluated the DiscovErr system, which is a comprehensive system for guideline-based critiquing and quality assessment, that includes an integrated set of modules with a graphical knowledge specification interface; a clinical guideline library; a full-fledged guideline-based quality-assessment engine that assesses care over long time periods according to a well-defined, formal representation of the guideline; and an interface for the visualization of the compliance analysis results. The DiscovErr system uses a formal representation of the procedural workflow knowledge inherent in clinical guidelines and of the declarative domain- specific data-interpretation knowledge they explicitly or implicitly use, to perform quality assessment of the medical care by analyzing the longitudinal clinical data. Furthermore, by using a flexible reasoning mechanism based on fuzzy temporal logic, the compliance analysis algorithm addresses the inherent ambiguity of clinical guidelines, the uncertainty of clinical data, and the fact that care providers typically do not strictly follow clinical guidelines but rather adhere to these guidelines in a partial manner that reflects the essence of the guidelines' recommendations. To evaluate the DiscovErr system, I formally represented a complex, state of the art guideline for management of type II diabetes patients. I then performed several experiments by applying the system to significant numbers of real patient data, comparing the critique generated by the system to the comments made by three expert internists (two of whom are diabetes-therapy experts, and the third a family medicine expert) who reviewed the original clinical records as well as the system’s comments. II The completeness of the DiscovErr system's comments was assessed by comparing the system's comments to those of the three expert clinicians, defined as the portion of the experts' comments that were reproduced by the system. The completeness of the DiscovErr system's comments increased from 66% for comments made by only one expert, to 83% for comments that were mentioned by exactly two of the experts, and reached 98% for comments made by all three experts. The completeness of the system was 91% for comments made by at least a majority of the three experts, which I considered as the system's completeness level. The correctness of the comments made by the system was assessed by the two diabetes experts, who assessed each comment as correct, partially correct, or incorrect. The level of agreement on the correctness of the system's comments, among the two diabetes experts, was measured using Cohen's Kappa, and was found to be significantly high. A comment was considered as correct if it was assessed as correct by one expert and as at least partially correct by the other expert. The correctness of the systems' comments, as assessed by the two diabetes experts, was also 91%. Correctness was higher for comments concerning issues that were judged as being of greater importance, as opposed to comments concerning issues judged as being of lesser importance. I have also assessed the experts' correctness and completeness in an indirect fashion, through the comments they made and through their assessments of the system's comments. The correctness of the experts' comments was defined as having one's comment agreed to by at least one additional expert. I defined an additional measure to assess the global "indirect correctness" score, in which the DiscovErr system was essentially considered as a fourth expert, and which was used for the overall assessment of the system versus the three experts. Completeness of the experts' comments was defined relative to the overall set of comments made by the DiscovErr system that were assessed as correct by both of the diabetes experts. Overall, when compared to the three human experts, using these measures to assess system and human correctness, the DiscovErr system could be placed between the family medicine expert and the two diabetes experts; with respect to the system and human measures of completeness, it displayed a higher level of completeness than any of the three human experts. I conclude that systems such as DiscovErr can be effectively used to assess the quality of longitudinal guideline-based care of large numbers of patients. Table of Contents 1 INTRODUCTION ............................................................................................................... 5 2 BACKGROUND ................................................................................................................ 13 2.1 Planning, Plan Understanding, and Plan Recognition .................................................... 15 2.2 Formal Models for Guideline Representation ................................................................ 16 2.3 Methods for Clinical Guidelines Recognition and Critiquing ........................................ 20 2.4 Fuzzy Sets and Fuzzy Logic .......................................................................................... 37 3 THE DISCOVERR SYSTEM .......................................................................................... 41 3.1 Desiderata for the System’s Design ............................................................................... 42 3.2 Overall Architecture ....................................................................................................... 44 3.3 The Knowledge Framework ........................................................................................... 46 3.3.1 Clinical Guidelines Representation ....................................................................... 47 3.3.2 Clinical Steps Representation ................................................................................ 53 3.3.3 Domain Knowledge Representation ...................................................................... 55 3.3.4 The Knowledge Specification Tool ....................................................................... 59 3.4 The Patient Data Access Module ................................................................................... 62 3.5 The Analysis Framework ............................................................................................... 64 3.5.1 The Fuzzy Temporal Reasoner .............................................................................
Load more

Recommended publications
  • President's Report 2018
    VISION COUNTING UP TO 50 President's Report 2018 Chairman’s Message 4 President’s Message 5 Senior Administration 6 BGU by the Numbers 8 Building BGU 14 Innovation for the Startup Nation 16 New & Noteworthy 20 From BGU to the World 40 President's Report Alumni Community 42 2018 Campus Life 46 Community Outreach 52 Recognizing Our Friends 57 Honorary Degrees 88 Board of Governors 93 Associates Organizations 96 BGU Nation Celebrate BGU’s role in the Israeli miracle Nurturing the Negev 12 Forging the Hi-Tech Nation 18 A Passion for Research 24 Harnessing the Desert 30 Defending the Nation 36 The Beer-Sheva Spirit 44 Cultivating Israeli Society 50 Produced by the Department of Publications and Media Relations Osnat Eitan, Director In coordination with the Department of Donor and Associates Affairs Jill Ben-Dor, Director Editor Elana Chipman Editorial Staff Ehud Zion Waldoks, Jacqueline Watson-Alloun, Angie Zamir Production Noa Fisherman Photos Dani Machlis Concept and Design www.Image2u.co.il 4 President's Report 2018 Ben-Gurion University of the Negev - BGU Nation 5 From the From the Chairman President Israel’s first Prime Minister, David Ben–Gurion, said:“Only Apartments Program, it is worth noting that there are 73 This year we are celebrating Israel’s 70th anniversary and Program has been studied and reproduced around through a united effort by the State … by a people ready “Open Apartments” in Beer-Sheva’s neighborhoods, where acknowledging our contributions to the State of Israel, the the world and our students are an inspiration to their for a great voluntary effort, by a youth bold in spirit and students live and actively engage with the local community Negev, and the world, even as we count up to our own neighbors, encouraging them and helping them strive for a inspired by creative heroism, by scientists liberated from the through various cultural and educational activities.
    [Show full text]
  • A Knowledge-Based Method for Temporal Abstraction of Clinical Data a Dissertation Submitted to the Program in Medical Informatio
    A KNOWLEDGE-BASED METHOD FOR TEMPORAL ABSTRACTION OF CLINICAL DATA A DISSERTATION SUBMITTED TO THE PROGRAM IN MEDICAL INFORMATION SCIENCES AND THE COMMITTEE ON GRADUATE STUDIES OF STANFORD UNIVERSITY IN PARTIAL FULFILLMENT OF THE REQUIREMENTS FOR THE DEGREE OF DOCTOR OF PHILOSOPHY By Yuval Shahar October 1994 © Copyright by Yuval Shahar 1994 All Rights Reserved ii I certify that I have read this dissertation and that in my opinion it is fully adequate, in scope and quality, as a dissertation for the degree of Doctor of Philosophy. ___________________________________ Mark A. Musen (Principal Adviser) (Departments of Medicine and Computer Science) I certify that I have read this dissertation and that in my opinion it is fully adequate, in scope and quality, as a dissertation for the degree of Doctor of Philosophy. ___________________________________ Richard E. Fikes (Department of Computer Science) I certify that I have read this dissertation and that in my opinion it is fully adequate, in scope and quality, as a dissertation for the degree of Doctor of Philosophy. ___________________________________ Barbara Hayes-Roth (Department of Computer Science) Approved for the University Committee on Graduate Studies: ___________________________________ iii Abstract This dissertation describes a reasoning framework for knowledge-based systems, that is specific to the task of abstracting higher-level concepts from time-stamped data, but that is independent of any particular domain. I specify the theory underlying the framework by a logical model of time, parameters, events, and contexts: a knowledge-based temporal-abstraction theory. The domain-specific knowledge requirements and the semantics of the inference structure that I propose are well defined and can be instantiated for particular domains.
    [Show full text]
  • Change Management and Synchronization of Local and Shared Versions of a Controlled Vocabulary
    CHANGE MANAGEMENT AND SYNCHRONIZATION OF LOCAL AND SHARED VERSIONS OF A CONTROLLED VOCABULARY A DISSERTATION SUBMITTED TO THE PROGRAM IN BIOMEDICAL INFORMATICS AND THE COMMITTEE ON GRADUATE STUDIES OF STANFORD UNIVERSITY IN PARTIAL FULFILLMENT OF THE REQUIREMENTS FOR THE DEGREE OF DOCTOR OF PHILOSOPHY Diane Elizabeth Oliver August 2000 © Copyright by Diane E. Oliver 2001 All Rights Reserved ii I certify that I have read this dissertation and that in my opinion it is fully adequate, in scope and quality, as a dissertation for the degree of Doctor of Philosophy. _______________________________________ Mark A. Musen, M.D., Ph.D., Principal Adviser (Stanford Medical Informatics) I certify that I have read this dissertation and that in my opinion it is fully adequate, in scope and quality, as a dissertation for the degree of Doctor of Philosophy. _______________________________________ Edward H. Shortliffe, M.D., Ph.D. (Stanford Medical Informatics) I certify that I have read this dissertation and that in my opinion it is fully adequate, in scope and quality, as a dissertation for the degree of Doctor of Philosophy. _______________________________________ Yuval Shahar, M.D., Ph.D. (Stanford Medical Informatics) I certify that I have read this dissertation and that in my opinion it is fully adequate, in scope and quality, as a dissertation for the degree of Doctor of Philosophy. _______________________________________ Gio Wiederhold, Ph.D. (Department of Computer Science) Approved for the University Committee on Graduate Studies: _______________________________________ iii Abstract To share clinical data and to build interoperating computer systems that permit data entry, data retrieval, and data analysis, users and systems at multiple sites must share a common controlled clinical vocabulary (or ontology).
    [Show full text]
  • Israel Association for Information Systems (ILAIS) Conference July 1, 2013
    Proceedings of the 7 th ILAIS Conference, July 1, 2013, Ruppin Academic Center, Emek Hefer, Israel Proceedings of the 7th Israel Association for Information Systems (ILAIS) Conference July 1, 2013 Ruppin Academic Center Emek Hefer, Israel Editors: Dizza Beimel, Rina Zviel-Girshin, Shirly Barlev Assistant: Omri Mugzach The Israel Association for Information Systems (ILAIS ) was founded in 2005 as the Israeli chapter of the Association for Information Systems (AIS). The goal of ILAIS is to promote the exchange of ideas, experiences and knowledge among IS scholars and professionals engaged in IS development, management and use. 1 Proceedings of the 7 th ILAIS Conference, July 1, 2013, Ruppin Academic Center, Emek Hefer, Israel Conference Program 09:00-09:30 Welcome and greetings : Dov Te'eni, Past President of AIS and Phillip Ein-Dor, President of ILAIS Engineering Hall, Engineering Building Co-Chairs: Dizza Beimel, Rina Zviel-Girshin, Shirly Bar-Lev, Ruppin Academic Center 09:30-10:15 Keynote speaker: Professor Shimon Schocken, IDC Herzliya, Developing Educational Apps for Mobile Platforms: Problems and Solutions 10:15-10:30 Coffee Break 10:30-11:45 Parallel sessions A-D Session A – Room 13 Session Chair: Nitza Geri Oshrat Ayalon (Tel-Aviv University), Eran Toch (Tel-Aviv University) Understanding the Temporal Aspects of Information Sharing in Online Social Networks Amit Rechavi (Ruppin Academic Center), Sheizaf Rafaeli (University of Haifa) Major Players’ Network in Yahoo! Answer Benny Bornfeld (Ruppin Academic Center), Sheizaf Rafaeli (University of Haifa), Daphne Raban (University of Haifa) Electronic word-of-mouth spread in Twitter as a function of the message sentiment Ofer Arazy (University of Alberta), Oded Nov (Polytechnic Institute of NYU) Wiki DNA: Uncovering the Patterns of Online Collaboration Session B – Room 14 Session Chair: Yoram Kalman Omri Mugzach (University of Haifa), Mor Peleg (University of Haifa), Steven C.
    [Show full text]
  • Association for Jewish Studies
    44TH ANNUAL CONFERENCE OF THE AS S O C I AT I ON FOR JEWIS H STUDIES DECEMBER 16– 18, 2012 SHERATON CHICAGO CHICAGO, ILLINOIS Association for Jewish Studies c/o Center for Jewish History 15 West 16th Street New York, NY 10011-6301 Phone: (917) 606-8249 Fax: (917) 606-8222 E-mail: [email protected] www.ajsnet.org President AJS Staff Jeffrey Shandler, Rutgers University Rona Sheramy, Executive Director Vice President/Membership Karen Terry, Program and Membership and Outreach Coordinator Anita Norich, University of Michigan Natasha Perlis, Project Manager Vice President/Program Emma Barker, Conference and Program Reuven Firestone, HUC-JIR Associate Vice President/Publications Karin Kugel, Program Book Designer and Leslie Morris, University of Minnesota Webmaster Secretary/Treasurer Cover Designer Jonathan Sarna, Brandeis University Ellen Nygaard The Association for Jewish Studies is a Constituent Society of The American Council of Learned Societies. The Association for Jewish Studies wishes to thank the Center for Jewish History and its constituent organizations—the American Jewish Historical Society, the American Sephardi Federation, the Leo Baeck Institute, the Yeshiva University Museum, and the YIVO Institute for Jewish Research— for providing the AJS with office space at the Center for Jewish History. Cover credit: “City Core,” acrylic on canvas, 24” x 36”, © Sandra Holubow, 2010. Courtesy of the Chicago Jewish Historical Society. Copyright © 2012 No portion of this publication may be reproduced by any means without the express written permission of the Association for Jewish Studies. The views expressed in advertisements herein are those of the advertisers and do not necessarily reflect those of the Association for Jewish Studies.
    [Show full text]
  • Peace Through Health
    Center for the Study of the Presidency President: David M. Abshire, Ph.D. Founded in 1965, the non-profit, non-partisan Center for the Study of the Presidency serves as the institutional memory of that high office, and applies the lessons of history to the challenges faced by the President and Congress. Mission: • Promote leadership in the Presidency and the Congress to generate innovative solutions to cur- rent national challenges; • Preserve the historic memory of the Presidency by identifying the lessons from the successes and failures of such leadership; • Draw on a wide range of talent to offer ways to better organize an increasingly compartmental- ized Federal Government; • Educate and inspire the next generation of America’s leaders to incorporate civility, inclusiveness, and character into their public and private lives and discourse. For additional information on the CSP Palestine/Israel Health Initiative and the cooperative health programs described in this report as well as to submit descriptions of health projects and resources to be included in future editions of this document and on the PIHI websites, please contact: Susan Blumenthal, M.D., M.P.A. Stephanie Safdi, M.Phil [email protected] Center for the Study of the Presidency Health and Medicine Program 1020 19th Street, NW, Suite 250 Center for the Study of the Presidency Washington, DC 20036 Phone: 202-872-9800 Director: Susan J. Blumenthal, M.D. Fax: 202-872-9811 Health is vital to the economy, productivity, and national security of the United States. From the www.thePresidency.org beginning of our nation’s history, Presidents have played a significant role in steering a course of action for the health of the Nation.
    [Show full text]