Development and Factor Analysis of a Questionnaire to Measure Patient Satisfaction with Injected and Inhaled Insulin for Type 1 Diabetes

Total Page:16

File Type:pdf, Size:1020Kb

Development and Factor Analysis of a Questionnaire to Measure Patient Satisfaction with Injected and Inhaled Insulin for Type 1 Diabetes Epidemiology/Health Services/Psychosocial Research ORIGINAL ARTICLE Development and Factor Analysis of a Questionnaire to Measure Patient Satisfaction With Injected and Inhaled Insulin for Type 1 Diabetes JOSEPH C. CAPPELLERI, PHD, MPH IONE A. KOURIDES, MD system that permits noninvasive delivery of ROBERT A. GERBER, PHARMD, MA ROBERT A. GELFAND, MD rapid-acting insulin was developed (Inhale Therapeutics Systems, San Carlos, CA) that offers an effective and well-tolerated alternative to preprandial insulin injections in type 1 diabetes (3). Inhaled insulin, OBJECTIVE — To develop a self-administered questionnaire to address alternative deliv- intended for use in a preprandial therapeu- ery routes of insulin and to investigate aspects of patient satisfaction that may be useful for tic regimen, is the first practical alternative subsequent assessment and comparison of an inhaled insulin regimen and a subcutaneous to injections for therapeutic administration insulin regimen. of insulin. However, measures of treatment RESEARCH DESIGN AND METHODS — Attributes of patient treatment satisfaction satisfaction in diabetes have not directly with both inhaled and injected insulin therapy were derived from five qualitative research stud- examined delivery routes for insulin other ies to arrive at a 15-item questionnaire. Each item was analyzed on a five-point Likert scale so than by injection (e.g., syringe, pen, or that higher item scores indicated a more favorable attitude. There were 69 subjects with type 1 pump) and were developed at a time when diabetes previously taking injected insulin therapy who were enrolled in a phase II clinical trial. only injectable forms of insulin were readily Their baseline responses on the questionnaire were evaluated and subjected to an exploratory available in clinical practice (4–7). There- factor analysis. Meaningful factors were retained and interpreted based on their psychometric fore, patient satisfaction with inhalation properties. delivery of insulin needs to be investigated. This article reports the development of RESULTS — Exploratory factor analysis suggested a two-factor solution accounting for 66 a self-administered questionnaire whose and 20% of the variance, respectively. The first factor contained 10 reliable items (Cronbach’s ␣ = 0.89) relating to convenience and ease of use, and the second contained 5 reliable items items are tailored to novel as well as exist- (Cronbach’s ␣ = 0.82) relating to social comfort. ing forms of insulin delivery. As a first step to explore and identify attributes of patient CONCLUSIONS — Among patients with type 1 diabetes, this analysis highlighted and satisfaction in this context, we undertook a quantified two key factors contributing to patient satisfaction: convenience/ease of use and factor analysis on baseline responses of the social comfort. The questionnaire underwent rigorous development, had reliable properties, questionnaire. Such an analysis can serve as and an interpretable and rich factor structure. This report is intended to help advance, in sub- a conduit for subsequent research in the sequent investigations, the understanding and measurement of treatment satisfaction with assessment and comparison of patient sat- novel and existing forms of insulin delivery. isfaction with, for example, inhaled insulin therapy and subcutaneous insulin therapy. Diabetes Care 23:1799–1803, 2000 RESEARCH DESIGN AND he Diabetes Control and Complications One limitation may be the inconvenience METHODS Trial (1) and the Stockholm Diabetes and poor patient acceptability of a program TIntervention Study (2) have demon- of multiple daily insulin injections. Patient satisfaction questionnaire strated the benefits and impact of good The search for a practical alternative to Attributes of patient satisfaction with treat- glycemic control in type 1 diabetes. How- injections for therapeutic administration ment for both injectable and inhaled ever, despite the results of these studies, of insulin is nearly as old as the discovery insulin therapy were derived from five intensive insulin therapy has been slow to of insulin itself. Recently, a novel dry powder qualitative research studies that consisted of gain acceptance in clinical practice settings. insulin formulation and aerosol delivery one-on-one interviews conducted in the U.S. Two studies (n = 100 and n = 41) included people with type 1 and type 2 From Pfizer Inc. (J.C.C., R.A.Ger., R.A.Gel.), Global Research and Development, Groton, Connecticut; and Pfizer Inc. (I.A.K.), New York, New York. (insulin-using) diabetes; one study (n = 44) Address correspondence and reprint requests to Joseph C. Cappelleri, PhD, MPH, Pfizer Inc., M.S. 8260- included people with type 1 and type 2 253, Eastern Point Road, Groton, CT 06340. Email: [email protected]. (insulin-using and non–insulin using) dia- Received for publication 13 June 2000 and accepted in revised form 29 August 2000. betes; one study included 10 subjects (1 All authors are employed by and hold stock in Pfizer Inc. Abbreviations: PSIT, Patient Satisfaction with Insulin Therapy. subject with type 1 diabetes and 9 subjects A table elsewhere in this issue shows conventional and Système International (SI) units and conversion without diabetes) who used the inhaler factors for many substances. system four times a day (placebo, no med- DIABETES CARE, VOLUME 23, NUMBER 12, DECEMBER 2000 1799 Factor analysis of the PSIT Table 1—Baseline clinical characteristics of type 1 diabetes recruited into a 12-week Step 2 involved a promax (oblique) the study population parallel study of an inhaled insulin regimen rotation on the retained factors to help with versus a conventional subcutaneously interpretation. An oblique rotation was injected insulin regimen conducted at 10 applied because it was hypothesized (and n 69 centers in the U.S. Subjects completed the later confirmed) that the factors would be Sex (M/F) 37/32 baseline questionnaire in ϳ5–10 min. The correlated with one another. Step 3 Age (years) 37.4 ± 9.0 (18.0–56.0) design and clinical results of this study involved interpreting the rotated solution Duration of diabetes 14.6 ± 9.3 (1.2–35.0) have been reported elsewhere (3). by identifying which items load on each (years) Subjects were aged 18–56 years and on retained factor, the conceptual meaning of Race/ethnic group a stable insulin administration schedule (for at items that load on the same factor, and White 55 (80) least 2 months) involving two to three pre- conceptual differences in items that load on Black 2 (3) scribed insulin injections daily. Both screening different factors. Pattern loadings near 0.40 Hispanic, other 12 (17) and prerandomization HbA values were or greater (in absolute value) were used to Weight (kg) 1c between 7.0 and 11.9%, with fasting plasma interpret the results (9,11). Men 81.3 ± 10.8 (56.3–103.6) C-peptide Յ0.2 pmol/ml. All had body Women 64.1 ± 7.5 (50.2–76.7) weight of 80–130% of ideal (Metropolitan Internal consistency and stability BMI (kg/m2) Life Insurance Tables). Subjects were non- Cronbach’s ␣ reliability coefficient (12) was Men 25.5 ± 2.7 (21.0–31.0) smokers (for at least 6 months) and had a computed for each factor (domain) and total Women 24.4 ± 2.8 (19.0–31.0) normal chest X-ray, normal pulmonary func- scale to measure internal consistency. An HbA (%) 8.5 ± 1.1 (6.4–11.2) 1c tion test results, and an electrocardiogram item-total correlation between an individual Data are n, means ± SD (range), or n (%). A total of with normal sinus rhythm at a rate of 50–100 item and the sum of the remaining items on 73 men and women with type 1 diabetes were enrolled. One subject was discontinued before ran- beats/min. All subjects performed home a factor or total scale was calculated to fur- domization, and complete data were not available. Of blood glucose monitoring four times daily. ther assess reliability. the remaining 72 subjects, there were no discernible Baseline responses from a total of 69 subjects A second baseline measurement was differences between the 3 subjects excluded and the were considered in the factor analysis. not available for baseline test-retest reliabil- 69 subjects included (3). ity (stability). However, Pearson correlations Factor analysis between baseline (“test”) and posttreatment To further understand and identify attrib- (“retest”) scores at 12 weeks were measured ication of any kind was given) for 14 days utes of patient satisfaction, we conducted among patients who continued with, and and maintained a daily diary; and one an exploratory factor analysis of the base- were randomized to, traditionally adminis- study (n = 10) included health care profes- line questionnaire responses. Factor analy- tered subcutaneous insulin. Statistical sig- sionals (2 primary care physicians, 2 sis is a statistical technique that reduces a nificance was based on P Ͻ 0.05. internists, 2 endocrinologists, 2 pharma- large number of interrelated questions to a cists, and 2 certified diabetes educators). smaller number of underlying common Relationship of satisfaction scores Based on these studies, items and con- factors or domains that are primarily with demographic and medical tent relating to patient satisfaction with responsible for covariation in the data (8). variables insulin treatment were identified. The initial We followed a standard approach to We examined the relationship of satisfaction item pool was further reduced to contain conducting an exploratory factor analysis scores with the demographic and medical only items that were clear and not redun- (8,9). Three major sequential steps were variables found in Table 1. Pearson correla- dant. Emphasis was placed on using simple undertaken. Step 1 involved identifying the tion (r) was used to measure the association and unambiguous wording of items and number of meaningful factors to retain based of satisfaction scores with these variables responses. The resulting questionnaire—the on the scree test (10) and the percentage of except race, for which an analysis of vari- Patient Satisfaction with Insulin Therapy (common) variance accounted for by a given ance model was applied.
Recommended publications
  • Those Missing Values in Questionnaires
    Those Missing Values in Questionnaires John R. Gerlach, Maxim Group, Plymouth Meeting, PA Cindy Garra, IMS HEALTH; Plymouth Meeting, PA Abstract alternative values are not bona fide SAS missing values; consequently, a SAS procedure, expectedly, will include Questionnaires are notorious for containing these alternative values, thereby producing bogus results. responses that later become missing values during processing and analyses. Contrary to a non-response that Typically, you can re-code the original data, so results in a typical, bona fide, missing value, questions that the missing values become ordinary missing values, might allow several alternative responses, necessarily thus allowing SAS to process only appropriate values. Of outside the usual range of appropriate responses. course, there's a loss of information since the original Whether a question represents continuous or categorical missing values did not constitute a non-response. Also, data, a good questionnaire offers meaningful alternatives, such pre-processing might include a myriad of IF THEN / such as: "Refused to Answer" and, of course, the ELSE statements, which can be very tedious and time- quintessential "Don't Know." Traditionally, these consuming to write, and difficult to maintain. Thus, given alternative responses have numeric values such as 97, a questionnaire that has over a hundred variables with 998, or 9999 and, therefore, pose problems when trying varying levels of missing values, the task of re-coding to distinguish them from normal responses, especially these variables becomes very time consuming at best. when multiple missing values exist. This paper discusses Even worse, the permanent re-coding of alternative missing values in SAS and techniques that facilitate the responses to ordinary missing numeric values in SAS process of dealing with multi-valued, meaningful missing precludes categorical analysis that requires the inclusion values often found in questionnaires.
    [Show full text]
  • 10 Questions Opinion Polls
    Questions you might have on 10opinion polls 1. What is an opinion poll? An opinion poll is a survey carried out to measure views on a certain topic within a specific group of people. For example, the topic may relate to who Kenyans support in the presidential race, in which case, the group of people interviewed will be registered voters. 2. How are interviewees for an opinion poll selected? The group of people interviewed for an opinion poll is called a sample. As the name suggests, a sample is a group of people that represents the total population whose opinion is being surveyed. In a scientific opinion poll, everyone has an equal chance of being interviewed. 3. So how come I have never been interviewed for an opinion poll? You have the same chance of being polled as anyone else living in Kenya. However, chances of this are very small and are estimated at about 1 in 14,000. This is because there are approximately 14 million registered voters in Kenya and, for practical and cost reasons, usually only between 1,000 and 2,000 people are interviewed for each survey carried out. 4. How can such a small group be representative of the entire population? In order to ensure that the sample/survey group is representative of the population, the surveyors must ensure that the group reflects the characteristics of the whole. For instance, to get a general idea of who might win the Kenyan presidential election, only the views of registered voters in Kenya will be surveyed as these are the people who will be able to influence the election.
    [Show full text]
  • Handbook of Recommended Practices for Questionnaire Development and Testing in the European Statistical System
    Handbook of Recommended Practices for Questionnaire Development and Testing in the European Statistical System Release year: 2006 Authors: G. Brancato, S. Macchia, M. Murgia, M. Signore, G. Simeoni - Italian National Institute of Statistics, ISTAT K. Blanke, T. Körner, A. Nimmergut - Federal Statistical Office Germany, FSO P. Lima, R. Paulino - National Statistical Institute of Portugal, INE J.H.P. Hoffmeyer-Zlotnik - German Center for Survey Research and Methodology, ZUMA Version 1 Acknowledgements We are grateful to the experts from the network countries who supported us in all relevant stages of the work: Anja Ahola, Dirkjan Beukenhorst, Trine Dale, Gustav Haraldsen. We also thank all colleagues from European and overseas NSIs who helped us in understanding the current practices and in the review of the draft version of the handbook. Executive summary Executive Summary Questionnaires constitute the basis of every survey-based statistical measurement. They are by far the most important measurement instruments statisticians use to grasp the phenomena to be measured. Errors due to an insufficient questionnaire can hardly be compensated at later stages of the data collection process. Therefore, having systematic questionnaire design and testing procedures in place is vital for data quality, particularly for a minimisation of the measurement error. Against this background, the Directors General of the members of the European Statistical System (ESS) stressed the importance of questionnaire design and testing in the European Statistics Code of Practice, endorsed in February 2005. Principle 8 of the Code states that “appropriate statistical procedures, implemented from data collection to data validation, must underpin quality statistics.” One of the indicators referring to this principle requires that “questionnaires are systematically tested prior to the data collection.” Taking the Code of Practice as a starting point, this Recommended Practice Manual aims at further specifying the requirements of the Code of Practice.
    [Show full text]
  • Meta-Analysis of the Relationships Between Different Leadership Practices and Organizational, Teaming, Leader, and Employee Outcomes*
    Journal of International Education and Leadership Volume 8 Issue 2 Fall 2018 http://www.jielusa.org/ ISSN: 2161-7252 Meta-Analysis of the Relationships Between Different Leadership Practices and Organizational, Teaming, Leader, and Employee Outcomes* Carl J. Dunst Orelena Hawks Puckett Institute Mary Beth Bruder University of Connecticut Health Center Deborah W. Hamby, Robin Howse, and Helen Wilkie Orelena Hawks Puckett Institute * This study was supported, in part, by funding from the U.S. Department of Education, Office of Special Education Programs (No. 325B120004) for the Early Childhood Personnel Center, University of Connecticut Health Center. The contents and opinions expressed, however, are those of the authors and do not necessarily reflect the policy or official position of either the Department or Office and no endorsement should be inferred or implied. The authors report no conflicts of interest. The meta-analysis described in this paper evaluated the relationships between 11 types of leadership practices and 7 organizational, teaming, leader, and employee outcomes. A main focus of analysis was whether the leadership practices were differentially related to the study outcomes. Studies were eligible for inclusion if the correlations between leadership subscale measures (rather than global measures of leadership) and outcomes of interest were reported. The random effects weighted average correlations between the independent and dependent measures were used as the sizes of effects for evaluating the influences of the leadership practices on the outcome measures. One hundred and twelve studies met the inclusion criteria and included 39,433 participants. The studies were conducted in 31 countries in different kinds of programs, organizations, companies, and businesses.
    [Show full text]
  • Survey Experiments
    IU Workshop in Methods – 2019 Survey Experiments Testing Causality in Diverse Samples Trenton D. Mize Department of Sociology & Advanced Methodologies (AMAP) Purdue University Survey Experiments Page 1 Survey Experiments Page 2 Contents INTRODUCTION ............................................................................................................................................................................ 8 Overview .............................................................................................................................................................................. 8 What is a survey experiment? .................................................................................................................................... 9 What is an experiment?.............................................................................................................................................. 10 Independent and dependent variables ................................................................................................................. 11 Experimental Conditions ............................................................................................................................................. 12 WHY CONDUCT A SURVEY EXPERIMENT? ........................................................................................................................... 13 Internal, external, and construct validity ..........................................................................................................
    [Show full text]
  • MRS Guidance on How to Read Opinion Polls
    What are opinion polls? MRS guidance on how to read opinion polls June 2016 1 June 2016 www.mrs.org.uk MRS Guidance Note: How to read opinion polls MRS has produced this Guidance Note to help individuals evaluate, understand and interpret Opinion Polls. This guidance is primarily for non-researchers who commission and/or use opinion polls. Researchers can use this guidance to support their understanding of the reporting rules contained within the MRS Code of Conduct. Opinion Polls – The Essential Points What is an Opinion Poll? An opinion poll is a survey of public opinion obtained by questioning a representative sample of individuals selected from a clearly defined target audience or population. For example, it may be a survey of c. 1,000 UK adults aged 16 years and over. When conducted appropriately, opinion polls can add value to the national debate on topics of interest, including voting intentions. Typically, individuals or organisations commission a research organisation to undertake an opinion poll. The results to an opinion poll are either carried out for private use or for publication. What is sampling? Opinion polls are carried out among a sub-set of a given target audience or population and this sub-set is called a sample. Whilst the number included in a sample may differ, opinion poll samples are typically between c. 1,000 and 2,000 participants. When a sample is selected from a given target audience or population, the possibility of a sampling error is introduced. This is because the demographic profile of the sub-sample selected may not be identical to the profile of the target audience / population.
    [Show full text]
  • Guidelines for Stated Preference Experiment Design
    Guidelines for Stated Preference Experiment Design (Professional Company Project in Association with RAND Europe) A dissertation submitted for the degree of Master of Business Administration. Project Period: Aug. 1, 2001 – Nov. 30, 2001 November 23, 2001 © Nobuhiro Sanko 2001 All rights reserved School of International Management Ecole Nationale des Ponts et Chaussées (Class 2000/01) Nobuhiro SANKO Nobuhiro Sanko, 2001 ii Abstract The purpose of stated preference design is how to collect data for efficient model estimation with as little bias as possible. Full factorial or fractional factorial designs have been frequently used just in order to keep orthogonality and to avoid multi-colinearity between the attributes. However, these factorial designs have a lot of practical problems. Although many methods are introduced to solve some of these problems, there is no powerful way which solves all problems at once. Therefore, we need to combine some existing methods in the experiment design. So far, several textbooks about stated preference techniques have been published, but most of them just introduced some existing methods for experimental design and gave less guidance how to combine them. In this paper, we build a framework which brings an easier guideline to build SP design. In each step of the framework, we show a problem to be considered and methods to solve it. For each method, the advantage, disadvantage and the criteria are explained. Based on this framework, we believe even the beginner can build a reasonable design. Of course for advanced researchers, this paper will be a useful guidebook to understand stated preference design from different viewpoint.
    [Show full text]
  • Designing Valid and Reliable Vignette Experiments for Survey Research: a Case Study on the Fair Gender Income Gap
    Journal of Methods and Measurement in the Social Sciences, Vol. 7, No.2, 52-94, 2016 Designing Valid and Reliable Vignette Experiments for Survey Research: A Case Study on the Fair Gender Income Gap Peter M. Steiner Christiane Atzmüller University of Wisconsin-Madison University of Vienna, Austria Dan Su University of Wisconsin-Madison In survey research, vignette experiments typically employ short, systematically varied descriptions of situations or persons (called vignettes) to elicit the beliefs, attitudes, or behaviors of respondents with respect to the presented scenarios. Using a case study on the fair gender income gap in Austria, we discuss how different design elements can be used to increase a vignette experiment’s validity and reliability. With respect to the experimental design, the design elements considered include a confounded factorial design, a between-subjects factor, anchoring vignettes, and blocking by respondent strata and interviewers. The design elements for the sampling and survey design consist of stratification, covariate measurements, and the systematic assignment of vignette sets to respondents and interviewers. Moreover, the vignettes’ construct validity is empirically validated with respect to the real gender income gap in Austria. We demonstrate how a broad range of design elements can successfully increase a vignette study’s validity and reliability. Keywords: Vignette experiment, factorial survey, confounded factorial design, anchoring vignettes, ANOVA, multilevel modeling Experiments in survey research
    [Show full text]
  • Questionnaire Analysis Using SPSS
    Questionnaire design and analysing the data using SPSS page 1 Questionnaire design. For each decision you make when designing a questionnaire there is likely to be a list of points for and against just as there is for deciding on a questionnaire as the data gathering vehicle in the first place. Before designing the questionnaire the initial driver for its design has to be the research question, what are you trying to find out. After that is established you can address the issues of how best to do it. An early decision will be to choose the method that your survey will be administered by, i.e. how it will you inflict it on your subjects. There are typically two underlying methods for conducting your survey; self-administered and interviewer administered. A self-administered survey is more adaptable in some respects, it can be written e.g. a paper questionnaire or sent by mail, email, or conducted electronically on the internet. Surveys administered by an interviewer can be done in person or over the phone, with the interviewer recording results on paper or directly onto a PC. Deciding on which is the best for you will depend upon your question and the target population. For example, if questions are personal then self-administered surveys can be a good choice. Self-administered surveys reduce the chance of bias sneaking in via the interviewer but at the expense of having the interviewer available to explain the questions. The hints and tips below about questionnaire design draw heavily on two excellent resources. SPSS Survey Tips, SPSS Inc (2008) and Guide to the Design of Questionnaires, The University of Leeds (1996).
    [Show full text]
  • STANDARDS and GUIDELINES for STATISTICAL SURVEYS September 2006
    OFFICE OF MANAGEMENT AND BUDGET STANDARDS AND GUIDELINES FOR STATISTICAL SURVEYS September 2006 Table of Contents LIST OF STANDARDS FOR STATISTICAL SURVEYS ....................................................... i INTRODUCTION......................................................................................................................... 1 SECTION 1 DEVELOPMENT OF CONCEPTS, METHODS, AND DESIGN .................. 5 Section 1.1 Survey Planning..................................................................................................... 5 Section 1.2 Survey Design........................................................................................................ 7 Section 1.3 Survey Response Rates.......................................................................................... 8 Section 1.4 Pretesting Survey Systems..................................................................................... 9 SECTION 2 COLLECTION OF DATA................................................................................... 9 Section 2.1 Developing Sampling Frames................................................................................ 9 Section 2.2 Required Notifications to Potential Survey Respondents.................................... 10 Section 2.3 Data Collection Methodology.............................................................................. 11 SECTION 3 PROCESSING AND EDITING OF DATA...................................................... 13 Section 3.1 Data Editing ........................................................................................................
    [Show full text]
  • Questionnaire Design Asking Questions with a Purpose
    Questionnaire Design Asking Questions with a Purpose Paul Pope Extension Program Specialist—Evaluation Chris Boleman Assistant Professor and Extension Specialist Scott Cummings Assistant Department Head and Program Leader for Extension Education Texas Cooperative Extension The Texas A&M University System Updated and revised from the original Questionnaire Design: Asking Questions with a Purpose, developed by Mary G. Marshall Contents Introduction....................................................................................................4 Questionnaires: Part of the Survey Process (The Big Picture) .........................5 Using a Questionnaire: Pro and Cons..............................................................6 Modes of Delivery ..........................................................................................7 Constructing a Questionnaire: A Step-By-Step Approach ................................8 Starting Point Guidelines ...............................................................................9 Developing the Program Impact Section .......................................................11 Developing the Program Improvement Section .............................................14 Developing the Demographic Section ...........................................................15 Appendix A: Wording the Question ..............................................................20 Appendix B: Types of Questions ...................................................................24 Appendix C: Rating Scales ...........................................................................29
    [Show full text]
  • American Community Survey
    13190012 DC The American Community Survey This booklet shows the content of the American Community Survey questionnaire. Start Here ➜ Please print the name and telephone number of the You have two ways to respond: person who is filling out this form. We will only contact you if needed for official Census Bureau business. Respond online today at: Last Name https://respond.census.gov/acs OR Complete this form and mail it First Name MI back as soon as possible. Area Code + Number Your response is required by law. The American Community SurveyMATIONAL is COPY— conducted by the U.S. Census Bureau. This survey is one of only a few ➜ How many people are living or staying at this address? surveys for which all recipients are • INCLUDE everyone who is living or staying here for more required by law to respond. The than 2 months. U.S. Census Bureau is required by • INCLUDE yourself if you are living here for more than 2 law to protect your information.INFOR months. • INCLUDE anyone else staying here who does not have another place to stay, even if they are here for 2 months or If you need help or have less. questions about completing • DO NOT INCLUDE anyone who is living somewhere else for this form, please call more than 2 months, such as a college student living away or 1-800-354-7271. someone in the Armed Forces on deployment. Telephone Device for the Deaf (TDD): Number of people Call 1–800–582–8330. ¿NECESITA AYUDA? Llame sin cargo alguno al 1-877-833-5625.
    [Show full text]