Validity of the End-Of-Life Professional Caregiver Survey to Assess for Multidisciplinary Educational Needs
Total Page:16
File Type:pdf, Size:1020Kb
JOURNAL OF PALLIATIVE MEDICINE Volume 15, Number 4, 2012 ª Mary Ann Liebert, Inc. DOI: 10.1089/jpm.2011.0246 Validity of the End-of-Life Professional Caregiver Survey To Assess for Multidisciplinary Educational Needs Mark Lazenby, APRN, Ph.D., Elizabeth Ercolano, R.N., D.N.Sc., Dena Schulman-Green, Ph.D., and Ruth McCorkle, R.N., Ph.D., FAAN Abstract The National Consensus Project for Quality Palliative Care (NCP) has put forth eight domains of clinical practice guidelines that address the multidisciplinary nature of palliative and end-of-life (EOL) care. Extant surveys to assess education needs of palliative and EOL workers, however, have been constructed for individual profes- sions. Thus we developed the End-of-life Professional Caregiver Survey (EPCS) as an instrument for assessing the palliative and EOL care-specific educational needs of multidisciplinary professionals. Introduction and legal principles; organizational skills; and attitudes, val- ues, and feelings of health care professionals. We then eval- he National Consensus Project for Quality Palliative uated existing survey tools,6–11 and selected items that Care (NCP) has put forth eight domains of clinical prac- matched the six domains, resulting in 40 items. We edited the T tice guidelines that address the multidisciplinary nature of items to elicit different perceptions from different disciplines, palliative and end-of-life (EOL) care.1 However, a paucity of formatted them to a 5-point Likert scale, transferred them to a trained physicians, nurses, and psychosocial workers con- web-based medium, and pilot-tested them on laptop com- tinues to impede high-quality palliative and EOL care.2–4 puters at an annual meeting of the Connecticut Coalition to A strategy to increase the multidisciplinary workforce is to Improve End-of-Life Care. From the results of the pilot, we provide educational programs in palliative and EOL care emended the items for clarity. Schulman-Green and col- for practicing professionals. The most effective of these edu- leagues12 have fully described the development and content cational programs have a multidisciplinary approach, thus validity of the original needs survey. allowing clinicians to learn what each other member on the Between September 2008 and May 2009, we conducted a team does.5 Extant surveys to assess education needs of Connecticut-wide cross-sectional web-based survey of nur- palliative and EOL workers, however, have been constructed ses, physicians, and social workers with access to the Internet, for individual professions. None assesses educational needs aged 21 years or older, who could communicate in English, across professions.6,7 Thus we developed the End-of-life and who practiced in palliative and EOL care. Participants Professional Caregiver Survey (EPCS) as an instrument for were invited to participate through a link on the website of the assessing the palliative and EOL care-specific educational Connecticut Coalition to Improve End-of-Life Care, various needs of multidisciplinary professionals. In this article we state professional organizations, and direct advertisement. report on the validity of the EPCS, its factors, and its ability to This study was approved by the Human Subjects Research discriminate among characteristics of a diverse multidisci- Review Committee at the Yale University School of Nursing. plinary sample. We included all complete responses from respondents who met the inclusion criteria, regardless of discipline. Statistical analyses were performed using SPSS version 17 Methods (SPSS Inc., Somers, NY). Sample characteristics and survey To develop the EPCS, we reviewed the literature on tools items were described using measures of central tendency. that measure educational needs of professionals providing Factors were first screened for interrelation; one factor was palliative and EOL care. We identified six domains: scientific eliminated due to singularity ( < 0.30), and another was and clinical knowledge/technical skills; communication/ eliminated due to extreme multicollinearity ( > 0.90). Ten interpersonal skills with patients, family members, and other other items were deemed redundant. A principal common clinicians; spiritual and cultural issues; ethical, professional, factor analysis (FA) was performed on the remaining 28 items, Yale University School of Nursing, New Haven, Connecticut. Accepted November 15, 2011. 427 428 LAZENBY ET AL. providing for an unpolluted factor structure. Kaiser-Myer- adequate for FA and the items were uncorrelated in the Olkin (KMO) test was used to determine sampling adequacy, sample. and Bartlett’s test was used to test the hypothesis that the For all 28 items of the EPCS for all participants, the mean variables are uncorrelated among the population sampled. was 107.7 – 18.7, with an a of 0.96. Three factors, with cumu- Decisions about the number of factors retained for rotation lative variance of 60%, emerged (Table 2): 12-item Patient- and were formed by Eigen values ( ‡ 1), the scree plot, and the Family-Centered Communication (PFCC) (Eigen value 14.0; interpretability of the various factor solutions produced. Item variance 50.1%; a 0.95; mean 50.4 – 8.9; inter-item correlations loadings on each factor were estimated by Oblimin (default c between 0.37 and 0.50); 8-item Cultural and Ethical Values value = 0; items ‡ 0.30 were retained), as the factors might (CEV) (Eigen value 1.7; variance 5.9%; a 0.89; mean 28.9 – 5.4; correlate due to the survey’s theoretical construction. All 28 inter-item correlations between 0.55 and 0.75); and 8-item items were retained. We determined reliability statistics using Effective Care Delivery (ECD) (Eigen value 1.1; variance 5.9%; Cronbach’s a; > 0.70 was evidence of adequate scale reliabil- a 0.87; mean 28.4 – 5.6; inter-item correlations between 0.52 ity. We used the Pearson product-moment correlation for and 0.74). Correlations among the three factors and with the assessing degree of association among factors. We compared overall EPCS ranged from 0.80 to 0.92 ( p = 0.01). Results of factors’ means across demographic variables excluding race one-way ANOVA revealed the following significant ( p < 0.05) using one-way analysis of variance (ANOVA), with post hoc relationships: profession with PFCC and CEV; age with comparisons by the Bonferroni correction. Thereafter, asso- PFCC, CEV, and ECD; highest level of education with CEV ciations of each hypothesized factor as dependent variables and ECD; having advance directives with PFCC; and having with the total score of each factor were determined using had EOL education with PFCC (Table 3). Multivariate linear multivariate linear regression. regression showed that having advance directives was sig- nificantly associated ( p = 0.029) with higher mean scores on Results the PFCC (Sum of Squares 47.3; df 30; Mean Square 1.6; F 1.9; R2 0.91). Three hundred sixty-nine participants comprised the sample: 261 nurses, 93 physicians, and 15 social workers. Discussion Participants’ age, race, highest level of education, and whe- ther they had advance directives and have received EOL ed- The purpose of this study was to examine the validity of the ucation are described in Table 1. The KMO was 0.95, and EPCS, determine its factors, and perform discriminant anal- Bartlett’s was 7456.5 (df 378, p = 0.000); hence, the sample was ysis. To do so, we administered it to a sample of 369 Table 1. Sample Characteristics Total Nurses Physicians Social workers x2/t Age Mean (SD) Mean (SD) Mean (SD) Mean (SD) 44 (13) years 62.1a Range 22–90 years 49 (11) years 31 (13) years 47 (11) years Total N = 369 N = 261 (71%) N = 93 (25%) N = 15 (4%) Gender 50.9a Male 40 (11%) 11 (4%) 29 (31%) 0 Female 329 (89%) 250 (96%) 64 (69%) 15 (100%) Race White 342 (93%) 245 (94%) 82 (88%) 15 (100%) Black 6 (1.5%) 5 (2%) 1 (1%) 0 Asian/Pacific Islander 9 (3%) 4 (2%) 5 (6%) 0 Hispanic 4 (1%) 3 (1%) 1 (1%) 0 Other/Combination 6 (1.5%) 2 (1%) 4 (4%) 0 Highest level of education 71.5a Vocational/Assoc. 50 (14%) 50 (20%) 0 0 Bachelor’s Degree 86 (23%) 84 (32%) 0 2 (13%) Master’s Degree 94 (25%) 83 (32%) 0 11 (73%) Doctoral Degree 104 (28%) 10 (4%) 93 (100%) 1 (7%) Other 35 (10%) 34 (12%) 0 1 (7%) Have you had basic end-of-life training? Yes 228 (62%) 153 (59%) 65 (70%) 10 (67%) No 121 (33%) 90 (35%) 26 (28%) 5 (33%) Do you personally have advance directives? Yes 141 (38%) 121 (46%) 12 (13%) 8 (53%) No 213 (58%) 136 (52%) 70 (75%) 7 (47%) Don’t know 9 (2.5%) 1 (0.5%) 8 (9%) 0 Blank 6 (1.5%) 3 (1.5%) 3 (3%) 0 ap = 0.000. Table 2. Factor Analysis of the EPCS and Mean Scores of Each Factor by Profession Total Nurses Physicians Social workers Factors (n = 369) (n = 261) (n = 93) (n = 15) Items PFCC CEV ECD Mean (SD) Mean (SD) Mean (SD) Mean (SD) 1. I am comfortable helping families to accept 0.818 3.7 (0.9)a 3.8 (0.9) 3.4 (0.8) 3.9 (0.7) a poor prognosis 2. I am able to set goals for care with patients 0.818 3.9 (1.0) 4.0 (0.9) 3.6 (0.8) 4.3 (0.6) and families. 3. I am comfortable talking to patients and 0.813 4.0 (0.9) 4.1 (0.8) 3.6 (0.9) 4.5 (0.8) families about personal choice and self-determination. 4. I am comfortable starting and participating 0.802 3.9 (1.0) 4.0 (0.9) 3.6 (0.9) 3.9 (1.2) in discussions about code status. 5. I can assist family members and others 0.787 3.8 (0.9) 3.8 (0.9) 3.5 (0.7) 4.4 (0.6) through the grieving process.