Rorschach and Psychopathy, Supplementary Material 1
Appendix 1: Characteristics of Studies Included in Meta-Analysis.
Participants ______
Report No. Age % % w/ ASPD Included Perpetrator ID Authors Type Male or CD Dx Psychotic? Status ______1a. Ballard (2006) D 100 Adol. 100% 98% No FE 1b. Loving (1998) D 48 Adol. 100% 100% No FE___ 1c. Loving & Russell (2000) A 66 Adol. 100% 100% No FE 2a. Cunliffe (2002) D 45 Adult 0% 100% No I____ 2b. Cunliffe & Gacono (2005) A 45 Adult 0% 100% No I 3. Darcangelo (1997) D 40 Adult 100% ? ? I, R_ 4. Egozi-Profeta (1999) D 44 Adult 100% 100% No I, Dr 5a. Gacono & Meloy (1991) A 42 Adult 100% 100% No I____ 5b. Gacono & Meloy (1994) B 82 Adult 100% 100% No I 5c. Gacono, Meloy, & Berg (1992) A 43 Adult 100% 100% No I____ 5d. Gacono, Meloy, & Heaven(1990) A 42 Adult 100% 100% No I 5e. Heaven (1989) D 31 Adult 100% 100% No I____ 5f. Meloy & Gacono (1992) A 43 Adult 100% 100% No I 6. Hartmann et al. (2006) A 40 Adult 100% 100% No I, V_ 7. Muntz (1999) D 48 Adult 0% 30% No I 8. Ponder (1999) D 50 Adol. 86% ? No V____ 9a. Siemsen (1999) D 71 Adult 100% ? Yes I, MI 9b. Young et al. (2000) C 118 Adult 100% 69% Yes I, MI 10a. Smith (1995) D 60 Adol. 100% 100% No FE 10b. Smith et al. (1997) A 45 Adol. 100% 100% No FE___ 11a. Nassen (2008) D 97 Adult 100% ? No I, HV 11b. Welsh (1999) D 153 Adult 100% 37% Yes I, HV
(continued on next page)
Note: Studies with the same number in the ID (e.g., 1a. and 1b.) used the same or overlapping samples of participants. Abbreviations: For Study Type, A = Journal Article, D= Dissertation; B = Book, C = Book Chapter; % ASPD or CD Dx = Percentage of sample diagnosed with Antisocial Personality Disorder or Conduct Disorder; For Perpetrator Status, FE = Referred for forensic evaluation, I = Incarcerated, V = Violent, R = Rapists, Dr = Drug Offenders, HV = Highly Violent, MI = Mentally Ill; ? = insufficient information to determine. Rorschach and Psychopathy, Supplementary Material 2
Appendix 1: Characteristics of Studies Included in Meta-Analysis (continued).
Hare Psychopathy Checklist (PCL) ______PCL Groups (High/Medium/Low, High/Medium, or High/Low) ______Version Range of PCL No. participants ID Authors of PCL scores in each group in each group ______1a. Ballard (2006) PCL:YV H:> 30; M:20-29; L:< 19 H:13; M:44; L:43 1b. Loving (1998) PCL:YV H:> 30; M:20-29; L:< 19 H:11; M:17; L:20 1c. Loving & Russell (2000) PCL:YV H:> 30; M:20-29; L:< 19 H:13; M:26; L:27 2a. Cunliffe (2002) PCL-R H:> 30; M:< 24 H:27; M:18______2b. Cunliffe & Gacono (2005) PCL-R H:> 30; M:< 24 H:27; M:18 3. Darcangelo (1997) PCL-R H:> 30; M:< 29 H:11; M:29______4. Egozi-Profeta (1999) PCL-R H:> 30; M:< 29 H:17; M:27 5a. Gacono & Meloy (1991) original PCL H:> 30; M:< 29 H:21; M:21______5b. Gacono & Meloy (1994) PCL-R H:> 30; M:< 29 H:33; M:49 5c. Gacono, Meloy, & Berg (1992) PCL-R H:> 30; M:< 29 H:22; M:21______5d. Gacono, Meloy, & Heaven (1990) original PCL H:> 30; M:< 29 H:21; M:21 5e. Heaven (1989) original PCL H:> 30; M:< 29 H:14; M:17______5f. Meloy & Gacono (1992) original PCL H:> 30; M:< 29 H:22; M:21 6. Hartmann et al. (2006) PCL:SV H:> 19; M:< 18 H:16; M:24______7. Muntz (1999) PCL-R H:> 30; M:20-29; L:< 19 H: 9; M:22; L:17 8. Ponder (1999) PCL:YV Not divided into groups______9a. Siemsen (1999) PCL-R H:> 28; M:< 27 H:23; M:48 9b. Young et al. (2000) PCL-R H:> 30; M:< 29 H:32; M:86______10a. Smith (1995) PCL-R* H:> 30; M:20-29; L:< 19 H:20; M:20; L:20 10b. Smith et al. (1997) PCL-R* H:> 29; L:< 17 H:24; M:21______11a. Nassen (2008) PCL-R H:> 30; M:< 27 H:55; M:42 11b. Welsh (1999) PCL-R H:> 30; M:20-29; L:< 19 H:65; M:63; L:25
(continued on next page)
Abbreviations: PCL = Refers to all versions of Hare Psychopathy Checklist; original PCL = Hare Psychopathy Checklist as published by Hare (1980); PCL-R = Hare Psychopathy Checklist, Revised; PCL-YV = Hare Psychopathy Checklist, Youth Version; PCL-SV = Hare Psychopathy Checklist, Screening Version; PCL-R* = version of PCL-R modified for use with adolescents. H = High psychopathy; M = Medium Psychopathy; L = Low Psychopathy. Rorschach and Psychopathy, Supplementary Material 3
Appendix 1: Characteristics of Studies Included in Meta-Analysis (continued).
Interrater Reliability ______
Rorschach Scores PCL ______
ID Authors Statistic Range Median Statistic Reliability ______1a. Ballard (2006) Kappa .69-.91 .85 Spearman .94 1b. Loving (1998) Pct. Agreement .92-1.00 .94_____Spearman______.94______1c. Loving & Russell (2000) Pct. Agreement .92-1.00 .94 Spearman .94 2a. Cunliffe (2002) Pct. Agreement .79-1.00 .86 Spearman .98______2b. Cunliffe & Gacono (2005) Pct. Agreement .79-1.00 .86 Spearman .98 3. Darcangelo (1997) ICC______.80-1.00 .95______ICC______.90______4. Egozi-Profeta (1999) ? ? ? ? ? 5a. Gacono & Meloy (1991) ?______?______?______Spearman______.89______5b. Gacono & Meloy (1994) ? ? ? ? ? I 5c. Gacono, Meloy, & Berg (1992) ?______?______?______Spearman______.94______5d. Gacono, Meloy, & Heaven(1990) ? ? ? Spearman .89 5e. Heaven (1989) ? ?______?______Spearman______.89______5f. Meloy & Gacono (1992) Pct. Agreement .92-1.00 .96 Spearman .89 6. Hartmann et al. (2006) ICC______.68-.93___.86______?______?______7. Muntz (1999) Pct. Agreement .81-.95 .89 Pearson .97 8. Ponder (1999) Pct. Agreement__.85-1.00__.95______ICC______.96______9a. Siemsen (1999) Kappa .66-1.00 .91 ? ? 9b. Young et al. (2000) _?______?______?______?______?______10a. Smith (1995) Pct. Agreement >.80 ? ICC .80 10b. Smith et al. (1997) Pct. Agreement __ ?___ .94_____Spearman______.96______11a. Nassen (2008) ICC .14-1.00 .84 ? ? 11b. Welsh (1999) ? ? ? ? ?
(continued on next page)
Abbreviations: Pct. Agreement = Percentage Agreement; Spearman = Spearman’s rho; Pearson = Pearson’s r; ICC = Intraclass Correlation Coefficient. Rorschach and Psychopathy, Supplementary Material 4
Appendix 1: Characteristics of Studies Included in Meta-Analysis (continued).
PCL Scorers ______
ID Authors Professional Qualifications Training in PCL ______1a. Ballard (2006) Forensic psychologists ? 1b. Loving (1998) __Forensic psychologists, doctoral students______?______1c. Loving & Russell (2000) Forensic psychologists, doctoral students ? 2a. Cunliffe (2002) __Doctoral students______Trained in scoring & administration 2b. Cunliffe & Gacono (2005) Doctoral students Trained in scoring & administration 3. Darcangelo (1997) __Doctoral student______?______4. Egozi-Profeta (1999) Doctoral student ? 5a. Gacono & Meloy (1991) __Doctoral students______?______5b. Gacono & Meloy (1994) Doctoral students ? 5c. Gacono, Meloy, & Berg (1992)__Doctoral students______?______5d. Gacono, Meloy, & Heaven(1990) Doctoral students ? 5e. Heaven (1989) Doctoral students ______?______5f. Meloy & Gacono (1992) Doctoral students ? 6. Hartmann et al. (2006) Doctoral student and “assistant”______Attended professional workshop_____ 7. Muntz (1999) Doctoral student ? 8. Ponder (1999) __Doctoral student ______Attended professional workshop_____ 9a. Siemsen (1999) Forensic psychologists ? 9b. Young et al. (2000) Forensic psychologists ______?______10a. Smith (1995) Forensic psychologist ? 10b. Smith et al. (1997) Doctoral student ______?______11a. Nassen (2008) Forensic psychologists Formally trained in scoring & administration 11b. Welsh (1999) Forensic psychologists Formally trained in scoring & administration Rorschach and Psychopathy, Supplementary Material 5
Appendix 2: Validity coefficients of non-dichotomous Rorschach variables, by study.
Study Number (from Appendix 1) and validity coefficients Rorschach ------Variable Study r Study r Study r Study r Study r Study r Study r ------
AgPast 1a. 0.347 3. 0.170 5b. -0.200 6. 0.689 7. 0.080
AgPotential 1a. 0.353 3. 0.140 5b. -0.028 6. 0.587 7. 0.058
M- 5b. 0.038 6. 0.497 11a. 0.000
Sum T 1c. 0.412 2b. -0.155 3. 0.500 4. 0.190 5b. 0.212 7. 0.019 9a. 0.162
10b. -0.030 11b. 0.062
Personals 2a. 0.070 3. 0.540 4. 0.170 5b. 0.016 7. -0.047 8. 0.060 9a. 0.227
10a. -0.048 11b. 0.097
EGOI 1c. 0.076 3. 0.250 5b. 0.139 7. 0.059 8. 0.130 9a. 0.200 10a. 0.089
11b. 0.000
AgContent 1a. 0.063 3. -0.090 5b. -0.165 6. 0.554 7. 0.067
Sum V 1c. 0.101 2a. 0.143 4. -0.020 5b. 0.094 7. 0.011 9a. 0.113
FC 5b. 0.189 7. 0.019 11b. 0.031
COP 2b. -0.090 5b. 0.009 7. 0.267 8. -0.050 9a. 0.189
CF 5b. -0.046 7. 0.218
(Table continues on next page) Rorschach and Psychopathy, Supplementary Material 6
Appendix 2: Validity coefficients of non-dichotomous Rorschach variables, by study. (continued)
Study Number (from Appendix 1) and validity coefficients Rorschach ------Variable Study r Study r Study r Study r Study r Study r Study r ------
Reflections 1c. 0.426 2b. -0.155 3. 0.110 4. -.270 5b. 0.133 7. 0.053 9a. 0.157
10a. 0.165 11b. -0.096
Sum Y 1c. -0.002 3. 0.230 4. -0.150 5b. 0.201 7. 0.195 10b. 0.076 11b. -0.013
Afr 2a. 0.024 5b. 0.161 7. -0.102 11b. 0.025
Pure H 1c. -0.020 5b. -0.058 8. 0.20 11b. 0.044
Pure C 5b. 0.084 7. -0.072
Space 1c. 0.173 5b. -0.014 7. -0.071 11b. -0.091
FD 1c. 0.107 5b. -0.069 7. -0.122 11b. -0.065
AG 1a. -0.147 3. -0.060 5b. 0.115 6. -0.080 7. 0.126 8. -0.020 9a. -0.135
10b. -0.274 Rorschach and Psychopathy, Supplementary Material 7
Appendix 3: Validity coefficients of dichotomous Rorschach signs, by study.
Study Number (from Appendix 1) and validity coefficients ------Rorschach Sign Study phi Study phi Study phi Study phi Study phi Study phi Study phi ------
COP = 0 5b. 0.005 7. 0.171 9b. 0.216
Sum Y = 0 1c. 0.071 3. 0.421 5b. 0.129 7. 0.279 10b. 0.141 11b. -0.085
Afr < .50 2a. 0.236 7. 0.008
Sum T = 0 1c. 0.376 2b. -0.227 3. 0.527 5b. 0.236 7. -0.073 8. -0.060 9b. 0.140
10b. -0.085 11b. 0.099
M- > 0 5b. 0.115
AgPast > 0 1a. 0.282 5b. -0.108
AgPotential > 0 1a. 0.254 5b. -0.078
Reflections > 0 1c. 0.329 2a. -0.096 5b. 0.173 7. -0.115 8. 0.140 9b. 0.148 10a. 0.053
11b. -0.013
AG = 0 1a. -0.090 5b. 0.065 7. 0.072 9b. -0.122 10b. -0.269
Personals > 0 2b. -0.012 3. 0.450 5b. 0.160 7. -0.189 10a. -0.024
FD > 0 1c. 0.274 2b. 0.159 5b. -0.038 7. -0.101 11b. -0.067
Pure C > 0 2a. -0.109 5b. 0.035 7. 0.007 9b. 0.018
(Table continues on next page) Rorschach and Psychopathy, Supplementary Material 8
Appendix 3: Validity coefficients of dichotomous Rorschach signs, by study. (continued)
Study Number (from Appendix 1) and validity coefficients ------Rorschach Sign Study phi Study phi Study phi Study phi Study phi Study phi Study phi ------
Sum V > 0 1c. 0.117 2b. -0.255 5b. 0.004 7. 0.081
S > 2 1b. 0.195 5e. -0.009 7. -0.061 9b. 0.065 11b. -0.102
EGOI > .44 7. -0.133 9b. 0.013 10a. 0.000 11b. -0.040
AgContent > 0 1a. -0.048 5b. -0.065
(CF+C)>FC+1 7. 0.027 11b. -0.092
Pure H < 2 1c. -0.328 11b. 0.093