i Children’s Psychological Processes Scale (CPPS) Professional Manual Milton J. Dehn, Ed.D. Published by Schoolhouse Educational Services, LLC ii Published by Schoolhouse Educational Services, LLC Copyright© 2012 by Schoolhouse Educational Services, LLC. All rights reserved. No part of this work may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopying or by any information storage or retrieval system, without the prior written permission of Schoolhouse Educational Services, LLC. Address requests for permission to Schoolhouse Educational Services, LLC, N253 Johnson Road, Stoddard, WI 54658. Printed in the United States of America. iii Table of Contents List of Tables and Figures ………………………………………………………………….. vi Acknowledgements ………………………………………………………………………….. vii About the Author and Measurement Consultant …………………………………………. viii Chapter 1 Introduction ………………………………………………………………………. 1 The Needs for the CPPS …………………………………………………….... 1 Psychological Processes Measured by the CPPS …………………………….. 2 Attention………………………………………………………………. 3 Auditory Processing ……………………………………………..….... 3 Executive Functions ………………………………………………….. 3 Fine Motor ………………………………………………………….... 3 Fluid Reasoning …………………………………………………….... 4 Long-Term Recall ……………………………………………………. 4 Oral Language ………………………………………………………... 4 Phonological Processing ……………………………………………… 5 Processing Speed ………………………………………………........... 5 Visual-Spatial Processing …………………………………………….. 5 Working Memory …………………………………………………….. 5 General Processing Ability ………………………………………….... 6 Psychological Processes and Academic Learning …………………………….. 6 Basic Reading Skills…………………………………………………… 7 Reading Fluency……………………………………………………….. 7 Reading Comprehension………………………………………………. 7 Mathematics Calculation………………………………………………. 8 Mathematics Reasoning………………………………………………... 8 Written Language……………………………………………………… 8 Applications of the CPPS………………………………………………………. 8 Diagnosis………………………………………………………………. 8 Identification of Student Strengths and Weaknesses………………….. 8 Screening………………………………………………………………. 9 Measuring Change……………………………………………………… 9 Caveats…………………………………………………………………. 9 User Qualifications……………………………………………………... 10 Chapter 2 Development, Standardization, and Norming…………………………………….. 11 Item Development, Calibration, and Selection………………………………….. 11 Pilot Study……………………………………………………………… 11 Item Tryout……………………………………………………………... 12 iv Item Calibration Studies and Scaling…………………………………… 13 Rasch Item Analysis and Scale Development Procedures……………………………………………………… 13 Incorporation of the W-Scale…………………………………… 13 Final Item Selection …………………………………………… 14 The CPPS Standardization Sample ……………………………………………... 14 Socioeconomic Status ………………………………………………….. 16 Parent Education Level ……………………………………….. 17 Academic Skills Rankings ……………………………………. 17 Hispanic Status ………………………………………………………… 17 Gender Differences ……………………………………………………. 18 Age Differences ……………………………………………………….. 19 Construction of Norms …………………………………………………………. 21 Subject Weighting …………………………………………………….. 21 Calculation of CPPS Subscale and General Processing Ability Derived Scores ………………………………………………… 21 Calculation of CPPS Strength and Weakness Discrepancy Scores ………………………………………………………………….. 23 Chapter 3 Reliability and Validity ……………………………………………………………. 25 Reliability ………………………………………………………………………. 25 Internal Consistency …………………………………………………… 25 Standard Error of Measurement ……………………………………….. 26 Inter-Rater Reliability ………………………………………………….. 27 Construct Validity ………………………………………………………………. 28 Evidence Based on Test Content ……………………………………………….. 28 Expert Review …………………………………………………………. 28 Developmental Evidence ………………………………………………. 29 External Validity Evidence …………………………………………………….. 30 CPPS Relations with Academic Skills ………………………………… 30 Woodcock-Johnson III Tests of Achievement ………………... 30 Academic Skills Ranking ……………………………………... 32 CPPS Relations with Parent Education Level …………………………. 33 CPPS Relations with Cognitive Abilities ……………………………… 33 CPPS Relations with a Measure of Executive Functions ……………… 35 CPPS Diagnostic Utility for Students with Learning Disabilities ……………………………………………………………... 37 Internal Structural Validity Evidence …………………………………………... 38 Principal Component Analysis ………………………………………… 39 Exploratory Factor Analysis …………………………………………… 41 Cluster Analysis ……………………………………………………….. 44 Chapter 4 Use and Interpretation …………………………………………………………….. 47 Using the CPPS ………………………………………………………………… 47 v Accessing the Online CPPS Teacher Rating Form ……………………. 47 Completing the Online CPPS Teacher Rating Form ………………….. 48 Generating the CPPS Report ………………………………………….. 48 Interpretation of CPPS Results ………………………………………………… 48 T-Scores and Percentiles ……………………………………………… 48 Confidence Intervals ……………………………………………... ….. 49 W-Scores ……………………………………………………………… 50 Discrepancy Scores …………………………………………............... 51 Interpretive Steps ……………………………………………………………… 52 Step 1: Interpret General Processing Ability ………………………… 52 Step 2: Evaluate and Interpret Clinical Groupings of Subscales …….. 53 Step 3: Interpret Individual Subscales ……………………………….. 53 Step 4: Interpret Intra-Individual Strengths and Weaknesses ……….. 54 Step 5: Determine Base Rate ………………………………………… 55 Step 6: Interpret Responses to Individual Items ……………………… 55 Step 7: Identify Psychological Processes for Intervention …….. …….. 55 Step 8: Identify Cognitive Processes for Additional Assessment ……. 56 Step 9: Compare Results from Multiple Raters ……………………… 56 Step 10: Consider Relations with Achievement Scores ……………… 57 Diagnosis of LD ……………………………………………………………….. 58 Case Study …………………………………………………………………….. 58 Step 1: Interpret General Processing Ability ………………………… 60 Step 2: Evaluate and Interpret Clinical Groupings of Subscales …….. 60 Step 3: Interpret Individual Subscales ……………………………….. 60 Step 4: Interpret Intra-Individual Strengths and Weaknesses ……….. 61 Step 5: Determine Base Rate ………………………………………… 61 Step 6: Interpret Responses to Individual Items ……………………… 62 Step 7: Identify Psychological Processes for Intervention …………… 63 Step 8: Identify Cognitive Processes for Additional Assessment ……. 63 Step 9: Compare Results from Multiple Raters ………………………. 63 Step 10: Consider Relations with Achievement Scores ……………… 63 Case Study Diagnosis …………………………………………………. 63 Appendix A CPPS 121 Items Grouped by Process ………………………………………….. 65 Appendix B Communities and States in CPPS Standardization Sample ………………….. 68 Appendix C Z-Score Normal Probability Tables ……………………………………………. 70 Appendix D Sample CPPS Score Report …………………………………………………….. 72 References ………………………………………………………………………………………. 75 vi List of Tables and Figures Tables Table 1.1 Psychological Processes Measured by the CPPS ………………………………………………… 2 Table 1.2 Psychological Processes Significantly Related With Types of Academic Learning ……………. 7 Table 2.1 Demographic Characteristics of CPPS Standardization Sample with Weighting ………………. 15 Table 2.2 CPPS Gender Differences Across All Age Groups ……………………………………………… 18 Table 2.3 CPPS W-Scale Ability Range ……………………………………………………………………. 21 Table 2.4 CPPS Summary Statistics by Age Group ………………………………………………………… 23 Table 3.1 Cronbach’s alpha (α) Reliability Coefficients by Age …………………………………………… 26 Table 3.2 Cronbach’s alpha (α) Reliability Coefficients and SEM Values by Normative Age Groups …... 27 Table 3.3 Inter-Rater Reliability Coefficients for 22 Subjects ……………………………………………… 28 Table 3.4 CPPS W-Scores for WJ III Study ………………………………………………………………… 31 Table 3.5 WJ III ACH W-Scores ……………………………………………………………………………. 31 Table 3.6 Pearson Correlation Coefficients between CPPS and WJ III ACH W-Scores …………………... 32 Table 3.7 Results of ANOVA Comparing Academic Skills Ranking with CPPS GPA Score …………….. 33 Table 3.8 Results of ANOVA Comparing Estimated Parent Education Level with CPPS GPA Score …… 33 Table 3.9 WJ III COG W-Scores ……………………………………………………………………………. 34 Table 3.10 Pearson Correlation Coefficients between CPPS and WJ III COG W-Scores …………………. 36 Table 3.11 Pearson Correlations between CPPS Subscales and BRIEF Scales ……………………………. 37 Table 3.12 CPPS Scores of LD Subjects Compared with a Matched Sample ……………………………… 38 Table 3.13 CPPS Subscale Intercorrelations ……………………………………………………………….. 39 Table 3.14 Subscale Loadings (sorted by median loading) on the CPPS General Component …………… 41 Table 3.15 Ages 5-6 Exploratory Factor Analysis Solutions ………………………………………………. 41 Table 3.16 Ages 7-8 Exploratory Factor Analysis Solutions ………………………………………………. 42 Table 3.17 Ages 9-10 Exploratory Factor Analysis Solutions …………………………………………….. 42 Table 3.18 Ages 11-12 Exploratory Factor Analysis Solutions ……………………………………………. 43 Table 4.1 Interpretive Guidelines for CPPS T-Scores ……………………………………………………… 49 Table 4.2 Example of Intra-Individual Strengths and Weaknesses Table ………………………………….. 52 Table 4.3 Definitions of Processes Measured by the CPPS ………………………………………………… 54 Table 4.4 Example of T-Scores from Multiple Raters …………………………………………………....... 57 Table 4.5 Case Study WJ III Scores ………………………………………………………………………… 59 Table 4.6 Case Study CPPS Scores ………………………………………………………………………… 60 Table 4.7 Case Study Intra-Individual Strengths and Weaknesses Table ………………………………….. 61 Table 4.8 Case Study Responses to Individual Items ………………………………………………………. 62 Table 4.9 Case Study T-Score to Standard Score Conversion Table ………………………………………. 64 Figures Figure 2.1 Median W-Score Plot of Working Memory Subscale ………………………………………….. 20 Figure 3.1 Cluster Tree (Wards method: Ages 5-6) ……………………………………………………….. 45 Figure 3.2 Cluster Tree (Wards method: Ages 7-8) ……………………………………………………….