DOCUMENT RESUME ED 099 817 CS 001 538 AUTHOR Siegel, Arthur I.; Burkett, James R. TITLE Application of Structure-of-intellect and Psycholinguistic Concepts to Reading Comprehensibility Measurement. INSTITUTION Air Force Human Resources Lab., Lowry AFB, Colo. Technical Training Div. REPORT NO AFFIRL-TR-74-49 PUB DATE Sep 74 NOTE 160p. EDRS PRICE MF-$0.75 HC-$7.80 PLUS POSTAGE DESCRIPTORS Communication (Thought Transfer); *Computational Linguistics; Military Personnel; *Psycholinguistics; Psychometrics; *Readability; Reading Achievement; *Reading Comprehension; *Reading Research ABSTRACT Air Force training depends to a considerable extent on the transmission of information through textual materials. This study was performed to define and clarify methods for increasing the capability of written materials to transfer information to the reader. Variables drawn from current psycholinguistic and intellective function literature were defined and related to current theories of learning. Then, for each variable, two sets of reading materials were developed and administered to the airmen. After reading the materials, the airmen were tested to determine how well they comprehend the various materials. Comparison of the comprehension of materials which were heavily loaded with psycholinguistic and intellective variables with comprehensibility of materials which were low on these variables provided the basis for statements relative to the effects of manipulating these variables. The results were recorded and'aralyzed and new techniques for judging the comprehensibility of textual materials have been developed and made available. (Author/TS) U S DEPARTMENT OF HEALTH. EDUCATION A WELFARE NATIONAL INSTITUTE OF EDUCATION BEST COPY AVAILABLE THIS DOCUMENT HAS BEEN REPRO 1 DUCED EXACTLY AS RECEIVED FROM THE PERSON OR ORGANIZATION ORIGIN MING IT POINTS OF VIEW OR OPINIONS AFHRL-TR-74-49 STATED DO NOT NECESSARILY REPRE SENT OFFICIAL NATIONAL INSTITUTE OF EDUCATION POSITION OR POLICY AIR FORCE APPLICATION OF STRUCTURE-OF-INTELLECT AND PSYCHOLINGUISTIC CONCEPTS TO READING COMPREHENSIBILITY MEASUREMENT H U By Arthur I. Siegel Applied Psychological Services, Inc. M Wayne, Pennsylvania 190E17 A James R. Burkett N TECHNICAL TRAINING DIVISION Lowry Air Force Base, Colorado 80230 R E September 1974 S 0 Approved for public release; distribution unlimited. LABORATORY MR FORCE SYSTEMS COMMAND BROOKS AIR FORCE BASE,TEXAS 78235 2 NOTICE. When US Government drawings, specifications, or other data are used for any purpose other thanadefinitelyrelated Government procurement operation,theGovernmenttherebyincurs no responsibility nor any oblirt ion whatsoever, and the fact that the Government may have formulated, furnished, or in any way supplied the said drawings, specifications. or other data is not to be regarded by implication or otherwise, as in any manner licensing the holder or any other person or corporation, or conveying any rights or permission to manufacture, use, or sell any patented invention that may inany way be related thereto. This report was submitted by Applied Psychological Services, Inc., Wayne, Pennsylvania 19087, under contract F41609.73-C0018, project 1121, with Technical Training Division, Air Force Human Resources Laboratory (AFSC), Lowry Air Force Base, Colorado 80230. Dr. James R. Burkett, Technical Training Division,was the contract monitor. This report has been reviewed and cleared for open publication and/or publicrelease by the appropriate Office of Information (01) in accordance with AFR 190-17 and DoDD 5230.9. There isno objection to unlimited distribution of this report to the public at large,or by UDC to the National Technical Information Service (NTIS). This report has been reviewed and is approved. MARTY R. ROCKWAY, Technic 11 Director Technical Training Division Approved for publication. HAROLD E. FISCHER, Colonel, USAF Commander 3 UNCLASSI PIED SECURITY CLASSIFICATION OF THIS PAGE (When Detn Entered) READ INSTRUCTIONS REPORT DOCUMENTATION PAGE BEFORE COMPLETING FORM 3 RECIPIENT'S CATALOG NUMBER 1 REPORT NUMBER 2. GOVT ACCESSION NO. A FHRL- TR-74-49 5. TYPE OF REPORT & PERIOD COVERED 4. TITLE (and Subtitle) . A PPLICATV.)N OFSTRUCTURE-OP-INTELLECT Final AND PSYCHOLINGUISTICCONCEPTS TO READ- ING COMPREHENSIBILITYMEASUREMENT 6. PERFORMING ORG. REPORT NUMBER S. CONTRACT OR GRANT NUMBER(4) 7.AUTHOR(s) Arthur I. Siegel James R. Burkett F41609 -73 -C -0018 10. PROGRAM ELEMENT. PROJECT. TASK 9 PERFORMING ORGANIZATION NAME AND ADDRESS AREA fa WORK UNIT NUMBERS Applied Psychological Services, Inc. 62703F Wayne, Pennsylvania 1.9087 11210408 12. REPORT DATE 11 CONTROLLING OFFICE NAME AND ADDRESS Laboratory (AFwiSeptember 1974 HQ, Air Force Human Resources 13 NUMBER OF PAGES 78235 Brooks Air Force Base, Texas 164 14.. MONITORING AGENCY NAME & ADDRESS(!( different fromControl ltr-ii Office) IS. SECURITY CLASS. (of this report) Technical Training Division Unclassified Air Force Human Resources Laboratory 15a.DECLASSIFICADOWNGRADING Lowry Air Force Base, Colorado 80230 SCHEDULE 16. DISTRIBUTION STATEMENT (of this rt) Approved for public release; distributionunlimited. 17. DISTRIBUTION STATEMENT (of the abstract entered In Mock 20. ifdifferent from Report) 10. SUPPLEMENTARY NOTES i by block number) 19.KEY WORDS (Continue on reverse side if necessary and identify readability text analysis comprehensibility semantic information processing computational linguistics syntactical analysis reverse Mee /Ivan silt:feral f. idy thlockn I 20. A B ;lie 6thraeasurement of textual read- ability/comprehensibility through psycholinguisticsand through intellective var- iables are presented. Twoexperiments, each investigating thepotential of each of these areas forreadability/comprehensibility measurement, aredescribed and the results of theseexperiments are given. The resultssupported a conten- tion favoring the potentialof psycholinguistics and intellectiveconcepts for readability/comprehensibility measurement.Concepts are presented for auto- mating the measurements...............-described. DD FORM EDITION OF 1 NOV 65 IS OBSOLETE 40101 JAN 731473 UNCLASSIFIED Sl CURITY CLASSIFICATION OF Tt AGE (When Data Erherve SUN! NIA HY Problem Air Force training depends to a considerable extent on the transmission of information through textual materials.This pres- ent work was performed to define andclarify methods for increas- ing the capability of written materials to transferinformation to the reader. Approach Variables drawn from current psycholinguistic andintelle- tive function literature were defined andrelated .o current theories of learning. Then, for each variable, two sets.J reading materials were developed: (1) a setwhich is heavily weighted :n the variables, and (2) a set which is lightly weighted.These sets of materials were administered toairmen.After reading the materials, the air- men were tested to determinehow we" comprehended the vari- ous materials.Comparison of the comprellension of the materials which were heavily loaded on thepsycholingtostic and the intellec- tive variables with the comprehensibilityof the materials which were low on these variables provided the basisfor statements relative to the effects of manipulating thesevair.bles on comprehensibility. Results The effects of psycholinguistic and intellectivefunction re- lated variables on the comprehensibilityof written materials were demonstrated.:Methods for improving thereadability/comprehen- sibility of te':tual materials were defined.New techniques for judg- ing the comprehensibility of textualmaterials have been made avail- able, and initial insights into methodsfor computer analysis of text have been developed. Conclusions Written training materials caa nowbe made more efficient and cost-effective.The findings are not only pertinent toincreas- ing the comprehensibility of trainingmaterials but also to the com- prehensibility of all written materials. 5 PREFACE *I'he editors wish to acknowledge the contribution ofa num- ber of individuals at Applied Psychological Services, Inc., inpre- paring this report.Chapter II,Readability/Comprehensi.bility as Related to the Structure-of-Intellect Model,was written by Arthur I. Siegel and Brian A. Bergman.Chapter III,Psycho linguistic De- terminants of Readability, was authored by Joseph V. Lambert and Arthur I. Siegel.Finally, Chapter IV, Feasibility of Automatic Calculation of Zeadability/Comprehensibility Metrics, was pre- pared by J. Jay Wolf and Arthur I. Siegel. 2 6 TABLE OF CO.N;TENTS Page I. OVERVIEW 11 Purpose of Present Program 13 II.READAI3ILITY/CO1IPREHENSIBILITY AS REI.AllED TO NIODEI 15 Factors Derived from the SI Model Involv- ed in Readability/ Comprehensibility 17 Cognition of Semantic Units (UMW 17 Cognition of Semantic Relations (CNIR) Memory of Semantic Units (MMU) 18 Evaluation of Symbolic Units (ESU) 18 Memory of Figural Units (WU) 18 Divergent Production of Semantic Units (MIL) 19 Convergent Production of Semantic Systems (NMS) 19 Convergent Production of Semantic Implications (NMI) 19 Related Literature 19 The Reading Literature 20 Classical Behavior Theory 23 Gestalt Theory 28 Phenomenological Theory 32 Methods and Procedures 33 Hypotheses and Experimental Design 33 Felevant Structure-of-Intellect (SI) Factors 33 Cognition of Semantic Units (C'MU) 34 Cognition of Semantic Relations (C'MR) 37 Memory of Figural Units (MFU) 41 Memory of Semantic Units (MMU) 45 Convergent Production of Semantic Implications (NMIi48 onvergent Production of Semantic Systems(NMS1 52 Divergent Production of Semantic Units (DMU) 56 Evaluation