DOCUMENT RESUME ED 255 665 CE 041 126 AUTHOR Richardson, J. Jeffrey TITLE Artificial Intelligence: An Analysis of Potential Applications to Training, Performance Measurenient, and Job Performance Aiding. Interim Report for Period September 1982-July 1983. INSTITUTION Denver Univ., Colo. Denver Research Inst. SPONS AGENCY Air Force Human Resources Lab., Brooks AFB, Texas. REPORT 110 AFHRL-TP-83-28 PUB DATE Sep 83 CONTRACT F33615-82-C-0013 NOTE 79p. PUB TYPE Reports Research/Technical (143) EDRS PRICE MF01/PC04 Plus Postage. DESCRIPTORS *Artificial Intelligence; *Computer Oriented Programs; Computer Software; Evaluation Criteria; *Evaluation Methods; *Job Performance; Job Training; *Military Training; Postsecondary Education; Program Development; Research and Development; Research Projects; Specifications IDENTIFIERS *Air Force ABSTRACT This paper is part of an Air Force planning effortto develop a research, development, and applications program for theuse of artificial intelligence (AI) technology in three targetareas: training, performance measurement, and job performance aiding. The paper is organized in five sections that (1) introduce the reader to AI and those subfields of AI that are most relevant to thisprogram, (2) report on relevant ongoing research and development sponsored by the Department of Defense, (3) establish the challenges facing the Air Force in three target areas and explain how each presents opportunities for AI applications, (4) draw out important practical concerns that must be faced by an AI research and development program, and finally, (5) propose a set of recommendations for building an Air Force AI applications program in training, performance measurement, and job performance aiding. An eight-page , bibliography and a list of current relevant Department of Defense research projects are included in the report. (Author /::C) *********************************************************************** Reproluctions supplied by EDRS are the best thatcan be made from the original. document. ************************************N********************************** AFHRIMP8328 BEST COPY AVAILABL MR FORCE t=3 ARTIFICIAL INTELLIGENCE: w AN ANALYSIS OF POTENTIAL APPLICATIONS TO TRAINING, PERFORMANCE MEASUREMENT, AND JOB PERFORMANCE AIDING By J. Jeffrey Richardson Denver Research Institute M University of Denver Denver, Colorado 80208 TRAINING SYSTEMS DIVISION Lowry Air Force flaw, Colorado 80230 vc S September 1983 Interim Report for Period September 1982 July 1983 0 U R Approved for public release; distribution unlimited. a S LABORATO A iqoiookiiviitiohob(414flAu,N4fe-ef,wiomv4.-fw-*/...i4-1,,go,o;:otti: ELECTE "NA AIR FORCE SYSTEMS COMMAND PO BROOKS AIR FORCE BASe,TEXAS 78235 OCT 1 4 1983 II S DEPAIIIMFNI OF I DUCA HUN NA flONAI FoticAlION ()(, At()^4,1; ', ()WAI ,INIfN I 141( B 83 10 13 002 riti "1,1.,011,.111, 1),,goilon NOTICE When Government drawings.. specifications.or other data are used for any purpose other than in connoction with a definitely Government-relatedprocurement, the United States Government incurs no responsibilityor any obligation whatsoever. The fact that the Government may have formulatedor in any way supplied the said drawings, specifications, ii or other data, is 1101 to be regarded by implication, or otherwise inany manner construed, as licenuiog the h4Ader, or any other person or corporation;or as conveying any rights or permisaLon to manuticotre, use,or sell any patented invention that may in any way be related thereto. The Public Affairs Office has reviewed thispaper, and it is releasable to the National Technical Information Service, where it will be availableto the General public, including fete* nationals. This paper has been reviewed and is approved forpublication. BRIAN E. DALLMAN Contract M,nitor JOSEPH Y. YASUTAKE, Technical Director Training Systems Division ALLEN 1. PARTIN, Lt Colonel, USAF Chief, Training Systems Division J BEST COPY AVAILABLE Unclassified CURRY CU1S3IFICATI0N OF THIS PAGR Mew remora READ INSTRUCTIONS REPORT DOCUMENTATION PAGE BEFORE COMPLETING FORM 1. REPORT NUMBER 2. GOVT ACCESSION NO. & RECIPX.NTS CATALOG NUMBER AFH RL-TP83-28 A 1)-4 / 3 4 4.W= (awl Soitifit) 5. TYPE OF REPORT & PERIOD COVERED ARTIFICIAL INTELUGENCE: AN ANALYSIS OF Interim POTENTIAL APPLICATIONS TO TRAINING, PERFORMANCE September 1982 -July 1983 MEASUREMENT, AND JOB PERFORMANCE AIDING 6. PERFORMING ORG. REPORT NUMBER 7. AUTIKHt (s) 3. CONTRACT OR GRANT NUMBER (s) J. Jeffrey Richardson F33615-82-C-0013 9 PERFORMING ORGANIZATION NAME AND ADDRESS 10. PROGRAM ELEMENT, PROJECT, TASK Deaver Resesreh Institute AREA & WORK UNIT NUMBERS University of Denver 62205F Denver, r:alorado 80208 11210915 II.CONTP.OLLING OFFICE NAME AND ADDRESS 12. REPORT DATE HQ Air Force Human Reliance. Laboratory (A7SC) September 1983 Brooks Mr Force Rue, Texas 78235 13. NUMBER OF PAGES 80 14. MONITORING AGENCY NAME & ADDRESS (y* dermal front Controlling Office) 15. S'..CURTTY CLASS (V AU report) Training Systems Division .clasaified Air Force Human Resources Laboratory Lowry Air Force Rase, Colorado 80230 15.s. DECLASSIFICATION/DOWNGRADING SCHEDULE 16. DISTRIBUTION STATEMENT (of Otis Report) Approved for public release; distribution unlimited. 17. DISTRIBUTION STATEMENT (of Air abstract entered ut MA 20, if different front Report) 18. SUPPLEMENTA :1 Y NOTE) 19. KEY WOFIPS (Cows,wwo on town side ! if necrinvy and kingly by block mimetic.) artificial intelligence military research computer-sided diagnosis performance tests computer-assisted instruction task analysis job analysis training job performance aii.s 20. ABSTRACT (Colunum on rtwrot rid. f i nooesitiry an i nitrify& byblockagnsbe-I ti This paper is part of a planning effort to developa research, development, and applications Nog= for the utilization of artificial intelligence (Al) technology in three targetareas: training, performance measurement, and job performance aiding. The paper10 introduces the reader to 141 and those subfielda of AI thatare most relevant to this program, ili) reports on rrlevant ongoing ret.esrch and development sponsored by the Department of Defenso,Jp) establishes the challenges facing the Ak Force in the three targetareas and explains how each presents opportunities for Al applications,, draws out important practical concerns which must be faced by an Al research and development____ Da Farm14'13 LOTTION or 1 NOV 65 N °MOLE-ff. Unclitssifiefl SECURITY CLASSIFICATION of TILLS PACE (fawn Nat EAkrid) BEST COPY AVAILABLE threlalsiged SWUM CLASSIFICATION Of TIM PAGE MhosDag inkred) hem 20 (Costumed) plegram, and finally, #proposes a set of reconunendationa for buildingan Air Force Al application, program in training. performance measurement, and job performance aiding. lmrlaesifird SECURITY CLAMIFICATION OF THIS PAGE (WhenDodo Eruerrd) BEST COPY AVP'./\SLE AFIIRL Technical Paper 8.28 September 1983 ARTIFICIAL INTELLIGENCE' AN ANALYSIS OF POTENTIAL APPLICATIONS TO TRAINING, PERFORMANCE MEASUREMENT, AND JOB PERFORMANCE AIDING By J. Jeffrey Richardson Soctial Systems Research and Evaluation Dim-taints Denver Researeh Inatitate University of Denver Denver, Colorado 80208 Reviewed by Brian E. Dab's= Research Psyeiologist Submitted for publication by David L. Pohlman, Major, USAF Chief, Skills Development Branch This interim report documentsa scgmen. of a larger technical in ogram. It is published in the interest of scientific and technicalinfortnation exchange. BEST COPY AVAILABLE ACKNOWLEDGEMENTS Dr. Peter G. Poison, Dep.irtment of Psychology, University of Colorado, andDr.MarkL.Miller,Computec*Thought Corporation,contributedas consultants to the development of thispaper. We are grateful for their help and cooperation. Program officers with the vario:is DoD agencies doing workrelevant to this report were extremely helpful in azsistingusin acquiring current information regarding ongoing research activities in DoD. Weare grateful to our technical monitor; Mr. Brian Dailman, Air Force Purlr rtes3urces 1,ot:oratory, for his encouragement to go beyonda survey treatment c..f, the issues and develop a tentative plan of action for Al applications. Aocco51o7 For r: is ffiA3J Tn DTIC O ELEci-E7f08 OCT 1 4 1983 [By . !IV DistriNtion/ Avsilt,bility Codes B Avail any' /or Dist Pr i BEST COPY AVAILABI TABLE OF CONTENTS ACKNOWLEDGEMENTS CHAPTER I. INTRODUCTION Background of This Report Capsule History of Al Artificial Intelligence 2 2 CHAPTER II. CURRENTRELEVANT DOD RESEARCH AND DEVELOPMENT 7 DoD Centel s of Activity 7 CHAPTER III. CHALLENGES AND APPROACHES 17 Introduction Task Analysis 17 Training: In-Residence 18 and On-the-Job 24 Performance Measurement 33 Job Performance Aiding 36 Integrating Training,Measurement, 3PAs, and Job Design 39 CHAPTER N. PRACTICAL CONSIDERATIONS 41 Hardware Software Tools 41 Personnel 42 43 Guidelines for Practical Efforts 44 CHAPTER V. CONCLUSIONS AND RECOMMENDATIONS 48 Conclusions Recommendations 48 49 BIBLIOGRAPHY 52 APPENDIX A: CURRENTRELEVANT DoD RESEARCH PROJEC l'S--DETAILED LISTING 61 iii LPREVIOUS PACE IS OLANK rsi CHAPTER I. INTRODUCTION kl ,... Artificial intelligence (Al) isone of the emerging technologies of the 1980s. Al is the use ofcomputers to perform tasks typically consideredto require intelligerice. This.form of computingconcerns the manipulation of symbols wilich encode the knowledge and the . competence to perform intelligert acts, ratherthan the familiar form of computingthat concerns numerical calculation andrecord keeping. I, Almost all computing done todayinvolves numerical calculation;for example,