Sieger, George TITLE Instrumentation and Software for the Collection, Analysis, and Interpretation of Eye Movement Data During Reading

DOCUMENT RESUME

ED 201 997 CS 606 095

AUTHOR Hirschfeld, Rafael; Sieger, George TITLE Instrumentation and Software for the Collection, Analysis, and Interpretation of Eye Movement Data during Reading. Technical Report No. 3. INSTITUTION s ate Univ. of. New York, Ithaca. Coll. of Agriculture a'd Life Sciences at Cornell 'Univ. SPONS AGENCY 0 ice of Naval Research, Ariingtonl Va. Personnel and Training Research Programs Office. PUB DATE / Jun B1 CONTRACT. N00014-80-C-0372 NOTE 30p.; Bibliography may not reproduce clearly.

EDRS PRICE' MF01/PCO2 Pius Postage. DESCRIPTORS Cognitive Processes; *Data Analysis; *Data Collection; *Eye Fixations; *Eye Movements; *Measurement Equipment: *Measurement Techniques; Psychology; Reading Research; Research Methodology; Visual Perception

ABSTRACT Noting that the equipment traditionally Used in eve movement research is :loth expensive and stationery in nature, this report describes apparatus for .collecting and interpreting eye Movement data -that is both relatively inexpensive and portable. The report lists and describes hardware and software components of a data collection and data analysis system that provides precise information regarding the location, duration, and sequence .of eye fixations during the reading of zaterials that arecomposed of both' text and pictures. It also describes a procedure :for collecting eye movement data.in nonlaboratory settings, such as classrooms.(Author/FL)

****************4(***********************2, =t************************** * Reproductions supplied by EDRS are ta:e nest that can be made from the original tivrIllnent. *****************************************,k*************a4************** U.S. DEPARTMENT OF EDUCATION NATIONAL INSTITUTE OF EDUCATION EDUCATIONAL RESOURCES INFORMATION CENTER IEFOCI This document has been reproduced as /rt,t,I,IVIAfrom the person or organization irorlinaling il MI1101 Chdliql, ildve her -r1 made to improve ,pioductimliphiley

Points of vim, or immii-r-rstated in this document do 110' "?present official NIE p11511100 pr e'er

T OF EDUCATION

Collet sof AT...nt,:ultu reand LifeScier=es

COZITE-1. UNIVERSirr

. - INSTRUMENTATIOfi-ANi.,1777WARE F'n THECa...1.17.2TION

ANALYSIS.. ANT. 7:.7:RFFE7ATIW .3.F EYE710VEVENT

REAr:Y.G.

Tar- P.eper:r.-. No. 3

Rer7m=2uctiar: LI. whole or pa.rt .1-:"-,--=--ted for any pc=71-rs.e of the United

F c rtvluE

z,e3rch was sponsored by the -7,:T.-sonneland Traicimc: Research Progiams, PsyzcmIcal Sciences Division, of Naval Resew. -:t, under Contract Contract At::-OCom7ity Number NR157-452.

This cagr-rt, No. 4, Series B, is ma...a by the ReadL:lat Ti.e.3earch Group, Deter of Education, New York of iv--nr,11 tore and Life Universi:y,,, 4). a Statutory College of the.State Universiy,. Cornell Ithac.s, N.Y. 14833. It is supporteE in_ part by Hat=h 77tmdsProject 401) #42& PRZT'S STRAT .IMP .COMP . PRIN7 MAT. .1)

Apptmma-Ej-or public release; dist-iiionunlimited_ 40 V) c1 Uncla-..ssified SECL );ITY Ol..-A.:FICATION OF THIS PAGE (When Data Ertlitrise READ INSTRUCTIONS REPORT DOCUMENTATION PAGE I BEFORE COMPLETING FORM 3.. r--- CIPIENT'S:OATALOG NUMBER REPORT N.,kr,GER Zr- :it.....Ai k.'7 77',;SiON NO.

Technical Report Nu. 1 .51.-7-!4PE OF RE7,77RT te -PERIOD COVERED 4. "TITLE (and Subtitle) _-_.-zhnical 3.'1/80 - 5/31/81 Instrumiantation and Scftwardfn he 7...--Z11,==tion, Analyst , and Interprr-:ation of -1.7-eHLA4-=.:.... . PEERFORMING P.G. REPORT NUMBER Data.d==tng Reading '''.4a.archRep:,rt No.4 Series B L. CONTRACT OFI.GRANT NUMBER(s) 7. AUTHORes) Rafael:aLtschfeld, Cr..:Ill qni2ersity Georga Eiager, CorneiLlnivers.-ItT N00014-80--0372

I21 =ROGRAM EL:i.,.ENT. PROJECT, TASK 9.P ERFOR,i+:, T.- "DRGANIZATION^rAME ANDADDE,`7..:: AREA A WOR .NIT NUMBERS Cornell University, Th.7.pt ni Edil,-,--_-j_.:31...,K.,:_. 7.2042-06 State College of Agr:4----.111-,r & 115a Sciemz..as: -.-11153N(42. 7R157-452 A Statutory College -.±5: ti7le StateUn_ti27....sit7..- 3R0420602 'Z.. :REPORT DATE" II. CONTROLLING OFFICE NAME Aet,j..:.0....E.-.-SS dune 1981 Same L i'13,6-N_UMB ER OF PAGE_ 17 133. SECURITY CLASS.,f this report) 14. MONITORING AliENCY NAME ADID1.(f1-ItitNertrrt- tip= Zalnr."=22anei,.D/lIce) -Thclassifi.F-

-3.. -_-,ECLASSIFICA"-z1.DOWNGRADING fECHEDULE

16.DIST RI BUTI ON STATEMENT (of this iieze.art) Approved for Public RPM MtF::-.-Ti...Ition ....alf.mita.::

in BloAirr =.,., if :: ferent froaT,ltax=r0 17. DISTRIBUTION STATEMENT .(of the eberrncrrem-tes,0

No restrictions

---... IS. SUPPLEMENTARY NOTES This resea= --..;tic.,,-,1.5-z, supported ! Hatchfunds Project #424PRES. STRAT.'IMP. ZI-, 1.--7:LNT TECH:MAT, N.Y. State CollegE of Agriculture and Life Eden: es;.4- .E.z.atoz:TColl,e474, of theState University -....-- di;71Took nurneer, 19. KEY WORDS (Continuo on reveres side11 neon:emry orrt=:r:-m:ih.-

eye-movements eyt.:ra..k. reading research instrumentation visual processing nuesaar) 20. ABSTRACT (Continue on reveresside It necessary -and Irlerirrtv by blench interpreting eye move- Describes a method and apparatust.cr m2lIazting_iand both ment data, for research onreading -- :c.--t -=s as wellas text, that is relatively inexpensie and portabla. is _s and describeshardware and analysia system which software components of'adatacolli, ...nddata duration, and secidence provides precise 'informationrazar&ing :n lec.ation, that'are composed of both of eye fixations during therea.-ding:al .-ms.serials collecting eye-movement text and pictures. Also describes procedure for :...... ------.....0

EDITION OF I NOV 65 Is OED=ILETEE Unclassified DD IJAN 731473 S/N 0102LF014-6601 4-1 :SECURITY CLASSIFICATIORCF THISPAGE (When Data Entered) e) Uhclassfied SECURITY CLASSIFICATION OF THIS PAGE (When Data Entered)

daz...a.in nonlaboratory settingssuch as classrooms.

Unclassified SEC*JRITY CLASSIFICATION OF THIS PAGE(When Diet. Entered).' Eye Movement Instrumentation

InatnunAllatinn And Software for the Collection,_ and InterprQ:_tati_sm Eye Movement Data during Reading

Rafael firschfeld and George R. Bieger Cornell University

Abstract ,---:

Describes a method and apparatus for collecting and interpreting eye movement data, ,for research on reading pictures as well as text, that is both relatively inexpensive and portable. Lists and describes hardware and software components of a data collection anddata analysis system which provides precise inforthation regarding the . location, duration, and sequence of eye fixationsduring the reading of, materialsthat are composed of both text and pictures. Also describes a procedure for collecting. eye movement data in nonlaboratory settings such asclassrooms.. Eye Movement Instrumentation

for the Cca1egt:1 on. ysis,

and 7:::Lte-17rs.-.. Eve. Movement Arta during

the pay f-eis investigatzz-s in sev-erz:clam _J__=3 of cogniti- psym-thcLo7:haTe- begun to develop and use .techr for recorth.-:_ms the of small eye movements and werix:-..,:i=s1' which they e _tes of mental proc-esses.'-in they have "a1.- ixation durations as indices .cf' the temporal properti---1 of mental operations, thre:zincluding mental

(operations pr` r."11-F. involved in reading (Bouma & delloogd, 197)4;Carp-.;;,er & Just,"972, 1977; Just & Carpenter, -976a, 1976b, 198C:Lef'-on, 1973; Loftus, 1975; McConkie, 176; Rayner, 1975a, 9-,13:Rayner & McConkie, 1976).Although such tech..-z.lues `-iave proven valuable, they have. been found to have at laa.t.- twa major practical drawbacks limiting their widespre:a.---,se reading research.The first obstazLe has been the high cr-=°_.-.Eye tracking devices are typically .ezpensive themselves Dually require very costly accessory -.---quipment to be useful.,.,-;11 equipment expenditure in excess of$5C,-)00 is not unusual, but ys often prohibitiVe to many prospective rrasearchers in this field.A second problem is that such equipment is necessarily staltionary and reqUires that all data be collected in the laboratory.This limitation'often precludes (or at least makes more _difficult) the. use of subjects who do not have easy. \ 6 Eye Movemerit I7.strumentatfon

access- to the laboratory. from. these subjects are often useful in those irr:.--..tatigations -zonderned wit n individual differences in read-L-mg. This report descritas apparatus and procedures dasignd to overcorr-- --fneseobstecleswhile retaini-27 the precisior a=uracy Ilecm-r°y for the use of eye.movement techniques l'eed±ag research-

The dev,.e.:i---emt and use of Uza equipment, software,and procedures C-zscr.'zed .below came about in responseto problems encountered investigating the ways readers use the information zonta ned:in materi/,a_ consisting ofpictures and text. Our -_:went was.to maniv-ete thelocation of certain kinds of informatm (e.g. locative r descriptiveinformation) in text or pi:.:_ -res and measure effects of these manipulations on comprehemzion.. We wanted knoW what, caused a reader leave the text to search ci picture foradditional information and where in the picturethey loOked for that information. We also .wanted to compare reading strategieSamong diverse categories of readers; for example, beginning and immature versusaccomplished

reader's. These objectives required that we know: (a)where.. the' reader was looking (i.e.-thelocation of the eye fixation),(b) how long he/she attended to that location(i.e. the duration of

the fixation) and (c) where he/she looked next/(i.e. the

sequence of fixations) . Also; collecting datafrom People of

various backgrounds many of whom could notpractically come to

our laboratoey required a portable data collectionsystem.

hY --- e Eye Movement Instrunntioa-

Given our budgetary limitations, we attempted adapt our equipment to meet the specifications of our researar-- That equipment is described below and our laboratory lay= is shown in Figure 1.

Insert Figure 1about here.

1-C121122111t 1)' Gulf and Western Model 106 Eye-trac system(cost' $2500) This device uses a' differential reflection methOd of limbus and eyelid tracking, and produces an analog

signal proportional, to'the displacement of the eye.

Since it can follow each eye's movements in only one

direction, we record horizontal movements from one eye and vertical movements from the other. It is equipped With a chin and temple rest and has been modified to

include a head restraint to-minimize head movementsbut allow reasonable comfort. The machine is easily

portable and we have bolted .it to fa base which in turn

can be clamped.to any table or platformto _provide it

with stable support.

2) JVC KD-A2'stereO cassette deck (cost $300')

Ne use this store the output of 'the Eye-tracsystem 8 Eye Movement Instrumentation

when we are la:477- from the laboratory and cannot sendthe signal dimrtL- to the computer,In order to record the

D.C. signal we have built a detachable modulator/demodulator (see Figure 2).

3) Data Translation DT2762 A/D converter (cost$750) This takes the analog signal from the Eye-trac system or the tape deck and converts it to adigital value for

computer analysis.

4) PDF-11/03 zomputer system (cost $4500) The computer system includes a dual floppy diskdrive, 32K RAM, 4-port serial line interface, line timeclock, 0 and CRT terminal. The system accepts data fromthe analog -to digital converter and stores them onfloppy

disks for subsequent analysis. This. analysis will be descrqbed more fully in the section on, software:

5) Hewlett-Packard 7221B. plotter (cost $5000 -optional) -Although thie device is 'not essential, we -have foundit

)11 extremely: useful for diOlayig eye. positions and for

setting:bp map's, of the stimuli. The plotter sends the boundaries bf_all stimulus target regions to a mapping

program (using a digitizing.sight) and,after data have been collected, plots the eye-positionsover a larger

. reproduCtion of the stimulus. Eye Movement Instrumentation

Software

1) MAP - creates a map of target locations in the stimulus (i.e. words or parts of pictures) by acceptng the digitized coordinates of the boundaries of the target

areas 3from the plotter. In configurations without the

. plotter a modified Version' of MAP will accept the

manually measured coordinates from th e keyboard. ,This information is stored for subsequent comparison to the

raw eye movement dat gathered by the program ITRAK.

_2) ITRAK'- gathers data from the eye track machine. Two types of data are c llected: the raw eye positiondata 'Which is sampled at the rate of 60/sec., and calibration data used 'to map the eye position data onto the stored representation of the: stimulus created by MAP.

Currently, we ask the subjects to look at the corners of

the stimulus card to determine the coordinates of the

card boundaries. This information is then used to

-- compute a lineartransformation that changes the scale

of the rawdiatato that of the stored stimulus map. We have found, however, that this method'presents several

problems. First, it is difficult to tell exactly when the subject is looking at a corner of the card. Second, due to nonlinearities inherent inthe\eye track machine

and the analog/digital converter, these coordinates

often do not define a r'ectangle, but rather some bizzare

1.0 Eye Movement Instrumentation

is -quadrilateral. In order to remedy the first problem, we are installing a pushbuttonswitch'connected to the external trigger input of the A/D converter. The

subject would then push this button whenlooking at the

calibration point to begin conversion. This will

provide a more precise value for eachcalibration point.

To overcome the ni nlinearity problem, we aredeveloping

-a moregeneral interpolationaigcrithm.

3) MATCH - takesthe\eyemovement data (fromITRAK)ind. determines the target area to which eachpairof

coordinatesisclos\est. It does thi's y applying the-

transformation'. comp Uted in ITRAK to th Converted data \ and ,comparing the \coordinates to thoseof the target

regions 'in thestimulusmap created bylMAP. It then produces a summary listing of these target areas onthe

terminal, in the order tbey were scanned,and with the

time spent on each.

4) PLOT (Optional) - makes a .scaledreproduction of the stimulus and plots the eye movements on thisdepiction.

For -ease of interpretation's we plot the reproductionof

the stimulus in black; ink; eye positions areshown in

red ink; and a sequence of numerals isplotted in green ink at intervals of 60, eye positions,which corresponds

to one second of sampling. Eye Movement Instrumentation

Procedures

1) Afteriturning off the room lights to minimize artifacts, the experimenter calibrates the E e-trac sytem 'tor the

Particular sutjeCt.

2) The subject looks at each of the calibration points in

succession and the coordinates of each is.stbred,. either

on floPpy'diskS via the A-D converter and micro- -

computer;, or on the cassette tape for' later conversion .

and storag'e onLfloppy disks.

3) The subjectbegins reading and the program ITRAK colleCts eye position data and stores them on a floppy

disk. In 'out 'of laboratory data collection', the lect's-eye positions are sett IrOm the eye track

r..ieice to the Cassette tape recorder, and later, in the.

laboratory, are .sent from the tape recorder to the

"micro- computerusing ITRAK. The subject is instructed

\ . \ to 'look at several 'landmarks, 'on the 'stimulus both

before beginning and after finishing reading the

material. During data analysis the eyes' poSitions

before' and after reading, as recorded, by the equipment,

, - -- are compared. If ,the.recorded, location for the same landmark has not changed from'start to finish, we assume that the eyes' positions' as recorded are accurate for

4 , the entire samPle.'If. however, there is a substantial

difference (Just & Carpenter, 1980 suggest.that 0.5 Eye Movement Instrumentation,

degrees visual angle constitutes e substantial difference) the subject's data are not useable.

After ,the data are collected and stored oni floppydisks, 41) the experimenter rims MATCH, which summarizes the location, duration, and sequence of the eyes' positions .10

dtiring.reading (see Figure 3).

5) :.(qptional) The experimenter runs PLOT which reproduces a '...scaled enlargement of the stimulus and plots the eyes'

positions on it. These are represented by points, connected by straight lines which indicate the sequence

of fixations (see Figure 4).

Insert Figure 3 about here.

InseFigure 4 /about .here.

. \

Data Analysis

The data collected by ITRAK. and&I-splayed "byMATCH.and PLOT

is'in such ,a form tliat-itcan easily be inali-Zedto ilientify the

/ locatJon, duration, and sequence of eye fixations. Figure-3-,

depicts. the,output from MATCH and can beusedby itself to Eye Movement Instrumentation

identify these important variables, The locations identified in Figure 3 represent' the defined target area to which a given eye

position was closest and the durations are measured in 'ticks' -or

sixtieths .of 'a second. The order from top to bottom shows the

sequence of fixations. The principle disadvantage with using

/ MATCH alohe is that the eyes will frequently stop at or near the

boundary between two target,a,eas. Because 'the eyes are never (thereare small irregular movements called

tremors that occur when theeeyes appear staionary) this may cause

MATCH to show a series of very brief fixations alternating between the two target areas zurrounding the point of focus,

Such.a disadvantage is not .necessarily serious ;if thegeneral location .of a fixation is all that is needed, however if more precise informationy about the eyes' position is requiredthis

limitation could be a problem.

. The use of the iraphics plotter has overcome this

limitation. The plotter displays a reproduction of.the original stimulus ane,PLOT draws the eyes! positions over this depiction.

Figure 4 shows a sample of the PLOT and 'graphics 'plotter-output:

Note especially that theeyeslipositions are indicated.with , substantial .precision.'This plotter, and the program PLOT, used

--tozether- with MATCH, allows-us todetermine the'location, duration, and sequence of eye fixations with considerable

p acision.

The equipmentl, software and procedUres described above:have, c Eye Movement Instrumentation

enabled us to make relatively precise observations of eye

behavior during ,reading without theprohibitively high cost which typically characterize such systems. We are also able td- make thoda observations wherever there is a room capableof being

darkened and that has an electrical outlet and a table. We feel

.that. this instrumentation and procedures will provide opportunities for research byinvestigators who do not havethe

funds to purchase more expensive equipment.

gote: FORTRAN IV source programs, for all ofthe` user written software described i&thispaper, are available on request by contacting:

Reading, Researdh,Group

213 Stone Hall

Cornell University

Ithaca, NY 14853

(607)256=54-23 or 254=7706 Eye Movement Instrumentation

References

Bourne, H. & deVoogd, A. H. On the control of eye saccades in reading.nal=Research, 1974, 1L, 273-284. Carpenter, P. A. & Just, M. A. Semantic control of eye movements during picture scanning in a sentence-picture verification task. Perception and .Ea.Y.SliaP.12rnaa, 1972, 12., 61-64.

Carpenter, P. A.& Just, M. A. Reading comprehension as eyessee

it. In M. A. Just-& P. A. Carpenter (Eds.) , c"ogaltime processes lacomprehension. Hillsdale, N. J.: Lawrence Erlbaum kSsociates, 1977.

Just, M. A. & Carpenter, P.A. Eye fixations and cognitive proceiSes. Cognitive Psychology, 1976 a,' 441-480. (a)

JuSt, M A. Carpenter,-0.- A. The role of eye 'fixation research in cognitive psychology. Behavior Research 4Lethods and. ,Inztrumentation, 1976,' a, 139-143. (b)

Just, M. A. & Carpenter, P. A. A theory'of reading: From eye fixations to comprehension. Psychological RevieW,.In press.

Lefton, L. Al Eye movements in reading 'disabled children. In J.' W. Senders, D.F. Fisher & R. A. Monty :Eds.') Eye nOjements and the higherslayahalLgiaal functions. Hillsdale, N. J. Lawrence Erlbaum Associates, 1978.

Loftus, G. ,R. General software for an on-rline eye 'movement, recording -system.. Behavior Research methods And, Instrumen:Atian, 1975, L; 201-204. nMcConkie, G:W. The use of eye-movement data in determining the perceeptual,span in reading. In R. A. Monty & J. W. Senders

(Eds.) Eye i movements, and psychological ;processes. Hillsdale,N.. J.: Laurence Erlbaum Associates,'1916.

Rayner,,K.' ParafoYeal identification 'during a Fixation reading.. ACTA 11igiulLaglaal 1975,, 39., 271-282.

Rayner, K. The ,perceptual span and peripheral cues in reading. Cognitive Psychology;, 1975, L, 65-81. (b)

Rayner,-K. Visual attention in reading: Eye movements reflect cognitive processes. Memory and Cognition, 1977/ 5, 443-448. Eye Movement Instrumentation

Rayner, K. Eye movements in -reading and information processing. 251ahalsml.cal Bulletin, 1978, ai, 618-660.

Rayner, K. & McConkie, G. W. What gUides a reader's eye movements? Vision Research, 1976, al, 829-837. CRT PUP-1103 Eye track Subject. screen computer iachlne seated ------and potter disk keyboard drive ------phone Assembly area O

Experimenter seated

hi 0

0 ° 0 rt

1=4 figure la Eye movement iaboratory rt 1 , H

, o

rt. H. Left eye

Horizontal 'Eye Track

Monitor t,,ght eye 1VCO Vertical

Pushbutton Switch

Tape Recorder

Ibmd111111MIMMIII111

ALL ALL

VCO VoJtage'Control Oscillator 0

PLL - Phase 1.L ick loop

Analog/Digital Aff t/I Converter rt

Micro-computer, rt

Jigure 2, Schematic for modulator/demodulatordevice,'

2,0 I ),-e Movement Instrumentation

Duration is indicated in "ticks" each of which is 1/60th of a second (16.7 ms)

Location indicates the word to whl:h the eye's focus was closest

duration location

28 THIS -- cluster of points in the upper left corner,at the beginning 4 TRACK 4 EYE 1 IS -- eye blink 3 FOR 93 THIS -- fixations #1 and #2 50 IS -- #3 2 A 3 TEST 5 A fixation between "A" and "T 7r" 44' TEST 53 SENTENCE -- #4 1 MACHINE 1 TRACK --'regressive-sweep to beginning of second line 1 THE 46 FOR. -- fixation above #5 7 :THE 31 FOR #6 , 37 THE -- between "THE"' and "EYE" 2 EYE 35 TRACK -- #7. 55' MACHINE -- #8

1 :TRACK , 1. .THE ---movemen back toward the top for second reading 2 FOR

Figure, 3. Sample of 'output7from_MAtCH program.,

(To be used 'with,Figure 4b) Eye Movement Instrumentation 17

Figure, 4 S4mPqms4of output fromPLOTprogram cornell/glock May 27,.1981

Navy Navy

1 Meryl S. Baker NPRDC 1 CodeP309. CAPT Richard L. Martin, USN San Diegb, CA 92152 Prospective Commanding Officer USS _Carl Vinson ( CVN-70 ) 1 Dr. Alvah Bittner Newport News Shipbuilding and Crydock Co Naval. Biodynamics Laboratory Newport News, VA 23607 New Orleans, Lousiana 70189 1 Dr. James McBride Dr. Robert Breaux Navy Personnel R&D Center Code N-711 San Diego, CA 92152 NAVTRAEQUIPCEN 1 Dr William Montague Orlando, FL 32813 Navy Personnel R&D Center San Diego, CA. 92152 1 .Dr. Richard Lister Department-of AdministrativeSciences 1 Ted M.I. Yellen, Naval. PO3tgr. iduate School Monterey, CA 93940 Technical information Office,. Code' 201 -NAVY PERSONNEL R&D CENTER. SAN DIEGO,CA .92152 1 DR. PAT FEDERICO' , NAVY PERSONNEL R&D CENTER 1 library, Code P201L SAN DIEGO,. CA 92152 Navy Personnel R&D Center San Diego, CA' 92152 1 Dr. John Ford ,Navy Personnel. R&D 'Center 1 Technical Director San, Diego: CA' 92152. Navy .Personnel R&D Center San Diego,.., CA 92152 1 Dr., Henry M. Haig Department 'Of Psychology, C-009 6 Commanding Officer Univerbity of California atSan Diego Naval Research Laboratory La Jolla, CA 92093 Code 2627 :Washington, DC "20390, 1 LT Steven D. Harris, MSC,USN Co"de 6021' Naval' Air Developnent Center Warminster, Pennsylvania 18974 1' Psychologist ONR Branch Office 1 Dr]. Jim Hollan Bldg114, Section D Code 304 666 Summer Street Navy PersOnnel R & D Center Boston, MA02210. San.Diego, CA 92152 1 Psychologist CDR Charles W.Hutchins ONR, 'Branch:. Office Naval Air Systems Command 'Hg 536 S. Clark Street - Chicago, IL60605 Navy Department Washington, DC .20361 Office of Naval Research C.odis 4.37 800 N. Quincy SStreet 1. CDR_ Robert S. Kennedy Arlington; yA22217 Head, Human PerformanceSciences Naval Aerospace MedicalResearch Lab Personnel &Training'Researdh Programs Box. 294107 (Code 458) New Orleans,-U70189 Office of Naval. Research Arlington, VA22217: 1 Dr. Norman J. Kerr Chief of Naval TechnicalTraining Psychologist 1 Naval Air Station Memphis(75) ONR Branch-Office- Millington; ,TN38054 1030 East Green Street Pasadena', CA91101 Dr. William L. .Maloy . Principal Civilian Advisorfor 1 Special Asst. for' Education and Education and Training Training (0P-01E) Naval Training ?.:ommand,Code 00A Rm. 2705 Arlington Annex Pensacola, FL32508 Washington, DC20370 "

/1 24' cornell/glock. May 27, 1981

Army Navy

1 Technical Director for The U. S.%rmyResearch institute Operations Behavioral and 'SocialSciences 1 Office of the Chief of Naval Research Development &Studies Branch 5001 EisenhowerAvenue (0P-115) Alexandria, VA 22333 Washington, DC 20350 J. Farr 1 Dr. Beatrice Dr. Donald F. Parker% U. S. Army ResearchInstitute Graduate School ofBusiness Administrati 5001 EisenhowerAvenue University of Michigan Alexandria, VA22333 Ann Arbor, MI 48109

1 Dr. Dexter'Fletcher MSC, USN (Ph.D) Institute 1 LT Frank C. Petho, U.S. Army Research Selection and Training ResearchDivision 5001 EisenhowerAvenue Human PerformanceSciences Dept. Alexandria, VA 22333 Naval AerospaceMedical Research Laborat HARRIS , Peniacola, FL32508, 1 DR.. FRANK J. U,S. ARMYRESEARCH,,INSTITUTE 5001 EISENHOWERAVENUE Dr.. Gary, Mock ;. IA ,VA .: 22333 Operations Research.Department : ALEXANDR Code55PK". School Dr, Michael Wien Na Val Postgraduate- U.S. ARMY' RESEARCHINSTITUTE Monterey, CA 93940 . 5001 EISENHOWERAVENUE ALEXANDRIA,. VA 22333 Roger W.Remingtort, Ph.D ' Code L52 Dr. Milton S.Katz NAMRL., Training;Tech:heal Area " PeriSacel'a, FL 32508 M.: Army Researchinstitute, 5001 EisenhowerAVenue Dr. Worth, Scanland,Director ;, Alexandria, VA 22333 Research, Developnent,Test,& EvalUation 4-5 1; Dr. Harold F.O'Neil, Jr. Naval Education andTraining Command 32508 . Attn: PERIOK RAS, Pensacola, FL Army ResearchInstitute 5001,Eisenhawer Avenue Dr^:" Robert G. Smith' Alexandria, VA 22333 Office of. Chief' ofNaval, Operations ".,0P-987H" Dr. Robert Sasmor .6:or the. Washington, DC 20350 \ U. 'S. ArmyResearch Institute Behavioral. and SocialSciences Dr. Alfred F. anode 5001 EisenhowerAvenue Training Analysis &Evaluation Group Alexandria; VA 22333 (TAEG) _ . Dept. of the Navy Dr.Frederick Steiriheiser ^ Orlando,FL 32813 Dept. of Navy Chief of Naval.Operations Dr. RichardSorensen OP-113 Navy PersonnelR&D Center Washington, DC20350 San-Diego, CA 92152 e, Roger WeissingerBaylon Dr. Joseph4Ward Department of AdministrativeSciences U.S. Army Researchinstitute Naval ,PostgraduateSchool 5001 'Eisenhower Avenue KentereY, CA 93940 Alexandria, VA22333 Dr'. Robert Wisher Code 309 Navy 'Personnel R&DCenter an Diego, CA92152 A

1 Mr John H. Wolfe' Code P310 G. S. Navy PersonnelResearch 'and Development Ceriter San Diego, t CA92152 corne4/glock May 27, 1981 k .. CivilGovt

1 Dr. Susan Chipman Air Force Learning and Development e National Institute ofEducation 1200,19th Street V 20208 1 Dr. Earl. A. Alluisi a'y3hington, DC HQ, AFHRL (AFSC) Brooks AFB, TX 78235 William J. McLaurin 66610 Howie Court 1 Dr. Genevieve Haddad Camp Springs, MD. 20031 Program Manager Life Sciences Directorate 1.Dr. Arthur Mrlmed AFOSR National. Intitute of Education APB, DC 20332 1200 19th Street NW Washington, DC 20208 1 Dr, Marty Rocla.ray Tectallcal Director Dr. Andrew. R. Molnar AFHRL(OT) Science Education Dev. Williams AFB, AZ 58224 ,and Research ,National Science Foundation 2 3700' TC PITCH St p 32 Washington, DC20550 Sheppard AFB, 76311 Dr, Joseph Psotka 1 National .,Institute. of Education ,1200 19th St. NW, "t WaShington,DC 20208

Marines 4-' 1 Dr. Frank Withrow' U. S. Office-ofEducation 'SW H. William Greernip 400 Maryland, Ave. Edtication Advisor (E031) Washington, DC 20202 Education Center, MCDEC Le-Young. Director Quantico, VA 22134 1 Dr, :Joseph , Memory& CognitiveProcesses National. Science" Foundation',. 1 Special AsSistant for Marine 20550 Corps. Matters WashingtOrr, DC Code 100M Office of Naval Research 800 N. Quincy St. Arlington, VA 22217 ,; Non Gov t

1 'DR. A.L. SLAFKOSKI SCIENTIFIC ADVISOR (CODE RD-1) HQ, U.S. MARINE CORPS 1 Dr.-John R. Anderion Department of Psycfnlogy WASHINGTON, DC 20380 Carnegie ,Mellon University

Pittsburgh, PA''15213` A Anderson:T:ernes H., Ph.D. Center for the: Studyf Reading Other Dsp 17.11 Children's ResearctiCenter, 51 Gerty Drive Champiagn, IL 61820 . 12 Defense Technical. Information Center- , Cameron Station,,Bldg :5 1 Dr. John An nett,' Alexandnia, VA 22314 Department of Psychology Attn:,'TC University of Warwick 'Coventry CV11 7AL 1' Military Assistant, for; Training and ENGLAND Personnel. Technology Defense Office of the''Under Secretary of 1 1 piy,chological research, = for Research &Engineering Dept. et Defense ('ArmyOffice) Rooth 3D129, The Pentagon, carcpbelll Park Offices Washington, DC- 20301 Canberra ACT, 2600,- Australia \

DARPA- Dr. Alan Baddeley 1400 Wilson Blvd. Medical' Research Council Arlington, VA 22209 Applied Psychology Unit 15 Chaucer Road 26 Cert.:bridge C32 2EF ENGLAND , cornell /.glock x, May 27., 1981

Non Govt Non Govt

1 Charles Myers Library Livingstone House Livingstone Road 1 Dr. Patricia Baggett Stratford DepoPtment of Psychoiogy London E15 2LJ University of Denver ENGLAND University Park Denver,0080208 1 Dr. William Chase Department of Paychollogy 1 Dr. Jonathan Baron Carnegie Mellon University Dept. of Psychology Pittsburgh, PA 15213 University of Pennsylvania

3813-15 Walnut St. T-3 1 Dr. Micheline Chi ,Philadlphia, PA 19104 Learning RA. D Center University of Pittsburgh 1 Mr Avrot Barr 3939 O'Hara Street Department of Computer Science Pittsburgh, PA 15213 Stanford,Univeraity- Stanford,' CA 94305 Dr. Francois G. Christen Perceptronics 6271 Variel Avenue Woodland Hills, CA 91367

1 CDR Robert J. Biersner 1 Dr. William Clancey . program Manager Hunan Performance. Department of ComputerScience Navy Medical R&D Command Stanford University Bethesda, MD20014 Stanford, CA 94305

1 Liaison Scientists Dr. Allyn M. Collins Office of Naval Research, Bolt Beranek & Newnan, Inc. 50 Moulton Street Branch Office , London Box 39 FPO New York 09510 Cambridge, Ma 02138

1 1 Dr. LyleBourne Dr. Lynn A. Cooper Department of Psychology LRDC University of Colorado University of Pittsburgh Boulder, CO 80309 3939 O'Hara Street Pittsburgh, PA 15213

1. Col Ray Bowles 800 N.-Quincy St. Dr. Meredith P. Crawford Room 804 American Psychological Association Arlington, VA 22217 1200 17th Street, N.W. Washington,'DC 20036

1 Dr. John S. Brown XEROX Pale Alto Research Center 1 Dr. Kenneth B.' Cross 3333 Coyote Road Anacapa Scienceo,,Inc. Palo-Alto, CA 94304 P.O. Drawer Q Santa Barbara, CA 93102 Dr. Bruce Buchanan Department of Computer Science Stanford University f

,.Stanford, CA 0305 1 Dr. Hubert Dreyfus Department of Philosophy 1 -DR. C. VICTOR BUNDERSON University of California WICAT INC. Berkely, CA 94720 UNIVERSITY PLAZA, SUITE 10 1160 SO. STATE ST. ,LCOL J. C. Eggenberger OREM, UT 84057 ,DIRECTORATE OF PERSONNEL APPLIED RESEARC NATIONAL DEFENCE HQ Dr. Pat Carpenter 101 COLONEL BY DRIVE Department of Psychology OTTAWA, CANADA K1A OK2 CarnegieMellon University Pittsburgh, PA 15213 .0 ERIC Facility acquisitions '1 4833 Rugby Avenue.

Dr. John 8.Carroll Bethesda, MD20014 : Psychometric Lab

DavioAall 013k jChapel '27514 cornell/glock May 27, 1981

Non Gavt Non Govt

1 Dr. EdFeigenbam 1 Glenda Greenwald, Ed. Department of Coatputar Science "Human Intelligence Newsletter" Stanford University P. 0."9:ix 1-163 Stanford, CA 94305 Birmingham; MI 48012

1 Dr. Richard L. Ferguson 1 Dr. Earl Hunt The American' College Testing Program Dept. of Psychology P.O. Box 168 University of Washington Iowa City, IA 52240 Seattle, WA 98105

1 Mr. Wallace Feurzeig 1 Dr. Greg Kearsley Bolt Beranek & Newnan, inc. HumRHO 50 Moulton St. 300 N. Washington Street Cambridge, MA 02138 Alexandria, VA 22314

Dr. John R. Frederikeen 1 Dr. Steven W. Keele Bolt Beranek & Newman Dept. of Psychology 50 Moulton Street University of Oregon Cambridge, MA02138 Eugene, OR97403 Dr. Alinda Friedman Department of Psychology Dr. Walter Kintsch University of Alberta Department, of Psychology Edmonton, Alberta University of Colorado CANADA T6G 2E9 Boulder, CO 80302

1 DR.ROBERT GLASER 1 Dr. David Kieras LRDC Department of Psychology UNIVERSITYOF PITTSBURGH University of Arizona 3939O'HARA STREET 'flacon, AZ 85721/ PITTSBURGH, PA 15213 / 1 Dr. Kenneth A.Klivington Program Officer Dr. Daniel' Gopher Alfred- P. Sloan Foundation Industrial & Management Engineering 630 Fifth Avenue TechnionIsrael Institute of Technology New York, NY 10111 Haifa ISRAEL' 1 Dr. Stephen Kosslyn Harvard University 1 DR. JAMES G. GREENO Department of Psychology LRDC 33Kirkland' Street UNIVERSITY OF PITTSBURGH Cambridge', MA021 3939 O'HARA STREET PITTSBURGH, PA 15213 1 Mr. Marlin .Kroge!, 1117 Via Goleta 1 Dr. Harold, Hawkins Palos Verdes Estates, CA 90274 Department of Psychology University of Oregon Dr. Jill Larkin Eugene OR 971103 Department of Psychology Carnegie Mellon University Dr. James R. Hoffman Pittsburgh; PA 15213 DepartMent of Psychology University of Delaware 1 Dr. Alan Lesgold Newark, DE 19711 Learning R&D Center University of Pittsburgh Dr. ICristiny. Hooper Pittsburgh, PA 15260 Clark Kerrall University of California f Dr. Michael Levine Santa Cruz, CA 95060 Department of EducationalPsychology 210 Education Bldg. University of Lllinoia Champaign, IL 61801

1 Dr. Charles Lewis Faculteit Sociale Wetens happen RijkstOude'Boteringestraatativereiteit Cron/ en' 23 971ZC Groningen'L 44Natherlanda,e,,,, t' -N ',i' : ;,,,'; ' r corriell /glock May 27, 1981

Non Govt Non Govt

1 Dr. Erik McWilliams 1 Dr. Fred Reif . Science Education Dev. and Research SESAME National Science Foundation c/o Physics Washington, DC 20550 Department University of California Berkely, CA 94720 1' Dr, Mark Miller TI Computer Science Lab C/O 2824 Winterplace Circle 1. Dr. Andrew M. Rose Plano, TX 75075 American Institutes for Research 1055 Thomas Jefferson St. NW Washington, DC 20007 1 Dr. Allen Munro Behavioral Technology Laboratories 1 Dr, Ernst Z. Rothkopf 1845 Elena Ave., Fourth. Floor Redondo Beach, CA 90277 Bell Laboratories 600 Mountain Avenue Murray Hill, NJ 07974 1 Dr. Donald A Norman Dept. of Psychology C-009 1 Dr, David Rumelhart Univ. of California, San Diego Centerfor Human Information Processing La Jolla, CA 92093 Univ. of California, San Diego La Jolla, CA 92093 1 Dr. Jesse Orlansky Institute for Defense Analyses 1 DR. WALTER SCHNEIDER 400 Army Navy Drive DEPT. OF PSYCHOLOGY Arlington, V,1 22202 UNIVERSITY OFILLINOIS CHAMPAIGN, IL 61820 1 Dr. Seymour A. Papert Massachusetts Institute of Technology

Artificial Intelligence Lab 1 Dr. Alan Schoenfeld 545 Technology Square Department of Mathematics Cambridge, MA 02139 Hamilton College Clinton, NY 13323 1 Dr. James A. Paulson Portland State. University 1 DR. ROBERT J. SEIDEL ,. P.O. Box 751 INSTRUCTIONAL TECHNOLOGY CROUP. Portland, OR 97207 HUMRRO 300 N. WASHINGTON ST. 1 Dr. James W. Pellegrino ALEXANDRIA, VA22314 University of California, Santa Barbara ." Committee on Cognitive Research Dept. of Psychology % Dr. Lonnie R. Sherrod Santa Barabara, CA 93106 Social Science Research ,Council 605 Third Avenue 1 MR. LUIGI PETRULLO New York, NY 10016 2431 N. EDGEWOOD.STREET ARLINGTON, VA 22207 1 Robert S. Siegler Associate Professor 1 Dr. Martha Poison Carnegie-Mellon'University Department of Psychology Department of Psychology Campus Box 346 Schenley Park University of Colorado Pittsburgh, PA 15213 Boulder, CO 80309 1 Dr. Edward E. Smith DR. PETER POLSON Bolt Beranek & Newman, Inc. DEPT. CF PSYCHOLOGY- 50 Moulton Street UNIVERSITY OF COLORADO Cambridge, MA 02138 BOULDER, CO. 80309 1 Dr. Robert Smith 1 Dr..Steven,S. Poltrock Department of Computer Science Department of Psychology. Rutgers University. University of Denver New Brunswick, NJ 08903 Denver;CO 80208 1- Dr. Richard Snow MINRAT M. L. RAUCH School of Education P II 4 Stanford University BUNDESM/NISTERIUM DERVERTEIDIGUNG Stanford; CA94305 POSTFACH 1328 0.63 BONN 1, GERMANY Dr. Robert Sternberg Dept. of Psychology Yale University Box-:01A,yaleStation -NeW-Haven CI-,052p cornell/g1ock May 27, 1981

Non' Govt

DR. ALBERT STEVENS BOLT BERANEK & NEWMAN,INC. 50 MOULTON,STREET CAMBRIDGE. MA02138

1 ,David E. Stone, Ph.D. Hazeltine Corporation 7680OldSpringhouse Road McLean, VA 22102

1 DR. PATRICKSUPPES INSTITUTE FOR MATHEMATICALSTUDIES IN THE SOCIAL SCIENCES STANFORD UNIVERSITY STANFORD, CA 94305

1 Dr. Kikumi Tatsuoka, Computer Based Education Research

Laboratory . 252 Engineering ResearchLaboratory University of Illinois Urbana, EL 61801

1 Dr. Douglas Towne Univ. of So. California Behavioral Technology Labs 1845 S. Elena Ave. ..:-41edondo Beach. CA 90277

1 Dr. Uhlaner PerceotrOnics. Inc. 6271 Variel Avenue Woodland Hills, CA 91364 ':

Dr. Phyllis Weaver Grad ite School of Education Har and rO University 29Larsen HalI, Appian Way bridge, MA 02138

1 Dr. David J. Weiss N660 Elliott Hall University of Minnesota 75 E. River Road Minneapolis, MN 55455

/4121 DR. GERSHON WELTMAN PERCEPTRON/CS INC. 6271 VARIEL AVE. WOODLAND HILLS, CA 91367

1 Dr. Keith. T. WesCourt. Information Sciences Dept. The Rand Corporation 1700 Main St.