Of the Invit,.Ktional Conference On. Te
Total Page:16
File Type:pdf, Size:1020Kb
DOCUMENT`` RESUME: ED- 17138 7 '.009 577, -TITLE Prodeedin of the Invit,.ktionalConferenceon.Te ng -Pro kblams 4 tir,N714 York, 11,ew York, Novembe'r: 1963). INSTITUTION Educational TestingService, Pn C' PUB -DATE 21klov, 63 NOTE 161p.. EBBS PWICE MFO(1/PC07/ Plus -Post DESCRYPTQRS :, Academic Achieitement:- _gni five Ability; COil ge Students; *Educational Testing; .Equat-ed Soo es;, Higher- Education; 'Medical Education; Noraw.,Beterenqed:' Tests; *Norms; PersOnalitY -Ass osment; *pre fictive Measurement; Social Resposibility,; _Student. Tisting; : Success ;Factors; *Testin4 Problems; *Test- JteliA bi lit y ;Tvst. 610i-ty .- ABSTRACT con f _re, 1 cc s pea ke -2 viewed and anal yzed the current thinking- underlying the basic ccnc pts ot test norms, reliability, wand validity.: k.c '% Lennon* s . pa per. called for more attention to the development' of norming theory and sumdarfzed currentforming pr actrces- and -the- establishmznt of a systlmwhich -wound- perm: 4-'comOarable norms, for test's wer Stan d'ar dized ondiffer-a- namplas 'Robert- L Theirndike coMmented. on proposals, practices, and procedures. for estimating reliability.' AAa'? Anastasireviewed, re -Cent. approaches tothy"study of validity. During the session " deVatld -to mse medicine, John P.Nnbbard descr.ibed a method used to te-s-r-- the diagnostic- comPetence' of intrhs.E.Ldwell Kelly reported on an extensive investigation of yredictor and criterion variables.ot- Conderntomedical: school OK- Jc.rom S. bruner presented the luncheon address., on human developdeut. Warren' G. Findley : discusspd* current theoric'4nd applications tiro: appraisal of cognitive 'a Non-cognitive -aspects of student performance were treated by Samuel personality Messick, . who considrd 47.11 3 RortntiAl 'contribution Of assessment .techhigu es 'to th---?pr ):f'cd:1,1eqe success.the final speaker _was Robert L.1:b el, who spoke on the, social .consequences of -ducat ionil testing..(BA) ****"4- * x-tAcx * SU by EDR ar9 ,can be made from dri -iaalAocum ******** *****************- . U.S.DEPARTMENT OF HEALTH, . EDUCATION WELFARE NATIONAL-INSTITUTE OF EDUCATION . THIS DOCUMENT' HAS BEEN REPRO -.DliCED EXACTLY AS RECEIVED FROM RERS@NdIRORGANIZATiON ORLGIN ATING IT POINTS-OF VIEW OR @PINIONS STATED bo NOT NECESSARILY REORE! SENT OFFICIAL NATIONAL INSTITUTE OF [email protected] OR POLICY -PERMISSION TO R RODUCE THIS MATERIAL HAS BEEN GRANTEDBY TO THE EDUCATIONALRESOURCES INFORMATION CENTER (ERIC)." ;Copyright co196.4 by Educational Testing Scrvice. AU rights reserved. Library of Congress Catalogue Number: 47-1,1220 Printed in the United Status of America ti EDUCVI8NAL TESTING SERVICE PrirICEitOn, New Jersey barkaiey, California a_ aride, Ch an .Gross ohn S. .,/All rge F. Baugl man 0 Henry Frank H. Bo,les Arnol loyal -. Samuel M. 'Firownell o Kirkpatrick John H. Fischer -den Thresher ohn W. Gardner Wert Calvin E. Gross ilson UW$13 ze Henry -Ghauntey; President- William W. Turnbull,. Exeautive C.'Russell de Burl°, J41 Vice Pre Henry S. Dyer, Vice President John S. Helmick, Vice President Robert J. Solomon, Vice President G. Dykernan Sterling, Vice President and Trd sui Catherine G.'Sharp; Seeta. Joseph E. Terral,Assistant Vice President David J. Brods14, Assistard Treasurer John Graham, Assistant Treasurer. The 1963- Invitational Conference on Testing Problems centered Up- on both theoretical and practicalaspects of measurement ,Speakers reviewed and analyzed the current thinkiqg thdt underlies the basic concepts of reliability, and validity!' The ,potential of cog- nitive: and non-cognitive tests was !explored as were the social consequences of tests in general. In contrast to thesetheoretical discussions the Conference featured to interesting reports on the application of objective tests. in the field of medical education. All in all; it was a most stimulating program that balanced the reality of the present with implications for the fuure. I should like to extend our thanks to Drlexander G. Wesman who, as Chairinan, was responsible fortanning this program. We owe our thanks also to Dr. Jerome S. Bruner for his lunch- eon address and to the other distinguished s _kers whose efforts made this Conference such a success. Henry Chauncey PRES I DENT` Pa 1. Io be 11esignat as "chairnian'., of ETS Invitational Confer- ence on -Testing Prohlenis- simultaneously an honor and an opportunity. The list of prior airmeu is a highly distinguished one; the excellenof prey s wrograms is.docurn4d 6y the constancy of inease in Atlendance al\the meetings. CIll-pporttinity fps. provided by the freedom given the aiman to compope the ,.., prjxgram as ._he wishes a.nd, by _the/regard iniwch the donfer- enceis helda rep clwihich., predisperesAir speakers to , accept the chairman'pi/Ration. The chi man whim. fails to f pfovicle a stimulattnmeeting has_, only himself to blame; if he chooses wIsery, the sp'eakers will fulfill his responsibilities to7his credit In oo nizing 'the. 463 conferince, my design was to have basic concepts and concerns inthe/field of njeasurement pre -sented comyrehensively, informedily/,-and informatively.-The first . session wasdevotedto -stater) -the seience overvie of three fundamental conceptsnorms reliability, and-validity.r.` Roger T. Eenno4 calledfor morefictive attention vdevel9pment o norming theofy, .unimarized current normilig practices, a ttly'ecl -the establi_[-neut. of a system which would permit co parable 'norms fortests whose primary )standardizations are based on sornewcat differing samples of the population, Dr. -.Robtrrt) L. - Thornlike 'commented on proposals, practices, and procedures - for estimating reliability; he.structurecLhis discussion in tams of convpt 'formulations, construction of mathematicalit ( page iv modls,, and Methods of obtainingpertinent data., The third fund. characieristicv validity, was discussed by, EV.Ahne ,nder the to io headings of constructvalidation,` decisionM, theory,moderator variables, syn- eticvalidity, and iesponsi Styles, she reviewed new,approaches. devised for the study ofvalidity'during the last ten years. The second triornini ,seisi n wasdevoted to the repart. and arPpraisal of. test, use id a spific field of application medicine. Dr, John P. Iffubbard .des ed a, tefstifig method used by the Naticntal -Board of Medidal Examiners to appraise..t.1;, diagLit tic ,coinpetence of an intern,piploying a,sequential, programmed pattern in a realistic clinicatitnatiot Under the title, "Alternate Criteria' in Medical Education andth`eir Correrates,'7iDt.°E. Lowell Kelly reported an extensive investigationof predictor and criter- ficon variables of concern tomedical schools. At the lune eon meeting wewere priVilegokl to hear a most address --by Dr. rer9,rite-S.Bruner. His discussion of oceSses and concept formationde eloPment was truly , stimulating,= schola.rly, and info -alive. -, The three afternoon sKaleersdirected ou attention to implica. tions,"and consequenceof- measurement. _helost, Dr. Warren cogni. Fndley, discussed ctirrG. erd theory and aRplication in the ',AppraisalI of ability. Hereviewed our changing tive fields , 4, ,e' A 1 74approaches to investigating the structureand'organisation of mental ability, and oncontemporary methodsof appraising achievement in schoolsnd colleges. Non-cognitive aspectsof student performarice weretreated by Dr. Saguel Messick,who IconMdered die potential ntribution of p sonality 46,essment techniques to the predictionof success. "of college students.He questions as to scientificstand- undetooIketo caise (and answer) valuating personality \dpicels, And , ataLproblemd , a'rclalkir` in "the use of suchdevice,, in pradical decisiiinmak g.- The final Speaker of the day! was Dr.Robei-t L. Ebel, whose-topic was -,The Stycial consequences ofEducational' Testine? Dr. Eby examined the fcharges recently aimed attesting`-by synipailTettc .and by Wrtagonistic critics; ,sub the charges so judicial cod- the siderati accepted the validity of some rejected ) page vi of others; -and .bioJght the several ssues inta saner perspective in concluding remarks owthe-social consequefices of RateAting. would irdAcking-in_gratitailtdit.o_expresi_expliFi nv deep appreciation to the committee of previouInv 1.1onaI- Conference chairmen,which selectedr4e, and to Educational TeStirig Serivice whit sponsored thtf meeting and supplied-pro- fessional and practical assistance at eery stage of the:develop- ent of the programrit was for me a m9st rewarding' eiperivice. page vii HIForeword b HenChauncey' Preface by A- exantier G. Session I: Basic. Concepts In Measurement 1963 13 Norms, Roger T. Lennon, Test DePtirtment, ,Harcourt, Brace and World, Inc. 23 Reliability, Robert. L, Thorndike, Teachers College, Columbia University , 33 Some Current Developments In the Measurement and Interpretation of TekValidlty, Anne Anasta-si, Department of Psychology, Graduate School, Fordharn University Sesellon II: Testing and 'the Medical Profession 49 Programme'd Testing in the Examinations of the National Board of Medical Examiners, John P. Hubbard, National Bbard of Medical Examiners 4 Alternate Criteria in Medical Education and Theii Correlates, E. Lowell Kelly, Bureau of Psychological-, Servites, The Unlversity of Michigan fi CliCe2:10t. contInopa Luncheon Address, 8$ Growing, Jerome S. Bruner, Center for Cognitive Studies Harvard University Session 111: implications and Consequent of Measurement 101Ability and Performance NVarren G. Findley, College of Education, The University of Georgia 110Personality Measurement and Collegec7 Performance, Samuel