666************11066666666
Total Page:16
File Type:pdf, Size:1020Kb
11 ODCWIANT,AESUME 41 ED 187 571 . SE 030 973 AUTHOR Wartield, John N. TITLE Deveiopm'ent otan Interpretive .Structural Modji and StLategies for Implementation Based oe-a Descriptive and Prescriptive Analysis of Resources for Environmental Education/Studies. Evaluatinga Regional Epvironmental LearningSystem, Volume V. INSTITUTION Virginia Univ., Charlottesville. Schoolof Engineering and Applied Scin,-;e. sPUNS AGENCY Ottice of Education (DHEW), Washington,D.C. Office of Environmental Education. REPORT NO Uh/522032/EE79(123 PUb DATE 31 Aug' 79 CONTRACT 300-700-402B ,NOTE. 1b3p.; For reiated documentersee SE 030 969-974 and ED 173 172. EDRkPRICE MF01/PC07 P.us Postage. DESCRIPTORS *Case Studies; *Chan4e Strategies; Curriculum . Development; *Educe,tional Assessment;*Educational Needs; Educational Planning: EducationaleResearch: Eiementa:y Secondary Education; *Environmental Education; Evaluation: Models; NonformalEducation; P:.:stsecoadary-Education; *Science Education ABSTRACT Tni volume deals with the evaluation of a Regional Envitonmental Lea:ning System (RELS). Five contexts of loeyl evaluatioi are,discussed: (1) eVaivation by a board of directors, (2) evaluation et impact ot inservide,(3) evaluation of bias, (4) evaluation of student acnievement, and(5) ethnographic evaluation of a community-based program. L'ase studies of,programs resembling the REES model are presented and,the organizationof an evaluation study is descr.ibed. (Ri) 4 6 4 4. o 666************11066666666**********************************************6 * ( d Aeproductions supplied by EDRS are the best'thatcan be made * * from the original document. *, **********************************44*************************o********* . , U S DEPARTMENT°, HEALTH. EDUCATION A WELFARE NATIONAL INSTITUTE OF EDUCATION TITIS DOCUMENT V.TASISEEN REPRO- DUCED EXACT Ly A% RECE.IvEor-Rom iTIL PERSON OR ORGANIZATIONORIGIN. A I INC. I 1POIN S Of vieley ortopinion's 5TATED 00 NO1 NECESSARILYREPRE SENT OF FIcAt. NATIONALINSTITUTE Or %OUCATION Posi TION ORPot ICY RESEARCH LABORATORIES 'FORTHE ENGINEERING SCIENCES, SCHOOL OF ENGINEERINGAND APPLIED SCJENCE UNIVERSITY OF VIRGINIA Charlot\tesville.,. Virginia 22901 DEVELOPMENT,OF AN INTERPRETIVESTRUCTURAL MODEL AND STRATEGIES FOR IMPLEMENTATION BASED ON A DESCRIPTIVE AND- PRESCRIPTIVE ANALYSISOF RESOURCES FOR ENVIRONMENTAL EDUCATION/STUDIES EVALUfTING- A REGIONALENVIRONMENTAL LEARNING SYSTEM VOLOME V Submitted to: Office of Environmental Educaton Department of Health, Educition and Welfgre 400 Maryland.Avenue, S.W. FOB 46, Room 2025 ) Washington, D. C. 20202 Submitted by: John N. Warfiela 4. Report No. 1JVA/522032/EE79/123 August 1979 a tfia RESEARCH LABORATORIES FOR THE ENGINEERING SCIENCES Members of the faculty who teach at the undergraduate and graduate levels and a number of professional engineers and scientists whose primaryactivityis research generate and conduct the investigations that make up the school's research program. The School of Engineering and Applied Science ofthe Umversity of Virginia believes that research goes hand in hand with teaching. Early in the development ofits graduate training program, the School recognized that men and women engaged in research should be as free as possible of the administrative duties involved ;n sponsored research. I n'1959, therefore, the Research Laboratories for the Engineering Sciences (RLES) was established and assigned the administrative responsibility for such research within the School. The director of R LES himself a faculty member and researcher -maintains familiarity with the support requirements of the research under way. He is aided by an Academic Advisory Committee, made up of a faculty representative from each academic department of the School. ThicCommittee serves to inform RLES of the needs and perspectives of the research program. In addition to administrative support, REES is charged with providing certain technical assistance. Because itis not practical for each oepartment to become self-sufficient in all phases of the supporting, technology essential to present-day research, REES makes services available through the following support groups Machine Shop, Instrumentation, Facilities Services, Publications (inchicling photographic facilities), .and Computer Terminal Maintenance. 4 DEVELOPMENT OF AN INTERPRETIVE,STRUCTURAL MODEL AND STRATEGIES FOR:-WLEMENTATION BASED ON A DESCRIPTIVE AND PUSCRTPTIVE ANALYSIS OFRESOURCES VOR ENVIRONMENTAL EDUCATION/STUDILS EVALUATING A REGIONAL ENVIRONMENTALLEARNING SYSTEM VOLUME V Final Report Contra-ct No. 300-700-4028 Work Supported Under the Environmental Education Act of 1970 P. L. No. 91-516, P. L. No. 93-278 and P.L. No. 95-482, as ameltded Submitted to: Office of Environmental Education peprtment of Health, Education and Welfare 400 Maryland Avenue, S.W. FOB 116, Room'2025 Washington, D. C. 20202 Submitted by: John N. Warfield Department of Electrical Engineering RESEARCH LABORATORIES FOR THE ENGINEERINGSCIENCES SCHOOL OF ENOINEER* AND APPLIED SCIENCE UNIVERSITY OF VIRGINIA CHARLOTTESVILLE, VIRGINIA Report No. UVA/522012/EE19/123 Copy No. August 11, 19/9 -1 ( EVALUATING -A REGIONAL VVIRONMENTAL LEARNING SYSTEM BY R OBER rSTAKE . CLAIRE 'BROWN. GORDON HOKE. GRAHAM MAXWELL /)JO FRI EDMAN AT THE UNIVERSITY OF ILLINOIS XXXXXXXXXXXXXXXXXXXXXXXXXXX)WKXXXXXXXXXXXX* 1 0 PROGRAM EVALUATION 0 x x RELS CASE STUNES x x x 0 I 0 * x . ' What it means 1 i LTVEC x ) * * Starting I x 1 * * to think 1 Basic terms x 1 * 1 about ,., 0 Citizens * x evaluating : Basic designs x x league *1 1 x 1 x 1 x I Politics 0 x 1 xexxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 1 x x x x * .x x 1 vxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 1 x x Its topical x 1 x 0 .x x x Figuring ' organization * 1 x x ORGANIZING AN EVALUATION STUDY 0 1 x x x out. this x x x 1 x 4 l x 1 x >k manual Pedagogical X , 0 X x X A 1 rationale x Reference 1 X x 0 1 X x didensions x 5 X x x (XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX X , xl X ---4., x x. 1 , 1 x VXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX X Impact 1 x X X X r Designs 1 X X ,, X I A X A 1.. I X x JYPICAL OPPORTUNITIES TO EVALUATE Process x x x. I , x x 1 x x 1 x x , * ' 1 x x x . x 1 Observation ' x x x 1 x 1 x Board 1 * Negotiating x x 1 * x ' x I x a contract A decision , x ' x x 1 Interview x x x 1 x x x makiny ' x x 1 x x x , ' x x - x 1 Document ' x ' x * 1 A plan of ' x 1 analysis $ u ' x action x ' x x x x 0 I. 1 1x x , x 1 Inservice . 4 ) 0 x 1 x 'x ' 1 Altitude x x Issues x tqacher. ' x 1 x x 1 scaling ' x x x , x V. ' x u 1 x , x x x x . x x x Reports) x 1 x x , ' x x , Value ' x x 0 ' x 1 xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx ' x 1 analysis ' x K-' 1 ' x ) Study ' ' x 1 Xxxxxxxxxx'xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx ' x 1 Document x committee ' x 1 x x *1 1 analysis \ x bias ' x 1 x ORGANIZING A RELS EVALUATION UNIT x ' 1 x x x ' .4- 1 x x * ,' x 1 Self x x 1 , , x i ., x ' evaluation ' x 0 ' 1 . What $5000 . 1 1 ' x x : ' x x , 1 buys ' x x 1 .., * ' 1 1 ?C A X , 1 I X Achievement , x x . , x 1 1 x , 1 testing x i :)1 Networking ' x Student x , : x ' x x X achievement 1 1 X x Curriculum ' x 1 : x xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx* 1 analysis 1 t 1 1 . xxxxxxxxxxxxxyxxxxxxxxxxxxxxxxxxxxxxxxxxxx 0 x 1 x 1 * 4 1.. 1 x 4 Ethnography ' x 1 , , 1 Co ity , r X 1 1 1 e 1 1 $ X TOPICAL BJBLIOGRAPHY action 1 iR 1 roject , x ' x 1 , 1 x . 1 history. 1 x x . 1 1 x ' x *xxxxxxxxxXxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx* XXXXXXXXXXXXXX4XXXXXXXXXXXXXXXXXXXXXXXXXXXX 7f- EVALUATING ,AREGIONAL ETONMENTAL LEARNING SYST±M a Program Evaluation Manual gi to accompany the design of a Regional griVironmental LearningSistem prepared by John Warfield of the University of Virginia and a team of collaborators under Fontract to the U.S. Offie of Environmental Education Contr`act No'. 300-700-4028 This Program Evaluation Manual has been preparedby Bob Stake, Claire Brown, Gdrdon Hoke, GrahamNtaxwell, and Jo Friedman with assistance during thecourse of the project from many people but particularly Tom Hastings,_Chris B uethe,Joan SextrO George Araka padavil and Jeri Willen CenterforInstructionalResearchandCurriculumEvaluation College of Educatiori University of Illinois Urbana, Illinois 1 4August 31, 1979 41, 0 1 EVALUATING A REGIONAL ENVIRONMENTAL LEARNING SYSTEM Table of Contents Page 1 Programvaluatian 3(_ The Meanings of Evaluation . 5 'The Political Side df RELS Evaluation 4 8 The Routing of the Reader through this Manual 0 10 This Manual's Pedagogical'Ratiohale 1 11 RELS-Like Case Studies / . .. 11 Once Upon a RiVer: The Little Tennes ee Valley Co-operative 14* The Seven Schoo) Districts 18 Beginnings 22 Buck Rogers Land .. .\ 24 Lost Dreams, Bnoken Promises 28 Better Years 30 LTVEC: Circa '79 1 42 . Final Thoughts 44 The titizens League 46 The WorKings of a Study Comittee 52 Opportunities/for Evaluation: Illustrative Applications 53 An'Evaluation of the LTVEC Board of Directors 53 A Blue Ribbon Pane) 57. Observation 58 Interviews 59 Document Analysis 64 Recommendations 65 Evaluating the Impact of an Inservice Training Project 69 Impact in the Classroom 71 Check Sheets 77 Summary ''. TO An.tvaluation Study of Possible Bias in Committee Work 80' Self Study . 81 Value Position Acknowledgement 84 Self-evaluation Portfolios , i 86 An Adversary Hearing s. 87 .i, Interviews on Representation 88 Quality Control of Network Informaticn' . 89 Awareness, Knowledge, and Behavior 91 An Evaluation of Student Achievement 91 Teaching Environmentalism , 93 Item Selection 95 Ethnogrlphfc Evaluation-ofa Community-Based Program 97 Natural-ktic Evaluation