Examining the Test: an Evaluation of the Police Standard Entrance Test. INSTITUTION Scottish Council for Research in Education
Total Page:16
File Type:pdf, Size:1020Kb
DOCUMENT RESUME ED 415 249 TM 027 914 AUTHOR Wilson, Valerie; Glissov, Peter; Somekh, Bridget TITLE Examining the Test: An Evaluation of the Police Standard Entrance Test. INSTITUTION Scottish Council for Research in Education. SPONS AGENCY Scottish Office Education and Industry Dept., Edinburgh. ISBN ISBN-0-7480-5554-1 ISSN ISSN-0950-2254 PUB DATE 1996-00-00 NOTE 104p. AVAILABLE FROM HMSO Bookshop, 71 Lothian Road, Edinburgh, EH3 9AZ; Scotland, United Kingdom (5 British pounds). PUB TYPE Reports Evaluative (142) EDRS PRICE MF01/PC05 Plus Postage. DESCRIPTORS *Employment Qualifications; Foreign Countries; Job Skills; Minority Groups; *Occupational Tests; *Police; Test Bias; *Test Interpretation; Test Use; *Testing Problems IDENTIFIERS *Scotland ABSTRACT In June 1995, the Scottish Council for Research in Education began a 5-month study of the Standard Entrance Examination (SET) to the police in Scotland. The first phase was an analysis of existing recruitment and selection statistics from the eight Scottish police forces. Phase Two was a study of two police forces using a case study methodology: Identified issues were then circulated using the Delphi approach to all eight forces. There was a consensus that both society and the police are changing, and that disparate functional maps of a police officer's job have been developed. It was generally recognized that recruitment and selection are important, but time-consuming, aspects of police activity. Wide variations were found in practices across the eight forces, including the use of differential pass marks for the SET. Independent assessors have identified anomalies in the test indicating that it is both ambiguous and outdated in part, with differences in the readability of different versions that compromises comparability. Proportionately more women and ethnic minority candidates experience difficulty with the SET, and proportionately more white male candidates are eliminated following background inquiry or for "other reasons" than other groups. Both the insufficient number of applicants from ethnic minority backgrounds and their disproportionately higher failure rate on the SET need to be addressed. Recommendations for improving the construction and use of the SET are offered. Seventeen appendixes present supplemental information about the SET and the study. (Contains five figures and nine tables.) (SLD) ******************************************************************************** * Reproductions supplied by EDRS are the best that can be made * * from the original document. * ******************************************************************************** (CLUll CRkg (Rag ((Ann 1j; rikkfi CR80 CR80 8:R8B CRU 0E0 CR80 0811 CR8,11 C13811 81k8.0 (C6R80 (x1rman CU CA811 (1380 FallCRU (C1k8S CR811 CR I Cna0 00180 CR811 CQUO COUttl /<1g kg CR80 (RailCR8111VRkrigl o as CRU0 (CAff0 cxan CI3M clan _r80 CR08 (CND vann (RRL mot 80 (CR88. (clan okon cea cxan (`Ran caan (CM COW exa 0080 CR811 .. CR811 C380 _VW CRUll c R 80 cR811 CR80 CX80 CROO. k'Rk0 CR00 LCR811 CR8 an cgan cgan CX80 C13110 C11WtCan (C1380 CA811 013811 -f101111 (COW h80 CR80 8.<R80 CRUll RaO CR80 CR80 caul Tenn CRUO 010080 COUP cxan Cagil (C8880 CEO CIP811OGIRap {: CR811 "IRUO C1380 CR80 CR8001000T H CRIB 01111CR80 80CRU0 CR80 ( /Rail rrnzsza ((AU CR80 Clk0 rata 811 ((nu CR80 rxa EXAMINING THE 110 (uSali CR80 (CA80 0/381 86380 CRUO CR80 CR 6380 CRUZ CR8 an '1L'«'4 C 13811 01380 OW 11 C480 TEST C3811 CR1111 CRU (`0080 4_.'10.80j,.! C1380 CR811 CR '"-w2A-11--c hap C11010.:..., CR011 C6380 CRU C(CRR80 CR80 CR80 40 80 C80R CR VW CR80 'RU otan ROI C008 6810 (i!' !10,111:Pii AN EVALUATION «A110 c( <[001aan cg( 110 °I00a11.c` CR811 non cg g11 figt.10 CR811 CRU CR8 80 IR 8 it CR8ll CR80 CR80 OF THE POLICE CR011 (CR811 CRI,1 gall 11 CR811 CX80 CR0 an .. CIgUil CR80 C'R8 CRU «Ann CR811 STANDARD ENTRANCE 013811 C13811 (CRO 110 611 CRUD CA8B CRO, CR811 CRill 8A80\---Cott nu :// 11if CRUO CR811 «i'xtv 11 TEST CRU caan v, Leff « C340 (Ran ('80 ci (1380 CR811 (Rail 1111 rumr-tc-RI 8a8.8 CRU0 ritall C1101 CR80 8 Rail (LAN, CVO ( R(111 CR811 cmao runn tl Vit. OF EDUCATION (6380 0138001380 013100 c gall U.S. DEPARTMENTResearch and Improvement Office of Educational INFORMATION VIM OW- Ull (ROO ,':: EDUCATIONAL RESOURCES CENTER (ERIC) CAU (0001-0100 CRUO ( .« RH, -Erlihis document has been reproduced as C1380 (C100 001 au received from the person ororganization (-03811 \unan cn4an originating it. heen made to CR811((13110 ( )0/ CRUO Minor changes have improve reproductionquality. CEO(`0000110CX8 R n-TR811 (11011 CUMCR8100088 (<R011 ( CU stated in this Points of view or opinions (13(11 18A811(('RU 1110631111. necessarily represent document do not CR811CR811 (7380 aD 003110 official OERI position orpolicy. CR811CR80 'MO 0031111 (°0081107380((\,, 80 "00 C811CR811 8148.0 an 01311018110 "108101380 CR8110/380CR8CR80 013110 1000111 CR811((Al c'lit\-i1k80 (C,3118 i (°/Rail(1380CR8Fmn 811C( <9001 Cng013811CV 80 1811 0R811 elkall0 /RaoCA 8 811 811 "Aka THE SCOTTISH OFFICE kind0/380((-18 811 (°6300 (/380CCU OW 01300 070080060 ((WU' a11 ('6380 (13110/Ball(1k40 Ten (°100011 CR80C /380rcega clan 80 can' ckanCR811\fe12'18 13811 CROP rumCR80 CR81 CR811 CR811CR80('138 11 280 0100811 CR811 BEST COPY AV 018110138001380<13811 CR00 CA80 07380 11CR80caan (13110 coaan ([31111 C R8CR80COW (63811 CFg0 C1380 CR8001380C000 CVO (1380 0 0 931I C63800/380CR80 0/380 (/k811 0(`[3110 Examining the Test An Evaluation of the Police Standard Entrance Test Valerie Wilson Peter Glissov Bridget Somekh The Scottish Council for RessuchIiEducation The Scottish Office Central Research Unit 1996 Further copies of this report are available priced £5.00. Cheques should be made payable to HMSO Books and addressed to: HMSO Bookshop 71 Lothian Road Edinburgh EH3 9AZ Tel: 0131-228-4181 Fax: 0131-229-2734 The views expressed in this report are those of the researcher and do not necessarily represent those of the Department or the Secretary of State for Scotland. © Crown Copyright 1996 Limited extracts from the text may be produced provided the source is acknowledged. For more extensive reproduction, please write to the Chief Research Officer at the Central Research Unit, St Andrew's House, Edinburgh EH1 3DG. Acknowledgements We wish to acknowledge the help and co-operation of a number of people: members of the Advisory Group, who provided insights into the working of the police service in Scotland; police forces, which provided us with information, and police officers, who agreed either to be interviewed individually or participated in the focus group meetings. We hope that we have fairly represented the views of all who participated in the evaluation process. ov Contents List of Tables and Figures i List of Appendices ii Summary in 1. Introduction and research outline 1 2. Aims of the research 2 3. The research in context 2 4. The Police Standard Entrance Test (SET) 6 5. Emerging issues 8 6. SET as a test instrument 9 7. Survey 13 8. A functional map of the police constable 20 9. Equal Opportunities: Women and ethnic minorities 31 10. Recruitment Pathway 38 11. Conclusions and implications 43 Appendices 50 References 84 0 List of Tables and Figures Table 1: An overview of a selection of previous studies of police officers 3 Table 2: Textual differences between the three versions of the SET 12 Table 3: Readability of SET Forms 1-3 13 Table 4: Sample of SET Candidates 1992-1994 14 Table 5: Number of candidates by ethnic background 15 Table 6: Pass/fail rates and appointments by educational achievement level 16 Table 7: The SCRE functional map of police work 21 Table 8: Headings and main categories used in five studies (in chronological order) 23 Table 9: Candidates failing the SET as a proportion of all candidates who failed in one force 34 Figure 1: The educational level of female and male candidates (Percent) 16 Figure 2: Fail/Pass rates for female and male candidates (Percent) 17 Figure 3: Number of candidates by test scores achieved 17 Figure 4: Proportion of candidates in one force over the period, 1992- 94 34 Figure 5: Proposed revised recruitment pathway 45 7 List of Appendices Appendix 1: Preliminary interview schedule 50 Appendix 2: Instructions for SET assessors 52 Appendix 3: Flesch reading ease index 53 Appendix 4: Analysis of topics in SET 54 Appendix 5: Survey data collection sheet 55 Appendix 6: Test scores on the four sections of the SET 56 Appendix 7: Sample of recruitment paths 60 Appendix 8: Basic entry requirements 65 Appendix 9: Sample interview aid form 66 Appendix 10: Behavioural event interview schedule 67 Appendix 11: Functional map for police constables 70 Appendix 12: Qualitative data collected 76 Appendix 13: Focus group topic guide 77 Appendix 14: Recruitment hurdles in one force 79 Appendix 15: SET scores for female and male candidates 80 Appendix 16: Delphi questionnaire form 81 Appendix 17: Structure of probationary period 83 ii Examining the Test: An Evaluation of the Police Standard Entrance Test Summary Introduction In June 1995 the Scottish Council for Research in Education began a five month study of the Standard Entrance Examination to the police in Scotland. The project was funded by The Scottish Office. The research comprised two phases: Phase 1: an analysis of extant recruitment and selection statistics from the eight police forces. Phase 2:a study of two police forces utilising a case study methodology. Additionally, emerging issues were circulated, Delphi-style, to all eight forces in order to validate the findings. The research had two principal outcomes: an interim report, summarising statistical fmdings, presented in September; a final report, detailing our findings in respect of both phases. Conclusions The main fmdings and conclusions to emerge from the evaluation are as follows: Context: agreement that both society and policing are changing disparate functional maps of a police officer's job have been developed general agreement that policing is demanding recognition of the relationship between job competences and context, viz.