Bennett Mechanical Comprehension Test
Total Page:16
File Type:pdf, Size:1020Kb
Bennett Mechanical Comprehension Test George K. Bennett 888-298-6227 • TalentLens.com Copyright © 2008 NCS Pearson, Inc. All rights reserved. Copyright © 2008 NCS Pearson, Inc. All rights reserved. Warning: No part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system without permission in writing from the copyright owner. Pearson, the TalentLens logo, Bennett Mechanical Comprehension Test, and the BMCT logo are trademarks, in the U.S. and/or other countries of Pearson Education, Inc., or its affiliate(s). Portions of this work were published in previous editions. Printed in the United States of America. Published by Pearson 19500 Bulverde Rd. San Antonio, TX 78259, USA 1-800-211-8378 ISBN 0158339304 1 2 3 4 5 6 7 8 9 10 11 12 A B C D E Table of Contents Chapter 1 Introduction ................................................................................................................ 1 Mechanical Comprehension ....................................................................................................... 1 Description of the BMCT ............................................................................................................ 2 Reading Level................................................................................................................................. 3 Chapter 2 General Directions for Administration and Scoring ........................................ 5 Testing Conditions ....................................................................................................................... 5 Preparing for Administration .................................................................................................. 5 Answering Questions ................................................................................................................... 6 Test Security ................................................................................................................................... 6 Accommodating Examinees With Disabilities ...................................................................... 6 Chapter 3 Administering the Paper-and-Pencil BMCT ....................................................... 9 Paper-and-Pencil Administration Materials ......................................................................... 9 Concluding Administration ..................................................................................................... 11 Scoring the BMCT Answer Sheet ............................................................................................ 11 Using the Hand-Scoring Templates ......................................................................................... 11 Preparing Answer Sheets for Machine-Scoring ...................................................................... 11 Chapter 4 Directions for Computer-Based Administration ............................................. 13 Administering the Test ............................................................................................................. 13 Scoring and Reporting .............................................................................................................. 14 Chapter 5 Comparing Scores to Normative Data ............................................................... 15 Development of Scaled Scores ................................................................................................. 16 Development of Norms .............................................................................................................. 16 Converting Raw Scores to Percentile Ranks ........................................................................... 17 Copyright © 2008 NCS Pearson, Inc. All rights reserved. iii Bennett Mechanical Comprehension Test Chapter 6 History of the BMCT .............................................................................................. 19 Development of Forms S and T ............................................................................................... 19 Updated Artwork ...................................................................................................................... 20 Equivalence of Forms ............................................................................................................... 21 Previous Studies of Equivalence of Form S to Form T ........................................................... 21 Current Studies of Equivalence of Form S to Form T ............................................................ 21 Equivalence of Computer-Based and Paper-and-Pencil Versions of the BMCT .................... 22 Differences in Mechanical Comprehension Test Scores Based on Sex ................................ 23 Fairness of Using the BMCT With Female Applicants ........................................................... 23 Adverse Impact ....................................................................................................................... 24 Chapter 7 Evidence of Reliability ........................................................................................... 25 Standard Error of Measurement............................................................................................. 25 Internal Consistency .................................................................................................................. 26 Previous Studies of Internal Consistency Reliability ............................................................ 26 Current Studies of Internal Consistency Reliability .............................................................. 27 Evidence of Test-Retest Reliability ......................................................................................... 28 Effects of Training and Practice............................................................................................. 29 Chapter 8 Evidence of Validity ................................................................................................ 31 Evidence of Validity Based on Test Content ........................................................................ 31 Evidence of Validity Based on Test-Criterion Relationships ........................................... 31 Evidence of Convergent and Discriminant Validity ......................................................... 37 Chapter 9 Using the BMCT as an Employment Assessment Tool .................................. 41 Employment Selection .............................................................................................................. 41 Making a Hiring Decision Using the BMCT ........................................................................... 42 Fairness in Selection Testing .................................................................................................... 43 Legal Considerations .............................................................................................................. 43 Group Differences/Adverse Impact ........................................................................................ 43 Monitoring the Selection System........................................................................................... 43 Employee Development ........................................................................................................... 44 Training and Instruction .......................................................................................................... 44 Copyright © 2008 NCS Pearson, Inc. All rights reserved. iv Table of Contents Appendix A Normative Data .................................................................................................... 45 References .................................................................................................................................... 55 Research Bibliography .............................................................................................................. 57 Glossary of Measurement Terms ............................................................................................ 63 List of Tables Table 1.1 Grade Levels of Words on BMCT Forms S and T ............................................................... 3 Table 6.1 Categorization of Form S and Form T Items ................................................................... 20 Table 6.2 Summary of Item Difficulty and Discrimination ............................................................ 20 in Forms S and T (Bennett, 1969) Table 6.3 Comparison of Forms S and T Scores .............................................................................. 21 Table 6.4 Equivalency of Form S and Form T ................................................................................. 22 Table 6.5 Equivalency of Paper and Online Modes of Administration .......................................... 23 Table 7.1 Means, Standard Deviations (SD), Standard Error ........................................................... 27 of Measurement (SEM), and Split-Half Reliability Coefficients r( xx) of the BMCT (Bennett, 1969) Table 7.2 Means, Standard Deviations (SD), Standard Error of ...................................................... 28 Measurement (SEM) and Internal Consistency Reliability Coefficients r( alpha) Table 7.3 Test-Retest Reliability of the BMCT ................................................................................. 29 Table 8.1 Studies Showing Evidence of Criterion-Related