Bennett Mechanical Comprehension Test

Total Page:16

File Type:pdf, Size:1020Kb

Bennett Mechanical Comprehension Test Bennett Mechanical Comprehension Test George K. Bennett 888-298-6227 • TalentLens.com Copyright © 2008 NCS Pearson, Inc. All rights reserved. Copyright © 2008 NCS Pearson, Inc. All rights reserved. Warning: No part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system without permission in writing from the copyright owner. Pearson, the TalentLens logo, Bennett Mechanical Comprehension Test, and the BMCT logo are trademarks, in the U.S. and/or other countries of Pearson Education, Inc., or its affiliate(s). Portions of this work were published in previous editions. Printed in the United States of America. Published by Pearson 19500 Bulverde Rd. San Antonio, TX 78259, USA 1-800-211-8378 ISBN 0158339304 1 2 3 4 5 6 7 8 9 10 11 12 A B C D E Table of Contents Chapter 1 Introduction ................................................................................................................ 1 Mechanical Comprehension ....................................................................................................... 1 Description of the BMCT ............................................................................................................ 2 Reading Level................................................................................................................................. 3 Chapter 2 General Directions for Administration and Scoring ........................................ 5 Testing Conditions ....................................................................................................................... 5 Preparing for Administration .................................................................................................. 5 Answering Questions ................................................................................................................... 6 Test Security ................................................................................................................................... 6 Accommodating Examinees With Disabilities ...................................................................... 6 Chapter 3 Administering the Paper-and-Pencil BMCT ....................................................... 9 Paper-and-Pencil Administration Materials ......................................................................... 9 Concluding Administration ..................................................................................................... 11 Scoring the BMCT Answer Sheet ............................................................................................ 11 Using the Hand-Scoring Templates ......................................................................................... 11 Preparing Answer Sheets for Machine-Scoring ...................................................................... 11 Chapter 4 Directions for Computer-Based Administration ............................................. 13 Administering the Test ............................................................................................................. 13 Scoring and Reporting .............................................................................................................. 14 Chapter 5 Comparing Scores to Normative Data ............................................................... 15 Development of Scaled Scores ................................................................................................. 16 Development of Norms .............................................................................................................. 16 Converting Raw Scores to Percentile Ranks ........................................................................... 17 Copyright © 2008 NCS Pearson, Inc. All rights reserved. iii Bennett Mechanical Comprehension Test Chapter 6 History of the BMCT .............................................................................................. 19 Development of Forms S and T ............................................................................................... 19 Updated Artwork ...................................................................................................................... 20 Equivalence of Forms ............................................................................................................... 21 Previous Studies of Equivalence of Form S to Form T ........................................................... 21 Current Studies of Equivalence of Form S to Form T ............................................................ 21 Equivalence of Computer-Based and Paper-and-Pencil Versions of the BMCT .................... 22 Differences in Mechanical Comprehension Test Scores Based on Sex ................................ 23 Fairness of Using the BMCT With Female Applicants ........................................................... 23 Adverse Impact ....................................................................................................................... 24 Chapter 7 Evidence of Reliability ........................................................................................... 25 Standard Error of Measurement............................................................................................. 25 Internal Consistency .................................................................................................................. 26 Previous Studies of Internal Consistency Reliability ............................................................ 26 Current Studies of Internal Consistency Reliability .............................................................. 27 Evidence of Test-Retest Reliability ......................................................................................... 28 Effects of Training and Practice............................................................................................. 29 Chapter 8 Evidence of Validity ................................................................................................ 31 Evidence of Validity Based on Test Content ........................................................................ 31 Evidence of Validity Based on Test-Criterion Relationships ........................................... 31 Evidence of Convergent and Discriminant Validity ......................................................... 37 Chapter 9 Using the BMCT as an Employment Assessment Tool .................................. 41 Employment Selection .............................................................................................................. 41 Making a Hiring Decision Using the BMCT ........................................................................... 42 Fairness in Selection Testing .................................................................................................... 43 Legal Considerations .............................................................................................................. 43 Group Differences/Adverse Impact ........................................................................................ 43 Monitoring the Selection System........................................................................................... 43 Employee Development ........................................................................................................... 44 Training and Instruction .......................................................................................................... 44 Copyright © 2008 NCS Pearson, Inc. All rights reserved. iv Table of Contents Appendix A Normative Data .................................................................................................... 45 References .................................................................................................................................... 55 Research Bibliography .............................................................................................................. 57 Glossary of Measurement Terms ............................................................................................ 63 List of Tables Table 1.1 Grade Levels of Words on BMCT Forms S and T ............................................................... 3 Table 6.1 Categorization of Form S and Form T Items ................................................................... 20 Table 6.2 Summary of Item Difficulty and Discrimination ............................................................ 20 in Forms S and T (Bennett, 1969) Table 6.3 Comparison of Forms S and T Scores .............................................................................. 21 Table 6.4 Equivalency of Form S and Form T ................................................................................. 22 Table 6.5 Equivalency of Paper and Online Modes of Administration .......................................... 23 Table 7.1 Means, Standard Deviations (SD), Standard Error ........................................................... 27 of Measurement (SEM), and Split-Half Reliability Coefficients r( xx) of the BMCT (Bennett, 1969) Table 7.2 Means, Standard Deviations (SD), Standard Error of ...................................................... 28 Measurement (SEM) and Internal Consistency Reliability Coefficients r( alpha) Table 7.3 Test-Retest Reliability of the BMCT ................................................................................. 29 Table 8.1 Studies Showing Evidence of Criterion-Related
Recommended publications
  • A Critical Study of Certain Tests of Mechanical Ability Herbert A
    University of Massachusetts Amherst ScholarWorks@UMass Amherst Masters Theses 1911 - February 2014 1930 A critical study of certain tests of mechanical ability Herbert A. Landry University of Massachusetts Amherst Follow this and additional works at: https://scholarworks.umass.edu/theses Landry, Herbert A., "A critical study of certain tests of mechanical ability" (1930). Masters Theses 1911 - February 2014. 1697. Retrieved from https://scholarworks.umass.edu/theses/1697 This thesis is brought to you for free and open access by ScholarWorks@UMass Amherst. It has been accepted for inclusion in Masters Theses 1911 - February 2014 by an authorized administrator of ScholarWorks@UMass Amherst. For more information, please contact [email protected]. UMASS/AMHERST 312066 0306 7566 2 FIVE COLLEGE DEPOSITORY A Critical Study of Certain Tests of Mechanical Ability Herbert A. Landry I This thesis is not to be loaned outside the library building. For this purpose, use the copy in the department where the work or the thesis was done. 9o(, k critical 3tuby cp cbwmi tests cp stofajical abiiitt BY H*WB*R? A, LAEDRT IWPAOTifTO? 0? AGRICULTURAL SWCATICB THESIS SUBMITTED POH MMHtt CP tttffi OP SCUBfCT. massashuswts agricuitoral nun AHHEPST. MASS. 1 9 3 0. The writer wishes to record here his indebtedness to those persons who have assisted in this study. His greatest obligation is to Professor Harry IT. Glide, who has followed the study with interest and who has offered valuable criticisms and sureestlons. Tb Superintendent John ft* Fausey and " Principal ''illiara A.. Cowing of the West Springfield Schools where the testing was done, he is indebted for their very willing cooperation.
    [Show full text]
  • Sex Differences in Mechanical Aptitude: an Investigation of Sex Differences in Mechanical Aptitude and Its Relation to Nonverbal Abilities Karolina E
    University of North Florida UNF Digital Commons All Volumes (2001-2008) The sprO ey Journal of Ideas and Inquiry 2001 Sex Differences in Mechanical Aptitude: An Investigation of Sex Differences in Mechanical Aptitude and Its Relation to Nonverbal Abilities Karolina E. Christensson Ringby University of North Florida Follow this and additional works at: http://digitalcommons.unf.edu/ojii_volumes Part of the Social and Behavioral Sciences Commons Suggested Citation Ringby, Karolina E. Christensson, "Sex Differences in Mechanical Aptitude: An Investigation of Sex Differences in Mechanical Aptitude and Its Relation to Nonverbal Abilities" (2001). All Volumes (2001-2008). 132. http://digitalcommons.unf.edu/ojii_volumes/132 This Article is brought to you for free and open access by the The sprO ey Journal of Ideas and Inquiry at UNF Digital Commons. It has been accepted for inclusion in All Volumes (2001-2008) by an authorized administrator of UNF Digital Commons. For more information, please contact Digital Projects. © 2001 All Rights Reserved Sex Differences in based on a smaller sample than originally planned. Mechanical Aptitude: An Little research has been conducted Investigation of Sex examining the basis for the reported sex differences in mechanical aptitude. Differences in Mechanical Mechanical aptitude tests are used Aptitude and Its Relation to extensively in selection procedures for Nonverbal Abilities mechanical jobs. A study investigating the validity of two of these measures and Karolina E. Christens son Ringby the differential performance of each sex group on them is quite timely because Faculty Sponsor: Dr. Susana Urbina, more women are seeking employment in Professor of Psychology areas that require mechanical abilities.
    [Show full text]
  • Comparison of Mechanical Aptitude, Prior Experiences, and Engineering Attitude for Male and Female Mechanical Engineering Students
    AC 2011-701: COMPARISON OF MECHANICAL APTITUDE, PRIOR EX- PERIENCES, AND ENGINEERING ATTITUDE FOR MALE AND FEMALE MECHANICAL ENGINEERING STUDENTS Michele Miller, Michigan Technological University Dr. Michele Miller is an Associate Professor in mechanical engineering. She teaches classes on manufac- turing and human factors and does disciplinary research on microelectromechanical systems and precision machining. Her educational research interests include problem solving in the lab and informal engineering education. Anna Pereira, University of California, Berkeley Benjamin Mitchell, Michigan Technological University Page 22.352.1 Page c American Society for Engineering Education, 2011 Comparison of Mechanical Aptitude, Prior Experiences, and Engineering Attitude for Male and Female Mechanical Engineering Students Abstract We investigated ways to measure mechanical aptitude, including: a paper and pencil mechanical aptitude test (MAT), rating of expertise based observation of students doing hands- on tasks, and performance on physics computer games. Male students scored higher then female students on the MAT and physics games at statistically significant levels. Students also completed prior experience and engineering attitude questionnaires. We examined correlations between prior experiences and MAT performance and found activities such as operating machinery, repairing equipment, and using tools to correlate most highly. The prior experience results showed that male students spent many more hours engaging in the activities with the strongest correlations to MAT performance. The attitude survey included questions relating to confidence and enjoyment of figuring out how things work and troubleshooting. Based on the results, the male students had more confidence and enjoyment than female students at statistically significant levels. Introduction The representation of women in engineering is quite low relative to other previously male- dominated professions such as law and medicine.
    [Show full text]
  • The Personality Inventory ••••••••••••••••••• 60
    A STUDY OF THE RELATIONSHIP BETWEEN FRENCH ACHIEVEMENT AIÏD CERTAIN MENTAL TRAITS A THESIS SUBMITTED TO THE FACULTY OF THE SCHOOL OF EDUCATION, ATLANTA UNIVERSITY IN PARTIAL FULFILLMENT OF THE REQUIREMENTS FOR THE DECREE OF MASTER OF ARTS BY RANDALL GARFIELD GAY SCHOOL OF EDUCATION ATLANTA UNIVERSITY AUGUST, 1949 R- vi T; ^ ii TABLE OF CONTENTS m £ ? *' Chapter Page I, INTRODUCTION 1 Statement of Problem • ••••«•••••••••••« 1 Definition of Tonne 1 Purpose •■•••••••••••••••••••••• 1 Collection of Data • •«•••••.•••••••••• 2 Survey of Related Literature ,••••••••••••« 3 Summary of Related Literature ••••••••••••• 34 II, ANALYSIS AND INTERPRETATION OF DATA 37 French Achievement as Measured by the American Council Beta French Test •••••••••••••• 37 French Achievement and Intelligence •••••••••• 41 French Achievement and Meohanical Aptitude • ••«••• 44 French Achievement and Introversion-extroversion , • • • 48 French Achievement and Dominance-submission ••«••• 52 French Achievement and Neurotic Tendency •••••••« 56 French Achievement and Self-sufficiency «••••••• 60 French Achievaaent and Sociability ••••••••••• 64 French Achievement and Confidence • ••«,,,••,, 68 Individual Cases • »*.»•••••,,,,«•«••• 73 III, SUMMARY AND CONCLUSIONS . 85 \ Summary • ••»»•«•«•••••••••»»••»• 85 Conclusions •••••••« •«••« 86 BIBLIOGRAPHY . 87 APPENDIX A 90 APPENDIX B 93 iii LIST OF TABLES Table Page 1, Frequency Distribution of Scores Obtained by Thirty-six Pupils on the Amerioan Council Beta French Test •••••• 38 2* Data Concerning Scores Made by Thirty-six
    [Show full text]
  • A Study of a Mechanical Aptitude Test in a Trade School Hermon R
    University of Massachusetts Amherst ScholarWorks@UMass Amherst Masters Theses 1911 - February 2014 1930 A study of a mechanical aptitude test in a trade school Hermon R. Clark University of Massachusetts Amherst Follow this and additional works at: https://scholarworks.umass.edu/theses Clark, Hermon R., "A study of a mechanical aptitude test in a trade school" (1930). Masters Theses 1911 - February 2014. 1398. Retrieved from https://scholarworks.umass.edu/theses/1398 This thesis is brought to you for free and open access by ScholarWorks@UMass Amherst. It has been accepted for inclusion in Masters Theses 1911 - February 2014 by an authorized administrator of ScholarWorks@UMass Amherst. For more information, please contact [email protected]. * UMASS/AMHERST 312066 0306 7564 4 FIVE COLLEGE DEPOSITORY A Study of Dr. O'Connor's Mechanical Aptitude Test No. 5 as Applied to a Trade School Hermon R Clark This thesis is not to be loaned outside the library building. For this purpose, use the copy in the department where the work ot the thesis was done. This thesis is not to be loaned this outside the library building. For purpose, use the copy in the department where the work ot the thesis was done. ?64 A STUDY OF A MECHANICAL APTITUIT. IF, ST IK A TRADE SCHOOL By Hermon R. Clark Thesis submitted for the degree of wastur of science Massachusetts Agricultural College Amherst, Mass. 1930. i ANALYTICAL OUTLIfSF Chapter I. Introduction A. Purpose? To make a study of 0« Connor 1 s Wisely Block in relation to its posrible use as a prognostic, vo- cational test in the Springfield Trade School ..............
    [Show full text]
  • Genes, Evolution, and Environment
    M03_WADE0354_05_SE_C03.indd Page 70 15/10/14 10:03 PM user /203/PHC00110/9780205960354_WADE/WADE_PSYCHOLOGY05CE_SE_9780205960354/SE/MAIN/M03 ... Genes, Evolution, 3 and Environment 70 M03_WADE0354_05_SE_C03.indd Page 71 15/10/14 10:03 PM user /203/PHC00110/9780205960354_WADE/WADE_PSYCHOLOGY05CE_SE_9780205960354/SE/MAIN/M03 ... Ask questions. OUTLINE Unlocking the Secrets be willing to wonder of Genes The Genetics of Similarity If a trait is “genetic,” is it inevitable? Evolution and Natural Selection Why do kittens, monkeys, toddlers, and Innate Human Characteristics grownups all love to play and “monkey around”? Our Human Heritage: Courtship and Mating Evolution and Sexual Has evolution made men, but not women, Strategies naturally promiscuous? The Genetic Leash The Genetics of Difference The Meaning of Heritability Computing Heritability hink of all the ways in which human the actual race of life . the chief determining Our Human Diversity: The Tbeings are alike. Everywhere, no matter factor is heredity.” But in words that became Case of Intelligence what their backgrounds or where they live, famous, his contemporary, behaviourist John Genes and Individual people love, work, argue, dance, sing, com- B. Watson (1925), insisted that experience Differences plain, and gossip. They rear families, celebrate could write virtually any message on the tabula The Question of Group Differences marriages, and mourn losses. They reminisce rasa, the blank slate, of human nature: “Give The Environment and about the past and plan for the future. They me a dozen healthy infants, well-formed, and Intelligence help their friends and fight their enemies. my own specified world to bring them up in Beyond Nature versus They smile with amusement, frown with dis- and I’ll guarantee to take any one at random Nurture pleasure, and glare in anger.
    [Show full text]
  • A User's Guide Introduction What to Look for in a Psychological Test
    Psychological Testing: A User’s Guide Introduction This guide is about using psychological tests and the principles of good use. Previous test guides issued by The British Psychological Society (BPS) have tended to focus on technical issues underlying tests themselves. While these are essential to the effective use of psychological tests, they represent only one aspect of good practice in testing. The Steering Committee on Test Standards (SCIS) has therefore taken the opportunity of this revision to broaden the scope of the guidelines and consider other issues. Among these are: • Competence in test use and the recent introduction of standards for the use of tests in occupational assessment. • Responsible test use and a commitment to such use introduced later in this guide. This guide is organised in four sections: • What to look for in a psychological test. • What qualifies as competence in the use of psychological tests. • A commitment to responsible use of psychological tests. • Further information. What to look for in a psychological test Tests are designed for a purpose and the use of a particular test will vary according to the objectives of assessment. Some broad distinctions between different categories of tests can be made as follows: Tests of Attainment are used to assess knowledge and skills acquired through education and instruction. Examples include tests of mathematics knowledge, 10 foreign language proficiency or mastery in a craft. Such tests tend to be narrowly defined in content and targeted at the achievement of specific standards. Like ability tests, such tests are generally designed so that there is only one correct answer to each test question.
    [Show full text]
  • Introduction
    Mechanical Aptitude Tests Introduction Author: Paul Newton Version 2.4 Copyright www.mechanical-aptitude-tests.com 2007 1 Mechanical Aptitude Tests An Introduction to Psychometric Tests You are most likely to encounter psychometric testing as part of the recruitment or selection process. Tests of this sort are devised by occupational psychologists and their aim is to provide employers with a reliable method of selecting the most suitable job applicants or candidates for promotion. Psychometric tests aim to measure aspects of your personality or your mental ability, as illustrated in the diagram above. Personality questionnaires seek to measure aspects of your personality, whereas aptitude and ability tests aim to measure your intellectual and reasoning abilities. Source: “Psychometric, Personality and Aptitude Testing” Ramada Consulting (2005) The graph above shows the use of psychometric testing is slightly higher in America than in the UK and that these types of test are used extensively. Copyright www.mechanical-aptitude-tests.com 2007 2 Mechanical Aptitude Tests Psychometric tests can help prospective employers in number of ways. As an indicator of your personality, preferences and abilities they can find the best match of individual to occupation and working environment. As a recruitment and selection tool, these tests can be applied in a straightforward way at the early stages of selection to screen-out candidates who are likely to be unsuitable for the job. You are very likely to be asked to take a psychometric test if you work in any of the following: • IT Companies • Large Corporations • Armed Forces • Local Authorities • Civil Service • Emergency Services If you are applying for a job or seeking in promotion in one of these type of organisations then familiarity with these tests will give you a major advantage over candidates who are not familiar with them.
    [Show full text]
  • Mechanical Aptitude
    COUNTY OF LOS ANGELES Department of Human Resources Workforce Planning, Test Research, and Appeals Division 3333 Wilshire Blvd., Ste. 350, Los Angeles, CA 90010 24-Hour Jobline: (800) 970-LIST http://dhr.lacounty.info Introduction to Mechanical Aptitude BOARD OF SUPERVISORS Gloria Molina Mark Ridley-Thomas Zev Yaroslavsky Don Knabe Michael D. Antonovich First District Second District Third District Fourth District Fifth District Lisa M. Garrett, Director of Personnel To Enrich Lives Through Effective and Caring Service Table of Contents Foreword...........................................................................................................2 Purpose ...........................................................................................................2 Objectives........................................................................................................2 Who should use this guide? ................................................................................2 Disclaimer ........................................................................................................2 Introduction......................................................................................................3 What is mechanical aptitude?..............................................................................3 How is mechanical aptitude assessed?..................................................................4 Gravity ..............................................................................................................5
    [Show full text]
  • Aptitude Tests in the Legal Profession
    Aptitude Testing and the Legal Profession 6 June 2011 Dr. Chris Dewberry Birkbeck, University of London 1 Acknowledgement: I wish to thank Chris Hutton for his help in compiling information in the section of this report entitled Aptitude Tests Currently Used in the Professional Services Sector, Appendix 3, and Appendix 4. 2 Contents Executive Summary ................................................................................................................... 6 The Background to this Report ................................................................................................ 12 An Introduction to Aptitude and Aptitude Tests ..................................................................... 13 A Brief History of Psychological Ability Testing ....................................................................... 16 The Origins of Testing .......................................................................................................... 16 The Birth of the Modern Ability Test ................................................................................... 17 The Introduction of Group Testing ...................................................................................... 19 The New Science of Psychological Testing .......................................................................... 20 The Growth of the Ability and Aptitude Testing Industry ................................................... 20 Aptitudes and Ability in the 20th Century ...............................................................................
    [Show full text]
  • A Study of the Predictability of High School Grades and the Differential Aptitude Tests for Success in Vocational Programs in Health Careers
    DOCUMENT RESUME ED 068 697 VT 017 222 \ AUTHOR Anderson, Ruth TITLE A Study of the Predictability of High School Grades and the Differential Aptitude Tests for Success in Vocational Programs in Health Careers. PUB DATE Dec 71 NOTE 63p.; M.S. Thesis, Wisconsin University EDRS PRICE MF-$0.65 HC-$3.29 DESCRIPTORS Academic Achievement; *Grades (Scholastic); *Health Occupations Education; *Masters Theses; Post Secondary Education; *Predictive Ability (Testing); *Predictor Variables IDENTIFIERS DAT; Differential Aptitude Test ABSTRACT This study was undertaken to determine the validity of the Differential Aptitude Test (DAT) in general, the differential validity of each score of the DAT, and the effectiveness of high :school rank (HSR) as a measure of past performance for predicting success in vocational programs in health careers. Data obtained for a sample of 127 students representing five health occupation programs consisted of: (1) DAT scores,(2) HSR, (3) results of a comprehensive examination at the end of the first quarter of training,(4) final grade point average, (5) scores on a vocational achievement test (NLN), and (6) a certifying examination (DCE) for two programs in the sample. Pearson Product Moment correlations revealed that HSR showed a higher correlation with each of the criterion measures than any of the DAT scores. HSR was a better predictor of success in the Theory subtest of the DCE than of any of the skill-oriented subtests. With respect to the prediction measures and the vocational achievement test, the only independent correlations of some magnitude were between DAT scores and the NLN. (Author /SB) U.S. DEPARTMENT OF HEALTH, EDUCATION & WELFARE OFFICE OF EOUCATION THIS DOCUMENT HAS BEEN REPRO.
    [Show full text]
  • A Study of Intelligence Testing, Classification Testing, and Clerical Aptitude and Mechanical Aptitude Testing, in a Military Setting
    A STUDY OF INTELLIGENCE TESTING, CLASSIFICATION TESTING, AND CLERICAL APTITUDE AND MECHANICAL APTITUDE TESTING, IN A MILITARY SETTING b y WILLIAM F. HILL A thesis submitted in partial fulfilment of the requirements for the degree of MASTER OF ARTS in the Department of PHILOSOPHY and PSYCHOLOGY THE UNIVERSITY OF BRITISH COLUMBIA September 19^0 ABSTRACT A STUDY OF INTELLIGENCE TESTING, CLASSIFICATION TESTING, AND CLERICAL AND MECHANICAL APTITUDE TESTING, IN A MILITARY SETTING WILLIAM F. HILL The purpose of this study was to investigate certain psychometric procedures, and to ascertain their value in relat• ion to the problems of selection and prediction for clerical and mechanical trades in the service. The tests selected were the Otis S-A (which were also marked for twenty minute performance as well as the standard thirty), the Wonderlic Personnel R Test, the SRA Primary Mental Abilities Test, the Detroit Mechanical Aptitude Test and the Detroit Clerical Aptitude Test. Included in the study were the marks obtained on a service-administered Classification Test - the Navy 11G". The samples that were used were New Entry Trainees in the Canadian Navy who were about to take courses either as Writers (clerical trade) or Stokers (mechanical trade). The criterion used to evaluate the tests was the course marks obtained by the Abstr. ii Stokers and Writers on their final examination. The tests were analyzed individually for types of dis• tribution and amount of dispersion or variability. All the tests and subtests were correlated with the criterion to obtain validity coefficients. Similarly all the tests and subtests were correlated with the Otis, and intercorrelations were worked out for all the intelligence and classification tests.
    [Show full text]