Download the Software Required Prior to the Training Sessions

Total Page:16

File Type:pdf, Size:1020Kb

Download the Software Required Prior to the Training Sessions National Council on Measurement in Education Here and There and Back Again: Making Assessment a Stronger Force for Positive Impact on Teaching and Learning 2018 Training Sessions April 12-13 2018 Annual Meeting April 14-16 Westin New York at Times Square New York, NY #NCME18 Welcome from the Program Chairs Welcome to New York, welcome to New York! Welcome, friends and colleagues, to the 2018 NCME Annual Meeting. We are pleased to present you with this year’s NCME program. Our goal in putting together this slate of sessions has been balance: we have sought to represent research from different testing contexts, from a wide range of perspectives, from behind-the-scenes test development efforts across topics in our field to activities that advance the ways that tests and test results can be made accessible and useful to stakeholders. This year’s conference theme of “Here and There and Back Again: Making Assessment a Stronger Force for Positive Impact on Teaching and Learning” seeks to cultivate the interplay between testing (in all its forms) and the processes of instruction and learning. Carrying on with NCME’s expanding consideration of issues relating to classroom assessment, this year’s program features several invited sessions related to this important topic. On Saturday, April 14, at 10:35am, The Past, Present, and Future of Curriculum-Based Measurement will be discussed, reviewing 30+ years of research in the areas of reading, mathematics, content areas, and writing, and a discussion of future directions and challenges for CBM. On Sunday morning at 10:35am, speakers Joanna Gorin, Margaret Heritage, and James Pellegrino will take on The Positive Impact of Assessment, in a conversation about ways that assessment has been a positive impact on teaching and learning as well as ways that it could become a more positive influence in the future. Furthermore, on Monday at 10:35am, we will be joined by Diego Zapata-Rivera, Steven Ferrara, and Howard Wainer, for We Can Do This: Communicating Information from Educational Assessments. Also, as we look forward to the future of assessment, in this year’s conference we also take measure of where our field has been. 2018 marks the 25th anniversary of publication of Howard Wainer’s Measurement Problems article, and we have organized three conference sessions to promote reflection on the past and kick off research for the next 25 years. First, on Saturday, April 14, at 4:05pm we will be joined by several NCME Past Presidents (Mark Wilson, Michael Kolen, Suzanne Lane, and Laurie Wise) to ponder where we as a field stand with respect to the original 16 problems, and then on Sunday at 2:45pm and Monday at 12:25pm we will gather again for two forward-looking conversations on unsettled questions and new measurement challenges. The Sunday session panelists include Li Cai, Jimmy de la Torre, Chris Han, Karen Barton, and Alina von Davier, and Monday will feature Kathleen Scalise, Derek Briggs, Andrew Butler, Ellen Forte, and Sandip Sinharay. We’d also like to note that Brian Clauser has organized sessions to be held on Saturday afternoon focusing on the History of Measurement from 1950 to the Present, featuring Robert Brennan, Ronald Hambleton, Michael Kane and Brent Bridgeman, and Michael Bunch. For your information, this year’s program features 24 workshops, over 50 coordinated sessions, 7 Electronic Board sessions (2 of which are Graduate Student sessions), and over 50 individual paper sessions. Another conference highlight will certainly be the featured session for NCME’s Committee on Diversity in Testing, entitled Insight and Action: Diverse Perspectives on Critical Fairness Issues in Testing, scheduled for Saturday at 2:15pm. In addition, NCME’s 2018 Award Winners will present their award-winning research on Sunday at 4:35pm. If that isn’t enough, there’s yoga on Saturday morning, receptions nightly, the ever- popular NCME Breakfast and Presidential Address from NCME President Randy Bennett on Sunday morning, and the NCME Fitness Run/Walk first thing on Monday. We would like to take a brief moment to acknowledge the many NCME members who have volunteered over this past year: the vast corps of reviewers who provided us with critically helpful feedback on submitted proposals; our friends and colleagues who were available at all hours to support us with insight, perspectives, and suggestions; and the all of the expert researchers who gracefully accepted our request to serve as discussants for individual paper sessions (they’re back this year!). We are exceptionally grateful for your ready willingness to help us throughout this process. We’ve been waitin’ for you - Enjoy the conference! April Zenisky and Charlie DePascale 2018 NCME Annual Meeting Co-Chairs New York, NY, USA Table of Contents NCME Board of Directors . 4 Proposal Reviewers . 6 Future Meetings . 7 Westin at Times Square Floor Plans . 8 New York Hilton Midtown Floor Plans . 10 Training Sessions Thursday, April 12 . 12 Friday, April 13 . 23 Program Saturday, April 14 . 36 Sunday, April 15 . .97 Monday, April 16 . .130 Index . .187 Contact Information . .200 Schedule-at-a-Glance . .221 Here and There and Back Again: Making Assessment a Stronger Force for Positive Impact on Teaching and Learning 3 2018 Annual Meeting & Training Sessions NCME Officers President Randy Bennett Educational Testing Service President Elect Rebecca Zwick Educational Testing Service Past President Mark Wilson UC Berkeley, Berkeley NCME Directors Luz Bay Ye Tong The College Board Pearson Derek Briggs Walter Way University of Colorado The College Board Rose McCallin C Dale Whittington CO Dept. of Reg Agencies Shaker Heights (OH) Public Schools Editors Journal of Educational George Engelhard, Measurement Emory University Jonathan Templin University of Kansas Educational Measurement Dr . Howard Everson Issues and Practice SRI International ITEMS Editor André Rupp Educational Testing Service NCME Book Series Editor Dr . Brian Clauser National Board of Medical Examiners NCME Newsletter Editor Megan Welsh UC - Davis NCME Website Editor Matt Gaertner WestEd 4 New York, NY, USA 2018 Annual Meeting Chairs Annual Meeting Program Chairs April Zenisky University of Massachusetts Amherst Charlie DePascale National Center for the Improvement of Educational Assessment Graduate Student Issues Masha Bertling Committee Chair Harvard University Training and Development Amanda Wolkowitz Committee Chair Alpine Testing Solutions, Inc. Fitness Run/Walk Directors Katherine Furgol Castellano Educational Testing Service Jill R . van den Heuvel Alpine Testing Solutions Brain French Washington State University NCME Information Desk The NCME Information desk is located on the Second Floor Level in the Westin New York at Times Square . Stop by to pick up your badge, as well as your bib number and t-shirt for the fun run and walk . We will also have AERA tote bags and programs this year as well if you registered for both NCME & AERA! It will be open at the following times: Thursday, April 12 . 7:30 . AM – 4:30 PM Friday, April 13 . 7:30. AM . - 4:30 PM Saturday, April 14 . 8:00 . AM – 4:30 PM Sunday, April 15 . 10:00 . AM – 4:30 PM Monday, April 16 . 8:00 AM – 1:00 PM 5 2018 Annual Meeting & Training Sessions Proposal Reviewers Terry Ackerman Tia Fechter Krista Mattern Kathleen Sheehan Cigdem Alagoz Leah Feuerstahler Katie McClarty Mark Shermis Alicia Alonzo Sara Finney James McMillan David Shin Alison Ames Shameem Gaj Patrick Meyer Sandip Sinharay Alvaro Arce Brian Gong Michaelis Stephen Sireci Debbie Bandalos Chad Gotch Michaelides Whitney Smiley Bo Bashkov Andrea Gotzman Rochelle Michel Scott Strickman Kirk Becker Sean Gyll Dan Mix Dubravka Svetina Issac Bejar Ron Hambleton Scott Monroe Nathan Thompson Damian Betebenner Kristen Huff James Olsen Anna Topczewski Joseph Betts Anne Corinne Tianshu Pan Jill van den Heuvel Laine Bradshaw Huggins-Manley Thanos Patelis Peter van Rijn Chad Buckendahl Dan Jurich Marianne Perie Michael Walker Heather Buzick Priya Kannan John Poggio Shudong Wang Amy Clark Lisa Keller Sonya Powers Ting Wang Amanda Clauser Leslie Keng Anita Rawls Xi Wang Brian Clauser Leanne Ketterlin Mark Raymond Xiaolin Wang Kimberly Colvin Min Sung Kim Heather Rickels Craig Wells Jenna Copella Seock Ho Kim Michael Rodriguez Dale Whittington Juan D’Brot Young Kim Mary Roduta- Heru Widiatmo Nathan Dadey G .Gage Kingsbury Roberts Drew Wiley Mark Davidson Holis Lai Yigal Rosen Steven Wise Jennifer Davis Joni Lakin Louis Roussos Caroline Wylie Laurie Davis Erika Landl Jonathan Rubright Adam Wyse Susan Davis-Becker Quinn Lathrop Andre Rupp Duanli Yan Nina Deng Sue Lottridge Javarro Russell Hanwook Yoo John Donoghue Xiao Luo Leslie Rutkowski Liru Zhang Jennifer Dunn Christine Lyon Christina Schneider Ou Zhang Leslie Eastman Susan Lyons Matthew Schultz Yue Zhao Karla Egan Ross Markle Emily Shaw Cengiz Zopluoglu Howard Everson Joshua Marland Benjamin Shear 6 New York, NY, USA Graduate Student Abstract Reviewers Christiana Akande Robert Fay Huan Liu Deng Sien Abeer Alamri Angela Chinyere Ren Liu Miguel Sorrel David Alpizar Brittany Flanery Ye Ma Jordan Sparks Ezgi Ayturk Yanyan Fu Kaiwen Man Myrah Stockdale Ella Banda Chenlu Gao James Mason Meghan Sullivan Yu Bao Daria Gerasimova Stefan Merchant Victoria Tanaka Masha Bertling Stephanie Green Ma Mingjia Chen Tian Tanesia Beverly Ying Han Zhang Mingqin Lissette Tolentino Alex Brodersen Heather Handy Kyle Nickodem Stephanie Underhill Liuhan (Sophie) Cai Ma Hao Susan Niessen Thao Vo Tiago Calico Kristen Hochstedt Rich Nieto Jue Wang Luciana
Recommended publications
  • <<SCROLL to VIEW ALL POSTED OPPORTUNITIES>>
    <<SCROLL TO VIEW ALL POSTED OPPORTUNITIES>> EMPLOYMENT OPPORTUNITY WITH PROFESSIONAL TESTING, INC POSTING DATE: 7/29/19 Job Title Psychometrician FLSA Status (exempt, non-exempt) Exempt Position Status (full, part-time) Full Time Location (city, state) TBD- Offices in Orlando, FL and Denver, CO Company Name + Description Professional Testing is a Psychometric Consulting Firm that develops, administers, and maintains licensure and certification examination programs in a wide range of industries. Our full range of services also includes program audits, accreditation preparation, policy development, recertification requirements, implementation of effective organizational and governance structures, and ethics and disciplinary procedures. Our team provides expertise in best certification practices and program management. We have offices in Orlando, Florida and Denver, Colorado. Position Description Psychometricians at Professional Testing manage, or assist in the management of, a variety of credentialing programs within varying industries. Activities performed by psychometricians include facilitating job/task analyses, item development activities, assembling and equating exam forms, facilitating passing score studies, performing item analyses, working in item banks, publishing CBT forms and managing projects. Essential Job Functions • Facilitate workshops including job/task analyses, item development meetings, form review meetings, and passing score studies • Guide and manage Professional Testing’s test development team in item banking activities
    [Show full text]
  • A Comparison of Marginal Maximum Likelihood and Marko
    Parameter Recovery for the Four-Parameter Unidimensional Binary IRT Model: A Comparison of Marginal Maximum Likelihood and Markov Chain Monte Carlo Approaches A dissertation presented to the faculty of The Gladys W. and David H. Patton College of Education of Ohio University In partial fulfillment of the requirements for the degree Doctor of Philosophy Hoan Do April 2021 © 2021 Hoan Do. All Rights Reserved. 2 This dissertation titled Parameter Recovery for the Four-Parameter Unidimensional Binary IRT Model: A Comparison of Marginal Maximum Likelihood and Markov Chain Monte Carlo Approaches by HOAN DO has been approved for the Department of Educational Studies and The Gladys W. and David H. Patton College of Education by Gordon P. Brooks Professor of Educational Studies Renée A. Middleton Dean, The Gladys W. and David H. Patton College of Education 3 Abstract DO, HOAN, Ph.D., April 2021, Educational Research and Evaluation Parameter Recovery for the Four-Parameter Unidimensional Binary IRT Model: A Comparison of Marginal Maximum Likelihood and Markov Chain Monte Carlo Approaches Director of Dissertation: Gordon P. Brooks This study assesses the parameter recovery accuracy of MML and two MCMC methods, Gibbs and HMC, under the four-parameter unidimensional binary item response function. Data were simulated under the fully crossed design with three sample size levels (1,000, 2,500 and 5,000 respondents) and two types of latent trait distribution (normal and negatively skewed). Results indicated that in general, MML took a more substantive impact of latent trait skewness but also absorbed the momentum from sample size increase to improve its performance more strongly than MCMC.
    [Show full text]
  • JMETRIK: Classical Test Theory and Item Response Theory Data Analysis Software
    ISSN: 1309 – 6575 Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi Journal of Measurement and Evaluation in Education and Psychology 2019; 10(2);165-178 JMETRIK: Classical Test Theory and Item Response Theory Data Analysis Software Gökhan AKSU* Cem Oktay GÜZELLER** Mehmet Taha ESER*** Abstract The aim of this study is to introduce the jMetric program which is one of the open source programs that can be used in the context of Item Response Theory and Classical Test Theory. In this context, the interface of the program, importing data to the program, a sample analysis, installing the jmetrik and support for the program are discussed. In sample analysis, the answers given by a total of 500 students from state and private schools, to a 10-item math test were analyzed to see whether they shows differentiating item functioning according to the type of school they attend. As a result of the analysis, it was found that two items were showing medium-level Differential Item Functioning (DIF). As a result of the study, it was found that the jMetric program, which is capable of performing Item Response Theory (IRT) analysis for two-category and multi-category items, is open to innovations, especially because it is open-source, and that researchers can easily add the suggested codes to the program and thus the program can be improved. In addition, an advantage of the program is producing visual results related to the analysis through the item characteristic curves. Keywords: jMetrik, item response theory, classical test theory, differential item functioning. INTRODUCTION For researchers nowadays, technology has almost the same meaning as the software that they use every day.
    [Show full text]
  • Psychometrics Denny Borsboom and Dylan Molenaar, University of Amsterdam, Amsterdam, the Netherlands
    Psychometrics Denny Borsboom and Dylan Molenaar, University of Amsterdam, Amsterdam, The Netherlands Ó 2015 Elsevier Ltd. All rights reserved. This article is a revision of the previous edition article by J.O. Ramsay, volume 18, pp. 12416–12422, Ó 2001, Elsevier Ltd. Abstract Psychometrics is a scientific discipline concerned with the construction of measurement models for psychological data. In these models, a theoretical construct (e.g., intelligence) is systematically coordinated with observables (e.g., IQ scores). This is often done through latent variable models, which represent the construct of interest as a latent variable that acts as the common determinant of a set of test scores. Important psychometric questions include (1) how much information about the latent variable is contained in the data (measurement precision), (2) whether the test scores indeed measure the intended construct (validity), and (3) to what extent the test scores function in the same way in different groups (measurement invariance). Recent developments have focused on extending the basic latent variable model for more complex research designs and on implementing psychometric models in freely available software. Definition led to questions that inspired the birth of psychometric theory as we currently know it: how should we analyze Psychometrics is a scientific discipline concerned with the psychological test data? Which properties determine the question of how psychological constructs (e.g., intelligence, quality of a psychological test? How may we find out neuroticism, or depression) can be optimally related to observ- whether a test is suited for its purpose? ables (e.g., outcomes of psychological tests, genetic profiles, Two important properties of tests were almost immediately neuroscientific information).
    [Show full text]
  • Monte Carlo Simulation Studies in Item Response Theory with the R Programming Language
    ISSN: 1309 – 6575 Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi Journal of Measurement and Evaluation in Education and Psychology 2017; 8(3);266-287 Monte Carlo Simulation Studies in Item Response Theory with the R Programming Language R Programlama Dili ile Madde Tepki Kuramında Monte Carlo Simülasyon Çalışmaları Okan BULUT* Önder SÜNBÜL** Abstract Monte Carlo simulation studies play an important role in operational and academic research in educational measurement and psychometrics. Item response theory (IRT) is a psychometric area in which researchers and practitioners often use Monte Carlo simulations to address various research questions. Over the past decade, R has been one of the most widely used programming languages in Monte Carlo studies. R is a free, open-source programming language for statistical computing and data visualization. Many user-created packages in R allow researchers to conduct various IRT analyses (e.g., item parameter estimation, ability estimation, and differential item functioning) and expand these analyses to comprehensive simulation scenarios where the researchers can investigate their specific research questions. This study aims to introduce R and demonstrate the design and implementation of Monte Carlo simulation studies using the R programming language. Three IRT-related Monte Carlo simulation studies are presented. Each simulation study involved a Monte Carlo simulation function based on the R programming language. The design and execution of the R commands is explained in the context of each simulation study. Key Words: Psychometrics, measurement, IRT, simulation, R. Öz Eğitimde ölçme ve psikometri alanlarında yapılan akademik ve uygulamaya dönük araştırmalarda Monte Carlo simülasyon çalışmaları önemli bir rol oynamaktadır. Psikometrik çalışmalarda araştırmacıların Monte Carlo simülasyonlarına sıklıkla başvurduğu temel konulardan birisi Madde Tepki Kuramı’dır (MTK).
    [Show full text]
  • An Investigation Into the Test Equating Methods Used During 2006, and the Potential for Strengthening Their Validity and Reliability
    An investigation into the test equating methods used during 2006, and the potential for strengthening their validity and reliability Final report to the Qualifications and Curriculum Authority Dr. Iasonas Lamprianou University of Manchester and Cyprus Testing Service September 2007 An investigation into test equating methods Contents Contents .........................................................................................................................1 Executive summary........................................................................................................3 Introduction....................................................................................................................8 The background of the research.................................................................................8 The aim and objectives of the report..........................................................................8 Methodology..............................................................................................................8 The format of the report...........................................................................................11 Literature Review.........................................................................................................12 Test equating............................................................................................................12 Data collection designs for test equating .................................................................13 Definition of
    [Show full text]
  • An Exploration of Effects on Academically Vulnerable Students
    EdWorkingPaper No. 20-213 Does the Common Core Have a Common Effect?: An Exploration of Effects on Academically Vulnerable Students Joshua Bleiberg Vanderbilt University Policymakers have sought to increase the rigor of content standards since the 1990s. However, the literature examining the effects of reforms to content standards on student outcomes is still developing. This study examines the extent to which the Common Core State Content Standards (CC) affected student achievement and the size of achievement gaps. To identify the effect of CC I compare early implementors of the CC to late implementors of the CC in a Difference-in-Differences framework. I conducted a document analysis to measure preparation for and implementation of the CC standards, which I merge together with the National Assessment of Educational Progress student-level data. I then exploit variation in the timing of state implementation of the CC to identify its effect on students overall and academically vulnerable groups. I find that the CC has a positive effect on math scores in 4th and 8th grade, but not in reading. The CC had a large positive effect on economically advantaged students, but a null effect for economically disadvantaged students. Demanding better results without addressing the structural issues burdening economically disadvantaged students may result in unintended consequences. VERSION: March 2020 Suggested citation: Bleiberg, Joshua. (2020). Does the Common Core Have a Common Effect?: An Exploration of Effects on Academically Vulnerable Students. (EdWorkingPaper: 20-213). Retrieved from Annenberg Institute at Brown University: https://doi.org/10.26300/v0an-cz33 DOES THE COMMON CORE HAVE A COMMON EFFECT? 1 Title Page Does the Common Core Have a Common Effect?: An Exploration of Effects on Academically Vulnerable Students By Joshua Bleiberg Ph.D.
    [Show full text]
  • <<SCROLL to VIEW ALL POSTED OPPORTUNITIES>>
    <<SCROLL TO VIEW ALL POSTED OPPORTUNITIES>> EMPLOYMENT OPPORTUNITY WITH PROFESSIONAL TESTING, INC POSTING DATE: 7/29/19 Job Title Psychometrician FLSA Status (exempt, non-exempt) Exempt Position Status (full, part-time) Full Time Location (city, state) TBD- Offices in Orlando, FL and Denver, CO Company Name + Description Professional Testing is a Psychometric Consulting Firm that develops, administers, and maintains licensure and certification examination programs in a wide range of industries. Our full range of services also includes program audits, accreditation preparation, policy development, recertification requirements, implementation of effective organizational and governance structures, and ethics and disciplinary procedures. Our team provides expertise in best certification practices and program management. We have offices in Orlando, Florida and Denver, Colorado. Position Description Psychometricians at Professional Testing manage, or assist in the management of, a variety of credentialing programs within varying industries. Activities performed by psychometricians include facilitating job/task analyses, item development activities, assembling and equating exam forms, facilitating passing score studies, performing item analyses, working in item banks, publishing CBT forms and managing projects. Essential Job Functions • Facilitate workshops including job/task analyses, item development meetings, form review meetings, and passing score studies • Guide and manage Professional Testing’s test development team in item banking activities
    [Show full text]
  • Semi-Real-Time Analyses of Item Characteristics for Medical School Admission Tests
    Proceedings of the Federated Conference on DOI: 10.15439/2017F380 Computer Science and Information Systems pp. 189–194 ISSN 2300-5963 ACSIS, Vol. 11 Semi-real-time analyses of item characteristics for medical school admission tests Patrícia Martinková Lubomír Štepánekˇ Institute of Computer Science Institute of Biophysics and Informatics Czech Academy of Sciences First Faculty of Medicine, Charles University Pod Vodárenskou vežíˇ 2, Praha 8 Salmovská 1, Praha 2 [email protected] [email protected] Adéla Drabinová Jakub Houdek Institute of Computer Science Institute of Computer Science Czech Academy of Sciences Czech Academy of Sciences Pod Vodárenskou vežíˇ 2, Praha 8 Pod Vodárenskou vežíˇ 2, Praha 8 [email protected] [email protected] Martin Vejražka Cestmírˇ Štuka Institute of Medical Biochemistry and Laboratory Diagnostics Institute of Biophysics and Informatics First Faculty of Medicine, Charles University First Faculty of Medicine, Charles University U Nemocnice 2, Praha 2 Salmovská 1, Praha 2 [email protected] [email protected] Abstract—University admission exams belong to so-called high- schools publish validation studies of their exams [3], [4], stakes tests, i. e. tests with important consequences for the exam [5], [6], [7], others may perform psychometric analyses as taker. Given the importance of the admission process for the internal reports or the test and item analysis is missing. While applicant and the institution, routine evaluation of the admission tests and their items is desirable. monographs containing the methodology of test analysis have In this work, we introduce a quick and efficient methodology been published in Czech language [8], [9], [10], the use and on-line tool for semi-real-time evaluation of admission of robust psychometric measures in test development is still exams and their items based on classical test theory (CTT) limited.
    [Show full text]
  • Jmetrik Item Analysis [Software Application]
    RESEARCH & PRACTICE IN ASSESSMENT Measurement in 2010. jMetrik is a free and open source Software Review jMetrik item analysis [software application]. Patrick software application for classical and modern psychomet- Meyer. Retrieved from http://www.itemanalysis.com/ ric analyses. The program is a pure Java application that runs on Windows, Mac, OSX, and Linux platforms, with REVIEWED BY: requirements of 256 MB of available memory, and Java 6 Andrea Gotzmann, Ph.D. (i.e., JRE 1.6) or higher. The jMetrik graphical user inter- Medical Council of Canada face (GUI) combines a workspace tree, data view, point- and-click menu, and several dialog boxes. Although the Louise M. Bahry, M.Ed. software is currently available not all features are active, University of Massachusetts, Amherst or fully functional. Therefore, this review will address the features that currently are available, offering a snapshot of Technology, and the use of software to enhance or the current version of the software. assist with evaluating measurement statistics, is currently a large emphasis for users. Measurement statistics, used Current Available Analyses and in classical test theory (CTT) and item response theory Program Interface (IRT), have been elusive for some users, as the measure- The jMetrik software includes psychometric analy- ment concepts are complex and investment of time to ses such as CTT, IRT, Differential item functioning (DIF), understand is intensive (Lord, 1980; Lord & Novick, and Confirmatory Factor Analysis (CFA). All of these 1968). However, users across many content disciplines are analyses are useful in evaluating the psychometric qual- developing their understanding and applying these meth- ity of an assessment.
    [Show full text]
  • DETERS, LAUREN BF, Ph.D. Analysis of the Schizotypal
    DETERS, LAUREN B. F., Ph.D. Analysis of the Schizotypal Ambivalence Scale. (2017) Directed by Dr. John Willse, 108 pp. The purpose of this study was threefold: a) to provide a thorough modern measurement example in a field where it is more limited in use, b) to investigate the psychometric properties of the Schizotypal Ambivalence Scale (SAS) through IRT measurement models, and c) to use the evaluation of the psychometric properties of the SAS to identify evidence for adherence to the relevant guidelines outlined in the Standards for Educational and Psychological Testing (hereafter Standards; AERA, APA, & NCME, 2014). Together, these goals were to contribute to the argument that the SAS is a robust measure of the ambivalence construct. An archived sample of over 7,000 undergraduate students was used to conduct all analyses. Comparison of eigenvalue ratios indicated that the SAS data could be interpreted as essential unidimensional; however, results from the DIMTEST procedure (Stout, 2006) suggested a departure from unidimensionality. Results from the analysis provided adequate evidence for Standard 1.13 (AERA, APA, & NCME, 2014). The data were modeled via 1PL, 2PL, and 3PL models, and the 2PL model best fit the data. Examination of item-level statistics indicated that items 4, 8, 10, and 15 were endorsed more frequently than other items, and that items 2, 3, 9, 14, and 19 were the most discriminating. Items 7, 15, and 18 were flagged for possible misfit. Results from the analysis of local independence revealed that many item pairs, particularly items 10 through 16, may have violated the assumption of local independence.
    [Show full text]
  • <<SCROLL to VIEW ALL POSTED
    <<SCROLL TO VIEW ALL POSTED OPPORTUNITIES>> EMPLOYMENT OPPORTUNITY WITH THE NATIONAL COUNCIL OF STATE BOARDS OF NURSING POSTING DATE: 5/26/21 Job Title Psychometrician II, Examinations FLSA Status (exempt, non-exempt) Exempt Position Status (full, part-time) Full time Location (city, state) Chicago, IL Company Name + Description The National Council States Boards of Nursing (NCSBN) is a not-for-profit organization whose membership includes the nursing regulatory bodies in the 50 US states, the District of Columbia, four U.S. territories, 9 Canadian Provinces, and 27 international jurisdictions. Our mission empowers and supports nursing regulators in their mandate to protect the public. NCSBN promotes leadership, excellence and innovation in addressing local and global regulatory and healthcare challenges through strategic alliances and partnership with its members and other organizations, both public and private. NCSBN is engaged in a transformative process to better support its strategic direction and initiatives focusing on its mission to empower and support nursing regulators in their mandate to protect the public. The building blocks of achieving NCSBN’s vision of leading regulatory excellence are encapsulated in the following four focusing concepts: • Collaboration • Performance Measures and Metrics • Governance • Data and Technology These focusing concepts require NCSBN to gain and maintain individuals with key skills related to communication, change management, performance management, quality improvement, policy, board development, strategic partnering, data analytics, and economics. The National Council of State Boards of Nursing (NCSBN) is an equal employment opportunity employer. Decisions affecting employment are considered without regard to disability, race, color, religion, gender, national origin, age, genetic information, military or veteran status, sexual orientation, marital status or any other protected characteristic.
    [Show full text]