DOCSLIB.ORG

LORI MCLEOD, Phd Head, Psychometrics and Executive Director of Patient-Centered Outcomes Assessment

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
LORI MCLEOD, Phd Head, Psychometrics and Executive Director of Patient-Centered Outcomes Assessment LORI MCLEOD, PhD Head, Psychometrics and Executive Director of Patient-Centered Outcomes Assessment Education PhD, Quantitative Psychology, University of North Carolina, Chapel Hill, NC MA, Quantitative Psychology, University of North Carolina, Chapel Hill, NC BS, Statistics, Mathematics Education (graduated summa cum laude), North Carolina State University, Raleigh, NC Summary of Professional Experience Lori McLeod, PhD, is Head of Psychometrics and Executive Director of Patient-Centered Outcomes Assessment at RTI-HS. Dr. McLeod is a psychometrician with more than 20 years of measurement experience, including expertise in instrument development and validation, as well as experience developing appropriate health outcome strategies. In her Psychometrics role, she has conducted many psychometric evaluations of both paper-and-pencil and computer-administered instruments. These investigations have included the assessment of scale reliability, validity, responsiveness, and work to define responder thresholds. In addition, Dr. McLeod has experience conducting and analyzing data from clinical trials and observational studies, including data to document burden of disease and treatment benefit. Dr. McLeod has published numerous related manuscripts in Quality of Life Research, Value in Health, Pharmacoeconomics, Mayo Clinic Proceedings, and Psychometrika, and currently serves as a co-editor for Value in Health. She has experience in a wide variety of therapeutic areas, including chronic pain, dermatology, oncology, psychiatry, respiratory, sleep disorders, urology, gastroenterology, and sexual dysfunction. Dr. McLeod also serves as an adjunct faculty in the Department of Health Policy and Management at the University of North Carolina at Chapel Hill. Employment Chronology 2013 to present Adjunct Associate Professor University of North Carolina Department of Health Policy and Management Chapel Hill, NC 2007 to present Head, Psychometrics and RTI Health Solutions Executive Director of Patient- RTI International Centered Outcomes Assessment 2003 to 2006 Director, Psychometrics RTI Health Solutions RTI International 2001 to 2002 Senior Psychometrician RTI Health Solutions RTI International 2000 to 2001 Research Psychologist/ Statistics Research Division Statistician RTI International Research Triangle Park, NC 1998 to 2000 Research Scientist Law School Admission Council Newtown, PA 1995 to 1998 Harold Gulliksen Psychometric Educational Testing Service Fellow Princeton, NJ RTI-HS McLeod-1 1994 to 1995 Research Assistant University of North Carolina L.L. Thurstone Psychometric Laboratory Chapel Hill, NC 1991 to 1998 Research Assistant Testing and Accountability Section Department of Public Instruction Raleigh, NC 1992 to 1993 High School Mathematics Wake County Schools Teacher Raleigh, NC Honors Brenda H. Loyd Outstanding Dissertation Award, National Council on Measurement in Education, 1999 Harold Gulliksen Psychometric Fellowship, Educational Testing Service, September 1995 to May 1998 Statistics Student of the Year, North Carolina State University, 1992 Professional Associations International Society for Quality of Life Research, co-leader for Psychometrics Special Interest Group, 2011 to 2014 American Orthopaedic Society for Sports Medicine, member of the Outcome Measures Consensus Task Force, 2010 to date Psychometric Society, Office of Treasurer, 2000 to 2007 Drug Information Association International Society for Pharmacoeconomics and Outcomes Research Publications Elewski BE, Fox T, Gnanasakthy A, Mallya UG, McLeod L, Mollon P, et al. Psoriasis patients with Psoriasis Area and Severity Index (PASI) 90 response achieve greater health-related quality-of-life improvements than those with PASI 75-89 response: results from two phase 3 studies of secukinumab. J Dermatolog Treat. 2017 [in press] Mercieca-Bebber R, Rouette J, Calvert M, King M, McLeod L, Holch P, et al. Preliminary evidence on the uptake, use and benefits of the CONSORT-PRO extension. Qual Life Res. 2017 Feb 7. [Epub] Gottlieb A, Strober B, Lebwohl M, Kaufmann R, Pariser D, …, McLeod L, et al. Greater efficacy with secukinumab treatment is associated with greater psoriasis symptom relief: results from secukinumab clinical trial data. JPPA. 2017 [in press] Strober B, Gottlieb AB, Sherif B, Mollon P, Gilloteau I, McLeod L, et al. Secukinumab sustains early patient-reported outcome benefits through 1 year: Results from 2 phase III randomized placebo- controlled clinical trials comparing secukinumab with etanercept. J Am Acad Dermatol. 2017 Jan 10;pii:S0190-9622(16)31159-8. [Epub ahead of print] Strober B, Sigurgeirsson B, Popp G, Sinclair R, Krell J, …, McLeod LD, et al. Secukinumab improves patient-reported psoriasis symptoms of itching, pain, and scaling: results of two phase 3, randomized, placebo-controlled clinical trials. Int J Dermatol. 2016 Apr;55(4):401-7. RTI-HS McLeod-2 McLeod LD, Cappelleri JC, Hays RD. Best (but oft-forgotten) practices: expressing and interpreting associations and effect sizes in clinical outcome assessments. Am J Clin Nutr. 2016 Mar;103(3):685- 93. Strober B, Zhao Y, Tran MH, Gnanasakthy A, Nyirady J, …, McLeod LD, et al. Psychometric validation of the Psoriasis Symptom Diary using Phase III study data from patients with chronic plaque psoriasis. Int J Dermatol. 2016 Mar;55(3):e147-55. Williams V, McLeod L, Nelson L. Advances in the evaluation of longitudinal construct validity of clinical outcome assessments. Ther Innov Regul Sci. 2015 Nov;49(6):805-12. Petrillo J, Cano SJ, McLeod LD, Coon CD. Using classical test theory, item response theory, and Rasch measurement theory to evaluate patient-reported outcome measures: a comparison of worked examples. Value Health. 2015 Jan;18(1):25-34. Deal LS, Sleeper-Triplett J, DiBenedetti DB, Nelson L, McLeod L, Haydysch EE, et al. Development and validation of the ADHD Benefits of Coaching Scale (ABCS). J Atten Disord. 2015 Mar;19(3):191-9 Hartman EE, Pawaskar M, Williams VSL, McLeod L, Dubois D, Benninga MA, et al. Psychometric properties of the PedsQL generic core scales for children with functional constipation in the Netherlands. J Pediatr Gastroenterol Nutr. 2014 Dec;59(6):739-47. Mohr P, Harries M, Grange F, Ehness R, Benajmin L, Siakpere O, …, McLeod L, et al. Treatment patterns and disease burden of stage IIIB/IIIC melanoma in France, Germany and the UK. Ann Oncol. 2014 Oct;25(Suppl 4):iv389. Webb SM, Ware JE, Forsythe A, Yang M, Badia X, Nelson LM, …, McLeod L, et al. Treatment effectiveness of pasireotide on health-related quality of life in patients with Cushing’s disease. Eur J Endocrinol. 2014 Jul;171(1):89-98. McLeod L. Review of the Task Force Report on PRO data collection in clinical trials using mixed modes. Value Health. 2014 Jul;17(5):491-2. Chen WC, McLeod LD, Nelson LM, Williams VS, Fehnel SE. Quantitative challenges facing patient- centered outcomes research. Expert Rev Pharmacoecon Outcomes Res. 2014 Jun;14(3):379-86. Coles T, Coon C, DeMuro C, McLeod L, Gnanasakthy A. Psychometric evaluation of the Sheehan Disability Scale in adult patients with attention-deficit/hyperactivity disorder. Neuropsychiatr Dis Treat. 2014 May 19;10:887-95. Strober B, Zhao Y, Tran MH, Gnanasakthy A, Nelson LM, McLeod LD, et al. Psychometric evaluation of the psoriasis symptom diary using phase 3 trial data. Value Health. 2014 May;17(3):A288. Martin S, Coon C, McLeod L, Chandran A, Arnold L. Evaluation of the fibromyalgia diagnostic screen in clinical practice. J Eval Clin Pract. 2014 Apr;20(2):158-65. Fehnel S, DeMuro C, McLeod L, Coon C, Gnanasakthy A. US FDA patient-reported outcome guidance: great expectations and unintended consequences. Expert Rev Pharmacoecon Outcomes Res. 2013;13(4):441-6. Nelson LM, Forsythe A, McLeod L, Pulgar S, Maldonado M, Coles T, et al. Psychometric evaluation of the Cushing’s Quality-of-Life questionnaire. Patient. 2013;6(2):113-24. Coon CD, McLeod LD. Patient-reported outcomes: current perspectives and future directions. Clin Ther. 2013 Apr;35(4):399-401. Reeve BB, Wyrwich KW, Wu AW, Velikova G, Terwee CB, Snyder CF, …, McLeod LD, et al. ISOQOL recommends minimum standards for patient-reported outcome measures used in patient- centered outcomes and comparative effectiveness research. Qual Life Res. 2013 Oct;22(8):1889-905. RTI-HS McLeod-3 Chandran AB, Coon CD, Martin SA, McLeod LD, Coles TM, Arnold LM. Sphygmomanometry- evoked allodynia in chronic pain patients with and without fibromyalgia. Nurs Res. 2012;61(5):363-8. Coon CD, Bokowy KL, Horblyuk R, Zisman RS, McLeod LD, Brown TM. The development and initial assessment of the Strategy and Leadership Systems Capability Evaluation Survey. Health Care Manag (Frederick). 2012;31(4):332-41. Engelhart L, Nelson L, Lewis S, Mordin M, Demuro-Mercon C, Uddin S, McLeod L, et al. Validation of the Knee Injury and Osteoarthritis Outcome Score subscales for patients with articular cartilage lesions of the knee. Am J Sports Med. 2012;40(10):2264-72. Bell C, McLeod L, Nelson L, Fehnel S, Zografos L, Bowers B. Development and psychometric evaluation of a new patient-reported outcome instrument measuring the functional impact of insomnia. Qual Life Res. 2011;20(9):1457-68. Dalal A, Nelson L, Gilligan T, McLeod L, Lewis S, DeMuro-Mercon C. Evaluating patient-reported outcome measurement comparability between paper and alternate versions using the lung function questionnaire as an example. Value Health. 2011;14(5):712-20. McLeod LD, Coon CD, Martin SA, Fehnel SE, Hays RD. Interpreting patient-reported outcome results: US FDA guidance
Load more

Recommended publications
  • An Introduction to Psychometric Theory with Applications in R
    What is psychometrics? What is R? Where did it come from, why use it? Basic statistics and graphics TOD An introduction to Psychometric Theory with applications in R William Revelle Department of Psychology Northwestern University Evanston, Illinois USA February, 2013 1 / 71 What is psychometrics? What is R? Where did it come from, why use it? Basic statistics and graphics TOD Overview 1 Overview Psychometrics and R What is Psychometrics What is R 2 Part I: an introduction to R What is R A brief example Basic steps and graphics 3 Day 1: Theory of Data, Issues in Scaling 4 Day 2: More than you ever wanted to know about correlation 5 Day 3: Dimension reduction through factor analysis, principal components analyze and cluster analysis 6 Day 4: Classical Test Theory and Item Response Theory 7 Day 5: Structural Equation Modeling and applied scale construction 2 / 71 What is psychometrics? What is R? Where did it come from, why use it? Basic statistics and graphics TOD Outline of Day 1/part 1 1 What is psychometrics? Conceptual overview Theory: the organization of Observed and Latent variables A latent variable approach to measurement Data and scaling Structural Equation Models 2 What is R? Where did it come from, why use it? Installing R on your computer and adding packages Installing and using packages Implementations of R Basic R capabilities: Calculation, Statistical tables, Graphics Data sets 3 Basic statistics and graphics 4 steps: read, explore, test, graph Basic descriptive and inferential statistics 4 TOD 3 / 71 What is psychometrics? What is R? Where did it come from, why use it? Basic statistics and graphics TOD What is psychometrics? In physical science a first essential step in the direction of learning any subject is to find principles of numerical reckoning and methods for practicably measuring some quality connected with it.
    [Show full text]
  • Fatigue and Psychological Distress in the Working Population Psychometrics, Prevalence, and Correlates
    Journal of Psychosomatic Research 52 (2002) 445–452 Fatigue and psychological distress in the working population Psychometrics, prevalence, and correlates Ute Bu¨ltmanna,*, Ijmert Kanta, Stanislav V. Kaslb, Anna J.H.M. Beurskensa, Piet A. van den Brandta aDepartment of Epidemiology, Maastricht University, P.O. Box 616, 6200 MD Maastricht, The Netherlands bDepartment of Epidemiology and Public Health, Yale University School of Medicine, New Haven, CT, USA Received 11 October 2000 Abstract Objective: The purposes of this study were: (1) to explore the distinct pattern of associations was found for fatigue vs. relationship between fatigue and psychological distress in the psychological distress with respect to demographic factors. The working population; (2) to examine associations with demographic prevalence was 22% for fatigue and 23% for psychological and health factors; and (3) to determine the prevalence of fatigue distress. Of the employees reporting fatigue, 43% had fatigue only, and psychological distress. Methods: Data were taken from whereas 57% had fatigue and psychological distress. Conclusions: 12,095 employees. Fatigue was measured with the Checklist The results indicate that fatigue and psychological distress are Individual Strength, and the General Health Questionnaire (GHQ) common in the working population. Although closely associated, was used to measure psychological distress. Results: Fatigue was there is some evidence suggesting that fatigue and psychological fairly well associated with psychological distress. A separation
    [Show full text]
  • When Psychometrics Meets Epidemiology and the Studies V1.Pdf
    When psychometrics meets epidemiology, and the studies which result! Tom Booth [email protected] Lecturer in Quantitative Research Methods, Department of Psychology, University of Edinburgh Who am I? • MSc and PhD in Organisational Psychology – ESRC AQM Scholarship • Manchester Business School, University of Manchester • Topic: Personality psychometrics • Post-doctoral Researcher • Centre for Cognitive Ageing and Cognitive Epidemiology, Department of Psychology, University of Edinburgh. • Primary Research Topic: Cognitive ageing, brain imaging. • Lecturer Quantitative Research Methods • Department of Psychology, University of Edinburgh • Primary Research Topics: Individual differences and health; cognitive ability and brain imaging; Psychometric methods and assessment. Journey of a talk…. • Psychometrics: • Performance of likert-type response scales for personality data. • Murray, Booth & Molenaar (2015) • Epidemiology: • Allostatic load • Measurement: Booth, Starr & Deary (2013); (Unpublished) • Applications: Early life adversity (Unpublished) • Further applications Journey of a talk…. • Methodological interlude: • The issue of optimal time scales. • Individual differences and health: • Personality and Physical Health (review: Murray & Booth, 2015) • Personality, health behaviours and brain integrity (Booth, Mottus et al., 2014) • Looking forward Psychometrics My spiritual home… Middle response options Strongly Agree Agree Neither Agree nor Disagree Strong Disagree Disagree 1 2 3 4 5 Strongly Agree Agree Unsure Disagree Strong Disagree
    [Show full text]
  • Properties and Psychometrics of a Measure of Addiction Recovery Strengths
    bs_bs_banner REVIEW Drug and Alcohol Review (March 2013), 32, 187–194 DOI: 10.1111/j.1465-3362.2012.00489.x The Assessment of Recovery Capital: Properties and psychometrics of a measure of addiction recovery strengths TEODORA GROSHKOVA1, DAVID BEST2 & WILLIAM WHITE3 1National Addiction Centre, Institute of Psychiatry, King’s College London, London, UK, 2Turning Point Drug and Alcohol Centre, Monash University, Melbourne, Australia, and 3Chestnut Health Systems, Bloomington, Illinois, USA Abstract Introduction and Aims. Sociological work on social capital and its impact on health behaviours have been translated into the addiction field in the form of ‘recovery capital’ as the construct for assessing individual progress on a recovery journey.Yet there has been little attempt to quantify recovery capital.The aim of the project was to create a scale that assessed addiction recovery capital. Design and Methods. Initial focus group work identified and tested candidate items and domains followed by data collection from multiple sources to enable psychometric assessment of a scale measuring recovery capital. Results. The scale shows moderate test–retest reliability at 1 week and acceptable concurrent validity. Principal component analysis determined single factor structure. Discussion and Conclusions. The Assessment of Recovery Capital (ARC) is a brief and easy to administer measurement of recovery capital that has acceptable psychometric properties and may be a useful complement to deficit-based assessment and outcome monitoring instruments for substance dependent individuals in and out of treatment. [Groshkova T, Best D, White W. The Assessment of Recovery Capital: Properties and psychometrics of a measure of addiction recovery strengths. Drug Alcohol Rev 2013;32:187–194] Key words: addiction, recovery capital measure, assessment, psychometrics.
    [Show full text]
  • PSY610: PSYCHOMETRICS/STATISTICS FALL, 2006 Dr. Gregory T. Smith Teaching Assistant: 105 Kastle Hall Lauren Gudonis 257-6454 L
    PSY610: PSYCHOMETRICS/STATISTICS FALL, 2006 Dr. Gregory T. Smith Teaching Assistant: 105 Kastle Hall Lauren Gudonis 257-6454 [email protected] [email protected] office: 111 J Office Hours: Monday and Wednesday 11:00 - 11:45 and by appt. Required Texts: 1. Keppel, G. (2004). Design and Analysis: A Researcher’s Handbook. (4th Edition). Upper Saddle River, N.J.: Pearson/Prentice-Hall, Inc. Course Outline 8/24 1. Introduction. Independent and dependent variables. Correlational and experimental studies. Implications for interpretation of results. Example. Randomization and Random Sampling. 8/29 2. Levels of Measurement. Examples. Relation of levels of measurement to statistical tests. Chart. Three major questions to be answered by statistical analysis: existence, nature, and magnitude of relationships between X and Y (or Y1 and Y2). Introduction to probability. 8/31 3. Probability: an intuitive approach and a formal approach. Independence and conditional probabilities. Introduction to the logic of hypothesis testing. 9/5 4. The logic of hypothesis testing. Introduction to parametric (normal distribution) techniques. One sample goodness of fit test z. Sampling distribution of the mean. Central limit theorem. Standard error of the mean. Lab #1 Introduction to lab. Probability. Definitions, examples, and exercises. Introduction to computer system. Homework #1 assigned. 9/7 5. Logic of hypothesis testing, decision rule, terms, power, Type I and Type II errors. 9/12 6. Student's t test: sampling distribution, procedures, assumptions, degrees of freedom. Unbiased and biased estimates. Directional v. nondirectional tests, confidence intervals, t and z compared. Lab #2 Review material from preceding two lectures; homework; SPSS exercises. 9/14 7.
    [Show full text]
  • Factor Analysis 1 Factor Analysis
    Factor analysis 1 Factor analysis Factor analysis is a statistical method used to describe variability among observed, correlated variables in terms of a potentially lower number of unobserved variables called factors. In other words, it is possible, for example, that variations in three or four observed variables mainly reflect the variations in fewer such unobserved variables. Factor analysis searches for such joint variations in response to unobserved latent variables. The observed variables are modeled as linear combinations of the potential factors, plus "error" terms. The information gained about the interdependencies between observed variables can be used later to reduce the set of variables in a dataset. Computationally this technique is equivalent to low rank approximation of the matrix of observed variables. Factor analysis originated in psychometrics, and is used in behavioral sciences, social sciences, marketing, product management, operations research, and other applied sciences that deal with large quantities of data. Factor analysis is related to principal component analysis (PCA), but the two are not identical. Latent variable models, including factor analysis, use regression modelling techniques to test hypotheses producing error terms, while PCA is a descriptive statistical technique[1]. There has been significant controversy in the field over the equivalence or otherwise of the two techniques (see exploratory factor analysis versus principal components analysis). Statistical model Definition Suppose we have a set of observable random variables, with means . Suppose for some unknown constants and unobserved random variables , where and , where , we have Here, the are independently distributed error terms with zero mean and finite variance, which may not be the same for all .
    [Show full text]
  • (ETS) Inductive Reasoning Battery for a High Ability Population
    Guide to MITRE/Educational Testing Service (ETS) Inductive Reasoning Battery for a High This publication is based upon work Ability Population supported by the Office of the Director of National Intelligence (ODNI), Intelligence Advanced Research Projects Activity (IARPA) SHARP program, via contract 2015-14120200002-002, and is subject to the Rights in Data – General Clause 52.227-14, Alt. IV (DEC 2007). The views and conclusions contained herein are those of the authors and should not be interpreted as necessarily representing the official policies or endorsements, expressed or implied, of ODNI, IARPA or the U.S. Government or any of the authors’ host affiliations. The U.S. Government is authorized to reproduce and distribute reprints for governmental purposes notwithstanding any copyright 22 July 2016 annotations therein. ©2016 The MITRE Corporation. All rights reserved. Approved for Public Release; Distribution Unlimited. McLean, VA Case Number 16-2283 2 Table of Contents Disclaimer ....................................................................................................................................... 3 Abstract ........................................................................................................................................... 4 Overview of MITRE/ETS Fluid Reasoning Tests ............................................................................ 5 Test Development Approach ........................................................................................................... 6 Tests ...............................................................................................................................................
    [Show full text]
  • Artefact Corrections in Meta-Analysis
    Postprint Advances in Methods and Practices in Psychological Science XX–XX Obtaining Unbiased Results in © The Author(s) 2019 Not the version of record. Meta-Analysis: The Importance of The version of record is available at DOI: XXX www.psychologicalscience.org/AMPPS Correcting for Statistical Artefacts Brenton M. Wiernik1 and Jeffrey A. Dahlke2 1Department of Psychology, University of South Florida, Tampa, FL, USA 2Human Resources Research Organization, Alexandria, VA, USA Abstract Most published meta-analyses address only artefactual variance due to sampling error and ignore the role of other statistical and psychometric artefacts, such as measurement error (due to factors including unreliability of meas- urements, group misclassification, and variable treatment strength) and selection effects (including range restriction/enhancement and collider biases). These artefacts can have severe biasing effects on the results of individual studies and meta-analyses. Failing to account for these artefacts can lead to inaccurate conclusions about the mean effect size and between-studies effect-size heterogeneity, and can influence the results of meta-regression, publication bias, and sensitivity analyses. In this paper, we provide a brief introduction to the biasing effects of measurement error and selection effects and their relevance to a variety of research designs. We describe how to estimate the effects of these artefacts in different research designs and correct for their impacts in primary studies and meta-analyses. We consider meta-analyses
    [Show full text]
  • Critical Values for the Two Independent Samples Winsorized T Test
    Wayne State University Wayne State University Dissertations 1-1-2010 Critical Values For The woT Independent Samples Winsorized T Test Piper Alycee Farrell-Singleton Wayne State University, Follow this and additional works at: http://digitalcommons.wayne.edu/oa_dissertations Part of the Statistics and Probability Commons Recommended Citation Farrell-Singleton, Piper Alycee, "Critical Values For The wT o Independent Samples Winsorized T Test" (2010). Wayne State University Dissertations. Paper 86. This Open Access Dissertation is brought to you for free and open access by DigitalCommons@WayneState. It has been accepted for inclusion in Wayne State University Dissertations by an authorized administrator of DigitalCommons@WayneState. CRITICAL VALUES FOR THE TWO INDEPENDENT SAMPLES WINSORIZED T TEST by PIPER A. FARRELL-SINGLETON DISSERTATION Submitted to the Graduate School of Wayne State University, Detroit, Michigan in partial fulfillment of the requirements for the degree of DOCTOR OF PHILOSOPHY 2010 MAJOR: EDUCATION, EVALUATION AND RESEARCH Approved by: ___________________________________ Advisor Date ___________________________________ ___________________________________ ___________________________________ ©COPYRIGHT BY PIPER FARRELL-SINGLETON 2010 All Rights Reserved DEDICATION To my family, my friends and The Most High God. ii ACKNOWLEDGEMENTS I would like to first give honor to God, for without Him, this work would not have been possible. Second, I would like to thank my mother, the late Marie Farrell-Donaldson, whose courage and ability to face the unknown inspired me to pursue this work. To my grandmother, Lorine “Mother Love” Morgan, your love and encouragement are invaluable. To my precious daughter, Aris Singleton, who helped keep me focused; To my stepfather, Dr. Clinton L. Donaldson, thank you for inspiring me to use education as a key to unlock the door to my dreams; My father, Joseph Farrell, your wisdom, love and life lessons helped me to see this project through to the end.
    [Show full text]
  • RESEARCH SCIENTIST POSITIONS in Psychometrics, Data Science
    RESEARCH SCIENTIST POSITIONS in Psychometrics, Data Science, Artificial Intelligence, Statistics, Computational Statistics, Educational Measurement available at Educational Testing Service The Psychometrics, Statistics, and Data Sciences (PSDS) area of ETS's Research & Development (R&D) Division invites applications for six Research Scientist positions at all levels. Specifically, we seek scientists in the areas of psychometrics, data science, artificial intelligence, statistics, computational statistics, and educational measurement to embark on exciting research to tackle the educational measurement challenges of the digital age. In this era, four realities will dominate assessment: • Digitally based assessments • Large volumes of data collected through test takers' assessment actions • Large volumes of other data about individuals who are being assessed • The growing capabilities of artificial intelligence. In PSDS, we have launched a Measurement Frontiers Initiative to prepare ETS to thrive in the face of these realities, and we are looking for research scientists from multiple disciplines to lead this initiative alongside the national leaders in assessment, psychometrics and statistics who make up our current staff. The research in the Measurement Frontiers Initiative will focus on the following research areas: • Next generation psychometrics for assessment and learning • o Individualized learning and assessment o Modelling response processes and sequences of actions o Modelling educational big data o Advanced psychometric modeling
    [Show full text]
  • 18. INSTITUTION Yale Univ., New Haven, Conn
    DOCUMENT RESUME ID 189 171 TM BOO 348 AUTHOP Sternberg, Pobert J.: Gardner, MichaelK. Unities in Inductive Peasoning.Technical Peport No.. 18. INSTITUTION Yale Univ., New Haven, Conn. Dept.of Psychology. SPONS AG7NCY Office of. Naval Pesearch, Arlington,Va. Personnel and. Training Pesearch Programs Office. PUB CATv Oct 79 CONTRACT N0001478C002 VOTE 66p.: Portions of thispaper were presented at.the Annual Meeting of the Society for Mathematical Psychology (Providence, PI, August,1979). EDFS PRICE MF01/PC03 Plus Postage. DrSCRTPTOPS Classification: Cognitive Measurement:*Cognitive Processes: Correlation: Hlgher Fducation:*Induction: *Intelligence: Models: vesponse StyleATests) TDENTIFTT.S Analogy Test Items: Series Completion ABSTRACT Two experiments were performed to study inductive reasoning as a set of thoughtprocesses that operat(s on the structure, as opposed to the content, oforganized h.emory. The content of the reasoning consisted ofinductions concerning thenames cf mammals, assUmed tooccupy a ruclidean space of three dimensions (size, ferocity, and humanness) inorganized memory; Problems used in the experiments were analogies, series,and classifications. They were presented in unrestricted-time form bypaper and pencil for-choice.items and tachistosccpicallyas two choice items. Time required in the tachistoscopic formwas assumed to be an additive combinition nf five stages: selection ofcomponents of the problem, of strategy, of internal representationsfor the information, ofa speed-accuracy trade off, and the monitoringof solutions. Results partially confirmed the vector modelof memory space for names of mammals. Response latencies Confirffed theprediction that analogies regdired ore more processing step thandid series, which in turn required one more step thr, did classifications.The significance of these findira for the exclanatior cf aeneral intelligenceis .discussed.
    [Show full text]
  • Psychometrics: an Introduction Overview a Brief History
    Overview Psychometrics: • A brief history of psychometrics An introduction • The main types of tests • The 10 most common tests • Why psychometrics?: Clinical versus actuarial judgment Psychometrics: An intro Psychometrics: An intro A brief history Francis Galton • Testing for proficiency dates back to 2200 B.C., when the • Modern psychometrics dates to Sir Francis Galton (1822- Chinese emperor used grueling tests to assess fitness for 1911), Charles Darwin’s cousin office • Interested in (in fact, obsessed with) individual differences and their distribution • 1884-1890: Tested 17,000 individuals on height, weight, sizes of accessible body parts, + behavior: hand strength, visual acuity, RT etc • Demonstrated that objective tests could provide meaningful scores Psychometrics: An intro Psychometrics: An intro James Cattell Clark Wissler • James Cattell !(studied with Wundt & Galton) first used • Clark Wissler (Cattell’s student) did the first basic the term ‘mental test’in 1890 validational research, examining the relation between the old ‘mental test’ scores and academic achievement • His tests were in the ‘brass instruments’ • His results were largely discouraging tradition of Galton • He had only bright college students in his • mostly motor and acuity tests sample • Founded ‘Psychological Review’(1897) • Why is this a problem? • Wissler became an anthropologist with a strong environmentalist bias. Psychometrics: An intro Psychometrics: An intro 1 Alfred Binet The rise of psychometrics • Goodenough (1949): The Galtonian approach was like • Lewis Terman (1916) produced a major revision of “inferring the nature of genius from the the nature of Binet’s scale stupidity or the qualities of water from those • Robert Yerkes (1919) convinced the US government to of….hydrogen and oxygen”.
    [Show full text]