Princeton University 1968 Ph. D. Psychometrics

Total Page:16

File Type:pdf, Size:1020Kb

Princeton University 1968 Ph. D. Psychometrics

HOWARD WAINER

EDUCATION

Princeton University 1968 Ph. D. Psychometrics

Princeton University 1967 A. M. Psychometrics

Rensselaer Polytechnic 1965 B. S. Mathematics Institute

EXPERIENCE

2002- Professor (adjunct), Department of Statistics, The Wharton School, University of Pennsylvania, Philadelphia, Pennsylvania.

2001- Distinguished Research Scientist. National Board of Medical Examiners, Philadelphia, Pennsylvania.

2001-2004 Governing Board of the Association of Princeton Graduate Alumni.

1998-2004 Elected member, Princeton Board of Education (two terms).

1990-1994 Professor (adjunct), Department of Civil Engineering, Princeton University, Princeton, NJ

1989-1991 Professor (adjunct), Department of Psychology, Princeton University, Princeton, NJ

1987- 2001 Principal Research Scientist, Division of Statistical and Psychometric Research and Services, Educational Testing Service, Princeton, NJ

1981-1987 Senior Research Scientist, Division of Statistical and Psychometric Research and Services, Educational Testing Service, Princeton, NJ

1980-1981 Research Scientist, Educational Testing Service, Princeton, NJ

1977-1980 Senior Research Associate, Bureau of Social Science Research, Washington, DC

1970-1977 Assistant Professor in the Departments of Psychology, Behavioral Science and in The College, The University of Chicago, Chicago, IL

1968-1970 Assistant Professor of Psychology, Temple University, Philadelphia, PA

Summer 1968 Research Associate, Princeton University, Princeton, NJ

1965-1968 Educational Testing Service Psychometric Fellow, Educational Testing Service, Princeton, NJ

Page - 1 !//#

HONORS

The Samuel J. Messick Award for Distinguished Scientific Contributions Award from Division 5 of the American Psychological Association, 2009.

Who’s Who in America, 2009.

Fellow, American Educational Research Association, 2009

Career Achievement Award for Contributions to Educational Measurement. National Council on Measurement in Education, April 2007.

Award for Scientific Contribution to a Field of Educational Measurement for the development of Testlet Response Theory, National Council on Measurement in Education, April 2006.

Graphic Discovery: A Trout in the Milk and Other Visual Adventures (Princeton University Press) was named by Choice as the “Best Math book of 2005”.

Distinguished Visiting Lecturer University of Twente, Enschede, The Netherlands. October 1-4, 2001.

Distinguished Visiting Lecturer at the Hebrew University in Jerusalem, under the sponsorship of Israel's National Institute for Testing & Evaluation, February 1990

Senior Scientist Award, Educational Testing Service, 1990-1992

Fellow, American Statistical Association, 1985

PROJECTS DIRECTED

2004-2005 Director and Principal Investigator, William Playfair’s Atlas and Breviary (Kellogg Foundation).

2001 Director and Principal Investigator, Who submits SAT scores when they are not required? (College Entrance Examination Board).

1999-2001 Director and Principal Investigator, Assessing the efficacy of AP exams: Developing adjustment methodology (Advanced Placement Research Committee, College Entrance Examination Board)

1998-2001 Director and Principal Investigator, Testlet Response Theory (Graduate Record Exam Research Committee, Joint Staff Research & Development Committee)

1998-1999 Director and Principal Investigator, Testlet Response Theory (TOEFL Research Committee)

1997-1998 Director and Principal Investigator, Pennsylvania's Performance on NAEP (Pennsylvania State Education Association).

1996-1998 Director and Principal Investigator, Revising display methods for NAEP (National Center for Education Statistics).

Page - 2 !//#

1994-1996 Director and Principal Investigator, Measuring the statistical characteristics of the TOEFL while incorporating its inherent cluster structure: I. Reliability (TOEFL Policy Council).

1994-1995 Director and Principal Investigator, A study of display methods for NAEP results (National Center for Education Statistics).

1993-1994 Director and Principal Investigator, On the Performance of New Jersey Public Schools (New Jersey Education Association).

1992-1993 Director and Principal Investigator, Measuring statistical characteristics of the LSAT while incorporating its inherent cluster structure: Reliability and DIF (Law School Admissions Council)

1992-1993 Director and Principal Investigator, How well can we equate test forms that are constructed by examinees? (Graduate Record Exam Research Committee)

1988-1989 Director and Principal Investigator, Differential Item Functioning (Air Force Human Resources Laboratory Contract)

1986-1987 Director and Co-Principal Investigator, Test Validity for the 1990's and Beyond (Air Force Human Resources Laboratory Contract)

1985-1986 Director and Principal Investigator, Drawing Inferences from Self-Selected Samples (National Science Foundation Grant)

1984-1988 Director and Principal Investigator, Development of a Computerized Adaptive Test version of the ASVAB (Navy Personnel Research and Development Center Contract)

1982-1984 Director and Principal Investigator, Robust Estimation for Item Response Theory (Air Force Human Resources Laboratory Contract)

1980-1981 Director and Principal Investigator, Robust Estimation of Victim Vulnerability (National Institute of Justice Grant)

1979-1980 Director and Principal Investigator, Dynamic Data Display (National Science Foundation Grant)

1978-1979 Director and Principal Investigator, Robust Estimation in Latent Trait Analysis, Department of Justice (Law Enforcement Assistance Administration Grant)

1976-1978 Director and Co-Principal Investigator, The Graphics Social Reporting Project (National Science Foundation Grant)

OTHER PROJECT EXPERIENCE

2009 Expert Witness, McCleary, Venema, and Network for Excellence in Washington Schools vs. State, King County Superior Court, Seattle, WA.

Page - 3 !//#

2008 Expert Witness, Pennsylvania State Education Association vs. Downingtown School Board, Downingtown, PA.

2007 Consultant, on general issues of data display and exploratory data analysis for SIG Corporation, Bala Cynwd, Pennsylvania

2007 Consultant, on general issues in testing and evaluation for New York State United Teachers, Albany, NY

2007 Member, NCES Task Force on CAT for Longitudinal Study. Washington, D.C.

2007 - Consultant, on general issues in testing and evaluation for Pennsylvania State Education Association, Harrisburg, PA.

2006 Consultant on Survey and Analysis Methodology. The Philadelphia Eagle’s Eye Mobile Project. Philadelphia, PA

2006 Expert Witness, Russo vs. NCS Pearson and the College Entrance Examination Board.

2005 Expert Witness, Springfield Board of Education vs. Springfield Education Association.

2005 Member, Task Force on Benchmarking. NCATE. Washington DC

2004 – Member, Advisory Board of Operation Public Education. Philadelphia, PA.

2004 Consultant, on general issues in testing and evaluation for New Jersey Education Association, Trenton, NJ.

2000-2003 Member, Assessment Advisory Committee for the South African Department of Education, Pretoria, South Africa.

2000-2004 Consultant, Statistical methodology in the revision of the Addiction Severity Index. Department of Psychiatry, University of Pennsylvania, Philadelphia, PA.

1996 –1999 Consultant, IRT for medical indicators. The Health Institute of the New England Medical Center, Boston, MA.

1996 Consultant, Predicting sales calls for pest and termite extermination from location, date and weather. J. Walter Thompson, Atlanta, GA.

1993 Consultant, Linking English and Spanish forms of the GED, American Council on Education, Washington, D. C.

1989 Consultant, Adaptive Strategies for Survey Questionnaires, Bell Communications Research, San Francisco, CA

1987 Consultant, U. S. Department of Energy, Graphic Display of Energy Data, Washington, D. C.

Page - 4 !//#

1985-1987 Consultant, the Cost of Capital Punishment, National Center for State Courts, Williamsburg, VA

1985-1986 Consultant, Effective Analysis and Display of Statistical Information, NBC, New York, NY.

1981 Consultant, Project on Standard Errors in Logistic Response Models, McFann-Gray and Associates, San Antonio, TX

1980 Consultant, Project on Evaluation of Drug Abuse Programs, Institute for Survey Research, Philadelphia

1979-1980 Consultant, National State Courts Project, Law Enforcement Assistance Administration, Washington, DC

1979 Consultant, Analysis of the National Survey of Children, Child Trends, Washington, DC

1977-1978 Consultant, Assessment of Uniform Parole Data Program, Law Enforcement Assistance Administration, Washington, DC

1976-1980 Consultant, Problems in the Intercultural Study of Attitudes, University of Texas, El Paso

1976 Consultant, Problems in the Analysis of Criminological Data, Social Science Research Council, Washington, DC

Consultant, Problems of Assessing the Efficacy of Visual Displays, Bureau of the Census, Washington, DC

1975-1986 Consultant, Assessment of Literacy, Touchstone Applied Science Associates, New York

1973-1975 Consultant, Methodology for the Development of a Measure for Effectiveness of Reading, The Riverside Research Institute, New York

1973 Consultant, data analysis, The Field Museum, Chicago, IL

1972-1980 Consultant, Prediction of Stature, The Fels Research Institute, Yellow Springs, OH

1970-1972 Consultant, Methodological Development of Prediction Models, The University City Science Center, Philadelphia, PA

1970 Consultant, scaling and experimental design, National Analysts, Incorporated, Philadelphia, PA

1969 Consultant, scaling, experimental design and data analysis, Arthur D. Little, Incorporated, Boston, MA.

PROFESSIONAL AFFILIATIONS

2007-2008 Member, Committee to revise the APA publication manual.

Page - 5 !//#

2003-2004 COPSS Committee on John W. Tukey Award, Chairman

2002-2004 Journal of Educational and Behavioral Statistics, Editor

2001-2003 Psychological Science, Member of the Editorial Board.

1997-1999 Member, Task Force on Statistical Inference. American Psychological Association.

1996-1998 Psychological Methods, Member of the Editorial Board.

1994 -2001 Journal of Educational and Behavioral Statistics, The Teacher's Corner Editor

1989-1992 The Psychometric Society, Trustee

1987- 1994 Journal of Educational Statistics, Associate Editor

1981-1983 Management Committee of the Journal of Educational Statistics (Vice Chairman)

1977-1980 Ad Hoc Committee on Statistical Graphics, the American Statistical Association

1977-1997 Applied Psychological Measurement, Associate Editor

1977-1983 Journal of the American Statistical Association, Associate Editor

1973-1981 The Psychometric Society, Treasurer, Trustee

Page - 6 !//#

BOOKS

Picturing the Uncertain World: How to Understand, Communicate and Control Uncertainty through Graphical Display . Princeton, NJ: Princeton University Press, 2009.

Testlet Response Theory and its Applications (with E. Bradlow & X. Wang). New York: Cambridge University Press, 2007.

The Commercial and Political Atlas, Representing, by means of Stained Copper-Plate Charts, The Progress of the Commerce, Revenues, Expenditure, and Debts of England, during the whole of the Eighteenth Century, by William Playfair. Edited and introduced by Howard Wainer and Ian Spence. New York: Cambridge University Press, 2005.

The Statistical Breviary; Shewing on a Principle entirely new, the resources of every state and kingdom in Europe; illustrated with Stained Copper-Plate Charts, representing the physical powers of each distinct nation with ease and perspicuity by William Playfair. Edited and introduced by Howard Wainer and Ian Spence. New York: Cambridge University Press, 2005.

Graphic Discovery: A Trout in the Milk and Other Visual Adventures. Princeton, N.J.: Princeton University Press, 2005. (Named by Choice “Best Math book of 2005”).

Test Scoring. (with D. Thissen) . Hillsdale, NJ: Lawrence Erlbaum Associates, 2001.

Visual Revelations: Graphical Tales of Fate and Deception from Napoleon Bonaparte to Ross Perot. (2nd edition) Hillsdale, N. J.: Lawrence Erlbaum Associates, 2000.

Computerized Adaptive Testing: A Primer, 2nd edition (with N. Dorans, D. Eignor, R. Flaugher, B. Green, R. Mislevy, L. Steinberg & D. Thissen) Hillsdale, N. J. : Lawrence Erlbaum Associates, 2000.

Drawing inferences from self-selected samples (2nd printing). Hillsdale, N. J. : Lawrence Erlbaum Associates, 2000.

Visual Revelations: Graphical Tales of Fate and Deception from Napoleon Bonaparte to Ross Perot. New York: Copernicus Books, 1997.

Differential Item Functioning (with P. W. Holland). Hillsdale, NJ: Lawrence Erlbaum Associates, 1993.

Computerized Adaptive Testing: A Primer (with N. Dorans, R. Flaugher, B. Green, R. Mislevy, L. Steinberg & D. Thissen) Hillsdale, N. J. : Lawrence Erlbaum Associates, 1990.

Test Validity (with H. Braun) Hillsdale, N. J. : Lawrence Erlbaum Associates, 1988.

Drawing inferences from self-selected samples. New York: Springer-Verlag, 1986.

Principals of modern psychological measurement. (with S. Messick) Hillsdale, N.J. : Lawrence Erlbaum Associates, 1983.

Semiology of Graphics by Jacques Bertin (translated by William Berg; Howard Wainer, Technical Editor) Madison, Wisconsin: University of Wisconsin Press, 1983.

Page - 7 !//#

Graphics and Graphic Information Processing by Jacques Bertin (Translated by William Berg; Howard Wainer, Technical Editor) Elmsford, N. Y. : Walter de Gruyter, 1981.

Predicting adult stature for individuals. (with A. F. Roche & D. Thissen) Basel: Karger, 1975.

Skeletal maturity: The knee joint as a biological indicator. (with A. F. Roche & D. Thissen) New York: Plenum, 1975.

ARTICLES AND CHAPTERS

2009

What happens if the SAT is made optional? Bowdoin College as an example. The American Scientist, 97, xxx-xxx, 2009.

An Eye-Witness to the Principles and Principals of 20th Century Statistics -- A Review of Erich L. Lehmann’s Reminiscences of a Statistician: The Company I Kept. Journal of Educational Measurement, 46(2), xx-xx, 2009.

A centenary celebration for Will Burtin: A pioneer of scientific visualization. Chance, 22(1), 51-55, 2009.

2008

Why is a raven like a writing desk? Musing on the power of convention. The American Scientist,96, 446-449, 2008.

Looking at blood sugar (with P. Velleman). Chance, 21(4), 56-61, 2008.

Giving the finger to dating services (with G. Lee & P. Velleman). Chance, 21(3), 59-61, 2008.

Computerized Adaptive Testing. In Corsisi’s Encyclopedia of Psychology, 4th edition (P. Rossi ed.), John Wiley & Son: New York., 2008, pages xxx-xxx.

14 conversations about 3 things. Journal of Educational and Behavioral Statistics, 33, xxx-xxx, 2008.

Improving graphic displays by controlling creativity (with discussion). Chance, 21(2), 46-53, 2008.

Until Proven Guilty: False Positives and the War on Terror .(With S. Savage), Chance, 21(1), 55-58, 2008.

Introduction to Linda S. Gottfredson. Journal of Educational and Behavioral Statistics, 33, xxx-xxx, 2008.

A Profile of Linda S. Gottfredson. (w/ D. Robinson). Journal of Educational and Behavioral Statistics, 33, xxx-xxx, 2008.

A Bayesian method for studying DIF: A cautionary tale filled with surprises and delights (with E. Bradlow, X. Wang, & E. Muller). Journal of Educational and Behavioral Statistics, 33, 363-384, 2008.

Page - 8 !//#

2007

Science and the SAT. Princeton Alumni Weekly, 4-5. November 7, 2007.

L’Equazione piu Pericolosa, Le Science, 470, 80-87. October, 2007.

A Psychometric Cicada: Educational Measurement returns. Educational Researcher, 36(8), 485-486, 2007.

A Profile of Susan E. Embretson. (w/ D. Robinson). Journal of Educational and Behavioral Statistics, 32, 431-439, 2007.

Taking a Chance: An interview with William F. Eddy and Stephen E. Fienberg. Chance, 20(4), 33-39, 2007.

A Catch-22 in assigning primary delegates (With A. Gelman), Chance, 20(4), 6-7, 2007

Improving data displays: ours and the media’s, Chance, 20(3), 8-16, 2007

The most dangerous equation. American Scientist, 95(3), 249-256, 2007.

Galton’s normal is too platykurtic. Chance, 20(2), 57-58, 2007

Insignificant is not zero: Rescoring the SAT as an example. Chance, 20(1), 55-58, 2007.

Value-Added Assessment (with Henry Braun). In Handbook of Statistics (Volume 27) Psychometrics (Eds C. R. Rao and S. Sinharay). Elsevier Science, Amsterdam. 2007, pages 867-892.

Three statistical paradoxes in the interpretation of group differences: Illustrated with medical school admission and licensing data (with Lisa Brown). Chapter 26 in the Handbook of Statistics (Volume 27) Psychometrics (Eds C. R. Rao and S. Sinharay). Elsevier Science, Amsterdam. 2007, pages 893-918.

A Profile of Roderick McDonald. (w. D. Robinson). Journal of Educational and Behavioral Statistics, 32, 315-332, 2007.

A Profile of Fumiko Samejima. (w. D. Robinson). Journal of Educational and Behavioral Statistics, 32, 206-222, 2007.

2006

Chance Conversation with Judith Tanur. Chance, 19(4), 52-57.

A modern classic expands and improves: A review of the 2nd edition of Leland Wilkinson’s The Grammar of Graphics, Psychometrika, 71, 603, 2006.

Logical and empirical evidence that smaller schools do not improve student achievement (with Harris Zwerling). The Phi Delta Kappan, 87, 300-303, 2006.

Page - 9 !//#

Finding what is not there through the unfortunate binning of results: The Mendel effect (with M. Gessaroli & M. Verdi) , Chance, 19(1), 49-52, 2006.

How’s your wife? A review of Defending standardized testing by Richard Phelps. Journal of Educational Measurement, 43(1), 77-84, 2006.

Using graphs to make the complex simple: The Medicare drug plan as an example, Chance, 19(2), 55- 56, 2006.

On model-based inferences: A fitting tribute to a giant. Chapter 4 in D. Hantula (ed.) Methodological & Theoretical Advances in Social & Organizational Psychology, Hillsdale, NJ: Lawrence Erlbaum Associates, 2006, pps. 61-73.

An application of Testlet Response Theory in the scoring of a complex certification exam (with L. M. Brown , E. T. Bradlow, X. Wang, W, P. Skorupski, & J. Boulet). In D. M. Williamson, R. J. Mislevy, & I. I. Bejar (eds.) Automated Scoring of Complex Tasks in Computer Based Testing. Hillsdale, NJ: Lawrence Erlbaum Associates, 2006, Chapter 6, pps. 169-200.

Statistical Graphics: A guidepost for scientific discovery. (with Paul F. Velleman). In Complementary methods for research in education (3rd edition). (edited by Green, J. L., Camilli, G., & Elmore, P.B.) Washington, D.C.: American Educational Research Association, 2006, pps. 605-621..

2005

Chance Conversation with Martha Farnsworth Riche. Chance, 18(4), 48-51.

William Playfair and his graphical inventions (with I. Spence). The American Statistician, 59(3), 224-229, 2005.

Old Mother Hubbard and the United Nations: An adventure in exploratory data analysis.. (with discussion) (with D. Vasilescu). Chance,18(3), 38-45, 2005.

Truth is slower than fiction: Francis Galton as an illustration (with B. Clauser). Chance,18(4), 52-54, 2005.

Shopping for colleges when what we know ain’t. Journal of Consumer Research, 32(3), 337-342, 2005.

Non Random Sampling. In B. Everitt & D. Howell (eds.). Encyclopedia of Statistics in Behavioral Sciences (Volume 3). London: Wiley, 2005, pps. 1430-1433.

Graphical presentation of longitudinal data (with I. Spence). In B. S. Everitt & D. C. Howell (eds.). Encyclopedia of Statistics in Behavioral Sciences. Volume 2, Chichester: Wiley, 2005, pps. 762-772.

A Bayesian method for evaluating passing scores: The PPoP curve (with Xiaohui Wang, William P. Skorupski, and Eric Bradlow). Journal of Educational Measurement, 42(3), 271-281, 2005.

Was it ethnic and social-class bias or was it statistical artifact? Logical and empirical evidence against Freedle's method for reestimating SAT scores (with W. P. Skorupski), Chance, 18(2), 17-24, 2005..

Page - 10 !//#

Stumbling on the path toward the visual communication of complexity. Chance,18(2), 53-54, 2005.

Item and Test Bias. (with Stephen Sireci). Encyclopedia of Social Measurement (volume 2) (K. Kempf-Leonard, editor) . San Diego, CA: Elsevier Academic Press. 365-371, 2005.

William Playfair and the Invention of Statistical Graphs. (with Ian Spence). Encyclopedia of Social Measurement(volume 3) (K. Kempf-Leonard, editor) . San Diego, CA: Elsevier Academic Press. 71-80, 2005.

Resizing triathalons for fairness (with R. de Veaux) pages 317-321 in Anthology of Statistics in Sports. J. H. Albert, J. Bennett, & J. J. Cochran (Eds.) Philadelphia, PA: Society for Industrial and Applied Mathematics, 2005.

2004

An Editor’s Gratitude: Reviewer Acknowledgement. Journal of Educational and Behavioral Statistics, 29(4), 489-490, 2004.

User’s Guide for SCORIGHT (Version 3.0): A computer program for scoring tests built of testlets including a module for covariate analysis (with Xiaohui Wang & Eric Bradlow). ETS Technical Report RR-04-49. Princeton, NJ: Educational Testing Service.

On Assessing the Quality of Physician’s Clinical Judgment: The Search for Dependent Variables (with Janet Mee), Evaluation & the Health Professions, 27(4), 369-382, 2004.

Two statistical paradoxes in the interpretation of group differences: Illustrated with medical school admission and licensing data (with L. Brown). The American Statistician, 58, 117-123, 2004

Value Added Assessment: An introduction and history, Journal of Educational and Behavioral Statistics, 29(1), 1-4, 2004.

When form violates function. Chance,17(3), 49-52, 2004.

Curbstoning IQ and the 2000 presidential election. Chance,17(4), 43-46, 2004.

Nobody’s perfect. (with Michael Friendly). Chance,17(2), 48-51, 2004.

Numbers and the remembrance of things past. (with Henry Braun), Chance,17(1), 44-48, 2004.

How much does extra time on the SAT help? (with B. Bridgeman, M. Najarian and C. Trapani). Chance, 17(2), 19-24, 2004.

The promises and pitfalls of making national educational assessments adaptive: America’s assessment as an example. Metodología de las Ciencias del Comportamiento (Methodology of Behavioural Sciences), 5(2), 211-224, 2004.

2003

John Wilder Tukey: Statistical inventor, discoverer and revolutionary. Statistical Science, 18(3), 285-286, 2003.

Page - 11 !//#

Editor’s Forward to: “Comparing harm done by mobility and class absence: missing students and missing data,” by Michelle Dunn, Joseph Kadane and John Garrow, Journal of Educational and Behavioral Statistics, 28(3), 267-268, 2003.

One cheer for null hypothesis significance testing. In Methodological Issues & Strategies in Clinical Research (3rd Edition). A. E. Kazdin (ed.). Washington, DC: American Psychological Association, 461-464, 2003.

Shaping Up the Practice of Null Hypothesis Significance Testing. (with D. H. Robinson). Educational Researcher,32(7), 22-30, 2003.

A political statistic. (with Daniel Koretz) Chance,16(4), 45-47, 2003.

La diffusion de quelques idées: A master’s voice. Chance,16(3), 58-61, 2003.

How long is short? Chance,16(2), 55-57, 2003.

A graphical legacy of Charles Joseph Minard: Two jewels from the past. Chance,16(1), 56-60, 2003.

2002

A Small Hurrah for the Black Death (with S. Zabell). Chance,15(4), 58-60, 2002.

The BK-Plot: Making Simpson’s Paradox clear to the masses. Chance,15(3), 60-62, 2002.

On the Past and Future of Null Hypothesis Significance Testing (with D. H. Robinson). Journal of Wildlife Management, 66, 263-271, 2002.

“Reporting Test Results in Education.” In the Encyclopedia of Psychological Assessment, R. Fernandez-Ballesteros (ed). New York: Sage, 2002.

....and still champion: A review of the Second Edition of Edward Tufte’s The Visual Display of Quantitative Information. Psychometrika, 67, 173-178, 2002.

A general Bayesian model for testlets: Theory and applications (with X. Wang & E. Bradlow). Applied Psychological Measurement, 26(1), 109-128, 2002.

Clear thinking made visible: Redesigning score reports for students. Chance,15(1), 56-58, 2002.

Reporting Test Results to Institutions and Nations. Chance, 15(2), 58-61, 2002.

On the automatic generation of test items: Some whens, whys and hows. In Item Generation for Test Development (S. Irvine & P. Kyllonen, Eds.). Hillsdale, N.J. : Lawrence Erlbaum Associates, pages 287-305, 2002.

Remembering Sam Messick. In Item Generation for Test Development (S. Irvine & P. Kyllonen, Eds.). Hillsdale, N.J. : Lawrence Erlbaum Associates, page xxxi, 2002.

2001

Winds across Europe: Francis Galton and the graphic discovery of weather patterns Chance,14(4), 44-47, 2001.

Page - 12 !//#

Review of Presenting your findings: A practical guide for creating tables by Adelheid A. M. Nichol & Penny M. Pexman, Teachers College Review, 103, 93-98, 2001.

Statistical Graphics: Mapping the Pathways of Science (with P. Velleman). The Annual Review of Psychology, 52, 305-335, 2001.

Sex, Smoking and Life Insurance. Chance, 14(3), 42-45, 2001.

On the alienation of content and evidence from commercial design. Chance,14(3) 37-39, 2001.

Overview of Test Scoring (with D. Thissen). In D. Thissen & H. Wainer (eds.) Test Scoring. Hillsdale, NJ: Lawrence Erlbaum Associates, 2001, Chapter 1, pps. 1-20.

True Score Theory: The Traditional Method. (with D. Thissen). In D. Thissen & H. Wainer (eds.) Test Scoring. Hillsdale, NJ: Lawrence Erlbaum Associates, 2001, Chapter 2, pps. 21-72.

Augmented Scores – “Borrowing Strength” to compute scores based on small numbers of items (with J. L Vevea, F. Camacho, B. Reeve, K. Rosa, L. Nelson, K. Swygert, & D. Thissen). In D. Thissen & H. Wainer (eds.) Test Scoring. Hillsdale, NJ: Lawrence Erlbaum Associates, 2001, Chapter 9, pps. 343-388.

New tools for exploratory data analysis: III. Smoothing & Nearness Engines. Chance,14(1), 43-46, 2001.

Graphical Details: A review of Leland Wilkinson’s The Grammar of Graphics. Psychometrika, 66, 307-310, 2001.

William Playfair (1759-1823): An inventor and ardent advocate of statistical graphics (with Ian Spence). In Statisticians of the Centuries (C. C. Heyde & E. Seneta, eds.). Springer- Verlag: New York, 105-110, 2001.

Order in the court. Chance,14(2), 43-46, 2001.

2000

Cholera, Rocket Ships and Tom's Veggies: Contemporary and historical ideas toward the effective communication of school performance. Evaluation and Research in Education, 14, 148-180, 2000.

Narrow and Shallow: Further Comments on Statistical Methods in Psychology Journals (L. Wilkinson & the rest of the APA Task Force on Statistical Inference). (2000). American Psychologist, 55, 965-966.

CATs: Whither and whence. Psicologica, 21(1), 121-133, 2000.

Empirical evidence in support of Kelley’s Paradox: A Response to Zaslavsky. Chance, 13(3), 3-4, 2000.

New tools for exploratory data analysis: I. Automating 2-way table decomposition. Chance, 13(3), 43-47, 2000.

New Tools For Exploratory Data Analysis: II. Rotatable SPLOMS & A Slicing Engine. Chance, 13(4), 45-47, 2000.

Page - 13 !//#

The Centercept: An estimable and meaningful regression parameter. Psychological Science, 11, 434- 436, 2000.

Review of Understanding USA. Print, 54(3), 34 & 194, June/July 2000.

Frederic Mather Lord (1912-2000). Educational Measurement: Issues and Practice, 19, 24-25, 2000.

Frederic Mather Lord (1912-2000) (with M. Stocking). Psychometrika, 65, 143-144, 2000.

Frederic Mather Lord (1912-2000). Chance, 13(2), 8, 2000.

Testing the disabled: Using statistics to navigate between the Scylla of standards and the Charybdis of court decisions. Chance, 13(2), 42-44, 2000.

Using a New Statistical Model for Testlets to Score TOEFL. (with X. Wang). Journal of Educational Measurement, 37, 203-220, 2000.

Kelley’s Paradox. Chance, 13(1), 47-48, 2000.

Assessing time trends in sex differences in swimming & running (with C. Njue & S. Palmer). (with discussions) Chance, 13(1), 10-15, 2000.

Sex and Sports and Martin and Price: A Rejoinder (with S. Palmer & C. Njue). Chance, 13(1), 21, 2000.

Rescuing Computerized Testing by Breaking Zipf's Law. Journal of Educational and Behavioral Statistics, 25, 203-224, 2000.

Caveats, pitfalls and unexpected consequences of implementing large-scale computerized testing (with D. Eignor). In H. Wainer et al, Computerized Adaptive Testing: A Primer (2nd edition). Hillsdale, NJ: Lawrence Erlbaum Associates, 2000, Chapter 10, pps. 271-300.

The Aptitude-Achievement Function: An Aid for Allocating Educational Resources, with an Advanced Placement Example (with W. Lichten). Educational Psychology Review, 12(2), 201-228, 2000.

Testlet Response Theory: An analog for the 3-PL useful in adaptive testing (with E. Bradlow and Z. Du). In Computerized adaptive testing: Theory and practice (W.J. van der Linden & C.A.W. Glas, Eds.). Boston, MA: Kluwer-Nijhoff, 2000, Chapter 13, pps. 245-270.

Maximum Marginal Likelihood and Expected A Posteriori estimates for the testlet response model (with C. Glas & E. Bradlow). In Computerized adaptive testing: Theory and practice (W.J. van der Linden & C.A.W. Glas, Eds.). Boston, MA: Kluwer-Nijhoff, 2000, Chapter 14, pps. 271-288.

Some paths toward making Praxis scores more useful. (with K. Sheehan & X. Wang). Journal of Educational Measurement, 37, 113-140, 2000.

1999

Statistical methods in psychology journals: Guidelines and explanations. (L. Wilkinson & the rest of the APA Task Force on Statistical Inference). (1999). American Psychologist, 54, 594-604.

Page - 14 !//#

Comparing the incomparable: An essay on the importance of big assumptions and scant evidence. Educational Measurement: Issues and Practice, 18, 10-16, 1999.

Is the Akebono School failing its best students? An Hawaiian adventure in regression. Educational Measurement: Issues and Practice, 18, 26-33, 1999.

Some comments on the Ad Hoc Committee’s critique of the Massachusetts Teacher Tests. Education Policy Analysis Archives, 7(5), Entire issue, 1999.

Alternative Displays for Communicating NAEP Results: A Redesign and Validity Study (with R. K. Hambleton and K. Meara). Journal of Educational Measurement, 36, 301-335, 1999.

A graphical investigation of the scourge of Vietnam. Chance, 12(4), 44-46, 1999.

Reynold B. Johnson (1906-1998) Chance, 12(2), 9-10, 1999.

The soul of wit. Contemporary Psychology, 44, 22-23, 1999.

A Bayesian random effects model for testlets (with E. T. Bradlow and X. Wang). Psychometrika, 64, 153-168, 1999.

Scaling the Market. Chance, 12(3), 43-44, 1999.

Simpson’s Paradox. Chance, 12(2), 43-44, 1999.

A Puzzle Solved? Chance, 12(1), 42-43, 1999.

The most dangerous profession: A note on non sampling error. Psychological Methods, 4,250-256, 1999.

One cheer for null hypothesis significance testing. Psychological Methods, 4(2), 212-213, 1999.

1998

Some statistical and logical considerations when rescoring tests (with E. T. Bradlow). Statistica Sinica, 8, 713-728, 1998.

Rounding Tables. Chance, 11(1), 46-50, 1998.

The graphical inventions of Dubourg and Ferguson: Two precursors to William Playfair. Chance, 11(4), 39-41, 1998.

Publication delays in statistics journals (with E. T. Bradlow). Chance, 11(1), 42-45, 1998.

Toward a coherent view of reliability in test theory. (with Heng Li). Journal of Educational and Behavioral Statistics, 23, 478-484, 1998.

Psychometrics: An Overview (with S. Sireci and H. Braun). In Encyclopedia of Biostatistics (P. Armitage & T. Colton, editors) London: John Wiley & Sons LTD, 1998.

A selection of selection anomalies (with S. J. Palmer, & E. T. Bradlow). Chance, 11(2), 3-7, 1998.

1997

Like a trout in the milk. Chance, 10(4), 34-36, 1997.

Page - 15 !//#

Tom's veggies and the American way. Chance, 10(3), 40-42, 1997.

Graphical birth announcements, Chance, 10(2), 58-60, 1997.

William Playfair: A Daring Worthless Fellow (with Ian Spence), Chance, 10(1), 31-34, 1997.

Who was Playfair? (with Ian Spence), Chance, 10(1), 35-37, 1997.

How reliable are TOEFL scores? (with R. Lukhele). Educational and Psychological Measurement, 57(5), 749-766, 1997.

Managing the influence of DIF from big items: The 1988 Advanced Placement History test as an example (with R. Lukhele). Applied Measurement in Education, 10(3) , 201-215, 1997.

"The history of test development" (with R. F. Ittenbach & I. G. Esters). Chapter 2 in D. P. Flanagan, J. Genshaft, & P. L. Harrison (Eds.) Beyond traditional assessment: Contemporary and emerging theories, tests, and issues. New York: Guilford Publications. pps. 17-31, 1997.

Some Multivariate displays for NAEP Results. Psychological Methods, 2, 34-63, 1997.

Improving tabular displays: with NAEP tables as examples and inspirations. Journal of Educational and Behavioral Statistics, 22, 1-30, 1997.

1996

A Priestley View of International Stock Exchanges, Chance, 9(4), 31-33, 1996.

Scaling the heights (and widths) Chance, 9(3), 43-49, 1996.

Why Playfair? Chance, 9(2), 43-52, 1996.

Depicting error. The American Statistician, 50(2) , 101-111, 1996.

How is reliability related to the quality of test scores? What is the effect of local dependence on reliability? (with D. Thissen). Educational Measurement: Issues and Practice, 15(1), 22-29, 1996.

Using trilinear plots for NAEP data. Journal of Educational Measurement, 33, 41-55, 1996.

A Nobel Plot. (with J. Durso). Chance, 9(1), 12-16, 1996.

1995

Measurement problems. In D. Laveault, B. D. Zumbo, M. E. Gessaroli, & M. W. Boss (Eds. ) Modern theories in measurement: Problems and issues. Ottawa: University of Ottawa Press. pps. 375- 407, 1995.

On the viability of some untestable assumptions in equating exams that allow examinee choice (with X-b. Wang & D. Thissen), Applied Measurement in Education, 8(3) , 211-225, 1995.

Trilinear plots. Chance, 8(1), 48-54, 1995.

A rose by another name. Chance, 8(2), 46-51, 1995.

Graphical mysteries. Chance, 8(3), 52-56, 1995.

Page - 16 !//#

Picturing an LA bus schedule. Chance, 8(4), 44-48, 1995.

Precision & Differential Item Functioning on a testlet-based test: The 1991 Law School Admissions Test as an example. Applied Measurement in Education, 8(2), 157-187, 1995.

1994

Problèmes de mesure. Mesure et évaluation en éducation, 17(2), 115-146, 1994.

On the Academic Performance of New Jersey’s Public School Children: I. Fourth and Eighth Grade Mathematics in 1992, Education Policy Analysis Archives, 2(10), Entire issue, 1994.

Implicit graphs. Chance, 7(4), 44-48, 1994.

Making triathlons fair: The ultimate triathlon (with R. Deveaux). Swim Magazine, 10(6), 18-21, 1994.

Visual Aids When Comparing an Apple to the Stars. Chance, 7(3), 50-53, 1994.

Three Graphic Memorials. Chance, 7(2), 52-55, 1994.

Resizing triathlons for fairness (with R. Deveaux). Chance, 7(1), 20-25, 1994.

Todai moto kurashi. Chance, 7(1), 46-49, 1994.

On the relative value of multiple-choice, constructed response, and examinee-selected items on two achievement tests (with R. Lukhele & D. Thissen). Journal of Educational Measurement, 31, 234-250, 1994.

How well can we compare scores on test forms that are constructed by examinees' choice? (with X- b. Wang & D. Thissen) Journal of Educational Measurement, 31, 183-199, 1994.

Are tests comprising both multiple-choice and free-response items necessarily less unidimensional than multiple-choice tests? An analysis of two tests. (with X-b. Wang & D. Thissen), Journal of Educational Measurement, 31, 113-123, 1994.

On examinee choice in educational testing. (with D. Thissen). Review of Educational Research, 64, 159-195, 1994.

1993

Does spending money on education help? A reaction to the Heritage Foundation and the Wall Street Journal. Educational Researcher, 22, 22-24, 1993.

Graphical Answers to Scientific Questions. Chance, 6(4), 48-50, 1993.

Tabular presentation. Chance, 6(3), 52-56, 1993.

Making readable overhead displays. Chance, 6(2), 46-49, 1993.

Combining multiple choice and constructed response test scores: Toward a Marxist theory of test construction. (with D. Thissen) Applied Measurement in Education, 6, 103-118, 1993.

How much more efficiently can humans run than swim? Chance, 6, 17-21, 1993.

Page - 17 !//#

Graphs in the presidential campaign: Why weren't they used by more than one candidate? Chance, 6, 48-51, 1993.

The Validity of the SAT at the University of Hawaii: A riddle wrapped in an enigma (with T. Saka & J. R. Donoghue), Educational Evaluation and Policy Analysis, 15, 91-98, 1993.

Graphing multiple comparisons: Some comments on Tukey. Journal of Computational and Graphical Statistics, 2, 35-40, 1993.

Measurement problems. Journal of Educational Measurement, 30, 1-21, 1993.

Some research problems encountered at the Educational Testing Service (with E. Johnson, C. Lewis & R. Mislevy). Journal of Official Statistics, 9, 189-201, 1993.

Some practical considerations when converting a linearly administered test to an adaptive format. Educational Measurement: Issues and Practice, 12, 15-20, 1993.

Detection of differential item functioning using the parameters of item response models (with D. Thissen & L. Steinberg). In P. W. Holland & H. Wainer (Eds. ) Differential Item Functioning. Hillsdale, NJ: Lawrence Erlbaum Associates, 1993, Chapter 4, pps. 67-113.

Model-based standardized measurement of an item’s differential impact. In P. W. Holland & H. Wainer (Eds. ) Differential Item Functioning. Hillsdale, NJ: Lawrence Erlbaum Associates, 1993, Chapter 6, pps. 123-135.

Graphical data analysis. (with D. Thissen). In G. Keren & C. Lewis (Eds. ), A handbook for data analysis in the behavioral sciences: Statistical issues (Chapter 13, pp. 391-457). Hillsdale, NJ: Lawrence Erlbaum Associates, 1993.

1992

Sense-lining. Chance, 5, 71-72, 1992.

Sex differences in performance on the mathematics section of the Scholastic Aptitude Test: A bidirectional validity study (with L. Steinberg). Harvard Educational Review, 62, 323-336, 1992.

A comparison of the performance of simulated hierarchical and linear testlets (with B. Kaplan & C. Lewis). Journal of Educational Measurement, 29, 243-251, 1992.

Review of SAS System for Statistical Graphics by Michael Friendly (with P. Pashley). Journal of the American Statistical Association, 87, 899-900, 1992.

Prologue — How the following article came to be. Educational Researcher, 21, 12-13, 1992.

Understanding graphs and tables. Educational Researcher, 21, 14-23, 1992.

A harmless necessary CAT. Contemporary Psychology, 37, 149-150, 1992.

1991

Elegance, Grace, Impact and Graphical Displays. Chance, 4(4), 45-47, 1991.

Integrating figures and text. Chance, 4(3), 58-60, 1991.

Page - 18 !//#

The Isthmus of Acceptance: A graphical tool for function-based item analysis and test construction. Journal of Educational Statistics, 16, 109-124, 1991.

Humble pie. Chance, 4(2), 52-53, 1991.

Double Y-axis graphs. Chance, 4(1), 50-51, 1991.

Building algebra testlets: A comparison of hierarchical and linear structures (with C. Lewis, B. Kaplan, & J. Braswell). Journal of Educational Measurement, 28, 311-323, 1991.

Differential testlet functioning: Definitions and detection (with S. G. Sireci and D. Thissen). Journal of Educational Measurement, 28, 197-219, 1991.

On the reliability of testlet-based tests (with S. G. Sireci and D. Thissen). Journal of Educational Measurement, 28, 237-247, 1991.

Adjusting for differential base-rates: Lord’s Paradox again. Psychological Bulletin, 109, 147-151, 1991.

1990

Measuring graphicacy. Chance, 3(4), 52 & 58, 1990.

Edwards & Cummings’ “Fuzzy Truncation Model” is a step in the right direction. (with P. W. Holland). Applied Measurement in Education, 3(4), 377-380, 1990.

Graphical visions from William Playfair to John Tukey. Statistical Science, 5, 340-346, 1990.

Confidence envelopes for item response theory (with D. Thissen). Journal of Educational Statistics, 15, 113-128, 1990.

The first four millennia of mental testing: From ancient China to the computer age. The Score, 13, 4-5,11-13, April, 1990.

Adjusting NAEP for self-selection: A useful place for “Wall Chart” technology? Journal of Educational Statistics, 15,1-7, 1990.

Toward a psychometrics for testlets (with Charles Lewis). Journal of Educational Measurement, 27, 1-14, 1990.

Sources of uncertainty often ignored in adjusting state mean SAT scores for differential participa- tion rates: The rules of the game. (with P. W. Holland) Applied Measurement in Education, 3, 167-184, 1990.

An introduction to computerized adaptive testing. In H. Wainer et al, Computerized Adaptive Testing: A Primer. Hillsdale, NJ: Lawrence Erlbaum Associates, 1990, Chapter 1, pps. 1-22.

Item response theory, item calibration and proficiency estimation (with R. Mislevy). In H. Wainer, et al, Computerized Adaptive Testing: A Primer. Hillsdale, NJ: Lawrence Erlbaum Associates, 1990, Chapter 4, pps. 65-102.

Validity (with L. Steinberg & D. Thissen). In H. Wainer, et al, Computerized Adaptive Testing: A Primer. Hillsdale, NJ: Lawrence Erlbaum Associates, 1990, Chapter 8, pps. 187-232.

Page - 19 !//#

Future challenges (with N. Dorans, B. Green, R. Mislevy, L. Steinberg & D. Thissen). In H. Wainer, et al, Computerized Adaptive Testing: A Primer. Hillsdale, NJ: Lawrence Erlbaum Associates, 1990, Chapter 9, pps. 233-272.

1989

Eelworms, bulletholes & Geraldine Ferraro: Some problems with statistical adjustment and some solutions. Journal of Educational Statistics, 14, 121-140, 1989 (with discussions). Reprinted in Shaffer, J. P. (Ed. ) (1992). The role of models in nonexperimental social science (pps. 129- 148). Washington, D. C. : American Educational Research Association & American Statistical Association.

Responsum. Journal of Educational Statistics, 14, 187-200, 1989. Reprinted in Shaffer, J. P. (Ed. ) (1992). The role of models in nonexperimental social science (pps. 195-207). Washington, D. C. : American Educational Research Association & American Statistical Association.

Graphical visions from William Playfair to John Tukey. Proceedings of the American Statistical Association: Sesquicentennial Invited Paper Sessions (pps. 382-390). Washington, DC: The American Statistical Association, 1989.

The future of item analysis. Journal of Educational Measurement, 26 (2), 191-208, 1989.

Making essay test scores fairer with statistics (with H. Braun) In J. Tanur, et al. Statistics: A guide to the unknown (3rd edition) San Francisco: Holden Day, 1989, pps. 178-187.

1988

Review of Rousseuw & Leroy’s Robust Regression and Outlier Detection. Journal of Educational Statistics, 13, 358-364, 1988.

How accurately can we assess changes in minority performance on the SAT? American Psychologist, 43, 774 - 778, 1988.

Use of item response theory in the study of group differences in trace lines. (with D. Thissen & L. Steinberg). In H. Wainer and H. Braun (Eds. ), Test Validity ( 147-169) Hillsdale, N. J. : Lawrence Erlbaum Associates, 1988.

Statistical history from a Stigler for detail. Contemporary Psychology, 33, 293-295, 1988.

Plotting in the Modern World: Statistics Packages and Good Graphics. (with D. Thissen) Chance, 1, 10 - 20, 1988

1987

Estimating ability with the wrong model. (with D. Thissen) Journal of Educational Statistics, 12, 339-368, 1987.

Deja view: A discussion of dynamic graphics for data analysis. Statistical Science, 2, 388-389, 1987. Reprinted in W. S. Cleveland & M. E. McGill (Eds. ) Dynamic graphics for statistics, (60- 62). Belmont, CA: Wadsworth, 1988.

Page - 20 !//#

Item clusters and computerized adaptive testing: A case for testlets. (with G. Kiely) Journal of Educational Measurement, 24, 185-202, 1987.

Review of Chapman's Plain Figures, Short Book Reviews, 7, 1, 1987.

1986

The SAT as a social indicator: A pretty bad idea. In H. Wainer (Ed. ) Drawing inferences from self- selected samples. (pp. 7-21) New York: Springer-Verlag, 1986.

Computer graphics for the scholar. (with D. Thissen) Scholarly Communication, 6, pps. 1, 11-16, 1986.

Minority contributions to the SAT score turnaround: An example of Simpson’s paradox. Journal of Educational Statistics, 11, 229-244, 1986.

He knows the words but not the music. Contemporary Psychology, 31, 792-793, 1986.

Review of The Statistical Exorcist by M. Hollander & F. Proschan (with L. Wainer) Psychometrika, 51, 341-343, 1986.

XTREE: A multivariate graphical icon applicable in the evaluation of statistical estimators. (with D. Thissen) The American Statistician, 40, 149-153, 1986.

Can a test be too reliable? Journal of Educational Measurement, 23, 171-173, 1986.

Five pitfalls encountered while trying to compare states on their SAT scores. Journal of Educational Measurement, 23, 69-81, 1986.

1985

Minority advances in test performance: A response to Jones. American Psychologist, 40, 103, 1985.

On “State Education Statistics” (with P. Holland, S. Swinton, & M. Wang) Journal of Educational Statistics, 10, 293-325, 1985.

1984

Psychology and mathematics. The American Scientist, 72, 208, 1984.

An exploratory analysis of performance on the SAT. Journal of Educational Measurement, 21, 81-91, 1984.

How to display data badly. The American Statistician, 38, 137-147, 1984.

Was there one distractor too many? (with J. R. J. Wadkins & A. Rogers) Journal of Educational Statistics, 9, 5-24, 1984.

1983

Review of The Visual Display of Quantitative Information by E. R. Tufte. Psychometrika, 48, 645- 647, 1983.

Foreword to Bertin’s Semiology of Graphics. Madison, Wisconsin: University of Wisconsin Press, 1983.

Page - 21 !//#

Multivariate displays. In M. H. Rizvi, J. Rustagi & D. Siegmund (Eds. ), Recent advances in statistics (pp. 469-508). New York: Academic Press, 1983.

Are we correcting for guessing in the wrong direction? In D. J. Weiss (Ed. ) New horizons in test- ing: Latent trait test theory and computerized adaptive testing (pp. 63-80). New York: Academic Press, 1983.

Gapping. In S. Kotz, N. L. Johnson and C. B. Read (Eds. ) Encyclopedia of Statistical Sciences, Vol. 3 (pp. 301-304). New York: John Wiley & Sons, 1983.

Pyramid power: Searching for an error in test scoring with 830,000 helpers. The American Statistician, 37, 87-91, 1983.

Reply to Oderwald and others. The American Statistician, 37, 351-352, 1983.

Toward the measurement and prediction of victim proneness. (with D. Thissen) Journal of Research in Crime and Delinquency, 20, 243-261, 1983.

How are we doing? A review of Social Indicators III. Journal of the American Statistical Association, 78, 492-496, 1983.

On item response theory and computerized adaptive tests: The coming technological revolution in testing. The Journal of College Admissions, 28, 9-16, 1983.

1982

Some standard errors in item response theory (with D. Thissen). Psychometrika, 47, 397-412, 1982.

Robust statistics: A survey and some prescriptions. In G. Keren (Ed. ) Statistical and methodolog- ical issues in psychology and social sciences research. (pp. 187-216). Hillsdale, N. J. : Lawrence Erlbaum Associates, 1982.

Robust estimation of parole outcome. (with A. M. B. Morgan) Journal of Research on Crime and Delinquency, 19, 84-109, 1982.

1981

A parameterization of recidivism. Evaluation Review, 5, 810-821, 1981.

An excellent item. Contemporary Psychology, 26, 680-682, 1981.

Influence enhanced scatter plots. (with L. Baker & D. Thissen) Psychological Bulletin, 90, 179-184, 1981.

Reply to Abt and Meyer. The American Statistician, 35, 57-58, 1981.

Discussion of Kleiner & Hartigan’s trees and castles. Journal of the American Statistical Association, 76, 272-275, 1981.

Graphical data analysis. (with D. Thissen). In M. R. Rosenzweig & L. W. Porter (Eds. ), Annual Review of Psychology (pp. 191-241). Palo Alto, CA: Annual Reviews, 1981.

1980

Page - 22 !//#

Making newspaper graphs fit to print. In P. Kolers, M. E. Wrolstad, & H. Bouma (Eds. ), Processing of Visible Language: 2. (pp. 125-142), New York: Plenum, 1980. (Republished in two parts: Chapel Hill, NC, Newspaper design notebook, 1981, 2, pps. 1, 10-16 and 1981, 3, pps. 1, 3-5. ).

Quantitative approaches to the study of parole. (with R. Perline). In S. E. Fienberg & A. J. Reiss (Eds.) Indicators of Crime and Criminal Justice: Quantitative Studies. Washington, D. C. : U. S. Department of Justice, 1980, 59-60.

A timely error. Royal Statistical Society News and Notes. 7, 6, 1980.

A review of estimation procedures for the Rasch Model with an eye toward longish tests. (with J. E. Gustafsson & A. M. B. Morgan). Journal of Educational Statistics, 4, 35-64, 1980.

A test of graphicacy in children. Applied Psychological Measurement, 5, 331-340, 1980.

An empirical inquiry into human understanding of “Two Variable Color Maps. ” (with C. Francolini), The American Statistician, 34, 81-93, 1980. Also in the Proceedings of the First General Conference on Social Graphics. (Tech. Report No. 49, pps. 80-113) Washington, D. C. : Bureau of the Census, 1980.

Review of Exploratory Data Analysis by F. Hartwig and B. E. Dearing. Psychometrika, 45, 499, 1980.

Robust estimation of ability in the Rasch model. (with B. D. Wright) Psychometrika, 45, 373-391, 1980.

1979

Current uses of the computer in medicine. Journal of the American Osteopathic Association, 79, 7, 1979.

On the assessment of skeletal maturity. American Journal of Clinical Nutrition, 32, (6), 1184-1185, 1979.

On the robustness of a class of naive estimators. (with D. Thissen) Applied Psychological Measurement, 3 (4), 543-551, 1979.

Review of R. A. Fisher: The life of a scientist by J. F. Box. Psychometrika, 44, 253-254, 1979.

The Rasch model as additive conjoint measurement. (with R. Perline & B. D. Wright) Applied Psychological Measurement, 3 (3), 237-256, 1979.

1978

A discussion of D. B. Rubin’s “Multiple imputation in sample surveys: A phenomenological Bayesian approach to nonresponse. ” In Imputation and Editing of Faulty or Missing Survey Data, Washington, D. C. : Bureau of the Census, 1978.

Assessing the efficacy of visual displays. (with M. Reiser) In Proceedings of the 1976 American Statistical Association Meetings (Social Statistics Section), Part I, 89-92. Reprinted in Graphic presentation of statistical information (Technical Report No. 43, pp. 83-88) Washington, D. C. : Bureau of the Census, 1978.

Gapping. (with S. Schacht) Psychometrika, 43, 203-212, 1978.

Page - 23 !//#

On the sensitivity of regression and regressors. Psychological Bulletin, 85, 267-273, 1978.

Predicting adult stature without skeletal age and without paternal stature. (with S. Bell & A. F. Roche) Pediatrics, 61, 569-572, 1978.

Predicting the impact of simple and compound life change events. (with D. Fairbank & R. Hough) Applied Psychological Measurement, 2, 313-322, 1978.

Reply to Noyes. (with A. D. Biderman) The Cartographic Journal, 15 (2), 104, 1978.

1977

EXPAK: A FORTRAN IV program for exploratory data analysis. (with D. Thissen) Applied Psychological Measurement, 1, 49-50, 1977.

Introduzione All’Inferenza Bayesiana. In R. P. Runyon and A. Haber’s Fondamenti di statistica. (pp. 228-232). Amsterdam: Inter-European Editions, 1977.

Late elongation of the cranial base. (with A. B. Lewis, R. McCartin & A. F. Roche) Journal of Dental Research, 56, 802-808, 1977.

Measuring the effects of a liberal arts education on the perception of poetry. (with P. Schofer) American Educational Research Journal, 14, 125-135, 1977.

Review of Exploratory Data Analysis by John W. Tukey. Psychometrika, 42, 635-638, 1977.

Some methodological comments on evaluating maps. (with A. D. Biderman) The Cartographic Journal, 14, 109-114, 1977.

Speed vs. reaction time as a measure of cognitive performance. Memory and Cognition, 5, 278-280, 1977.

1976

Baudelaire in the classroom: An application of multidimensional scaling in educational evaluation. (with W. J. Berg). Sciences de l’Art — Scientific Aesthetics, 1, 57-66, 1976.

Estimating coefficients in linear models: It don’t make no nevermind. Psychological Bulletin, 83, 213- 217, 1976.

Hereditary and environmental determinants of growth in height in a longitudinal sample of children and youth of Guatemalan and European ancestry. (with F. E. Johnson, R. MacVean, & D. Thissen) The American Journal of Physical Anthropology, 44, 469-475, 1976.

Individual growth in stature: A comparison of four U. S. growth studies. (with R. D. Bock, A. F. Roche, & D. Thissen) Annals of Human Biology, 3, 529-542, 1976.

Robust statistics: A survey and some prescriptions. Journal of Educational Statistics, 1, 285-312, 1976.

Rorschach revisited: A new look at an old test. (with L. Aiken & S. Hurt) Journal of Clinical and Consulting Psychology, 41, 390-399, 1976.

Three steps toward robust regression. (with D. Thissen) Psychometrika, 41, 9-34, 1976.

Page - 24 !//#

Two programs for the prediction of stature in individuals. (with D. Thissen) Pediatrics, 58, 368- 369, 1976.

1975

Multivariate semi-metric smoothing in multiple prediction. (with D. Thissen). Journal of the American Statistical Association, 70, 568-573, 1975.

A double logistic comparison of growth patterns of normal children and children with Down’s syndrome. (with G. L. Rarich, V. A. Seedfeldt, & D. Thissen). Annals of Human Biology, 2, 339- 346, 1975.

The RWT method for the prediction of adult stature. (with A. F. Roche, & D. Thissen) Pediatrics, 56, 1026-1033, 1975.

When jackknifing fails (or does it?) (with D. Thissen). Psychometrika, 40, 113-114, 1975.

1974

Multidimensional scaling of concept learning in an introductory course. (with K. Kaye) Journal of Educational Psychology, 66, 591-598, 1974.

Museums USA: A Type III error. Museum News, 53, 42-44, 1974.

Predicting the outcome of the Senate trial of Richard M. Nixon. Behavioral Science, 19, 404-406, 1974.

The Roche-Wainer-Thissen method of predicting adult stature. (with A. F. Roche, & D. Thissen) In the Proceedings of the Compe-Rendu de la XXIIe Reunion des Equipes Charge des Etudes sur la Croissance et le Developpement de l’Enfant Normal. Paris, 50-62, 1974.

The suspended rootogram and other visual displays: An empirical validation. The American Statistician, 28, 143-145, 1974.

TREBIG: A 360/75 FORTRAN program for three mode factor analysis (designed for big data sets). (with M. Blair & G. Gruvaeus) Behavioral Research Methods and Instrumentation, 6 (1), 53- 54, 1974

Using variance as a discriminator in lie detection. (with M. Blair, G. Gruvaeus, & N. Zill) Journal of Applied Psychology, 57, 110-112, 1974.

1973

A parameterization of individual human growth curves. (with R. D. Bock, J. Murray, A. Peterson, A. F. Roche, & D. Thissen) Human Biology, 45, 63-80, 1973.

CATJUD: An IBM 370 FORTRAN IV program using the method of successive intervals (Law of Categorical Judgment). (with G. Bond) Behavioral Science, 18, 223-225, 1973.

GAPPER: An IBM 360 program for finding gaps in univariate data strings. (with D. Thissen) Behavioral Science, 18, 77-78, 1973.

Page - 25 !//#

Senatorial decision making: I. The determination of structure. (with G. Gruvaeus & N. Zill) Behavioral Science, 18, 7-19, 1973.

Senatorial decision making: II. Prediction (with G. Gruvaeus & N. Zill) Behavioral Science, 18, 20- 26, 1973.

The other tail. The British Journal of Mathematical and Statistical Psychology, 26, 182-187, 1973.

1972

A practical note on one-tailed tests. The American Psychologist, 27, 775-776, 1972.

Basic principles of measurement, data analysis and hypothesis testing. In R. Lana & R. Rosnow, Introduction to Contemporary Psychology, (pp. 413-439). New York: Holt, Rinehart, Winston, 1972.

The dimensions of de Maupassant: A multidimensional analysis of students’ perception of literature. (with W. J. Berg) American Educational Research Journal, 9, 485-491, 1972.

Blurring. (with G. Bond) Psychotherapy: Theory, Research and Practice. 19, 9-10, 1972.

MOCA: A 360/65 program for Multiple-Ordered Cluster Analysis. (with G. Gruvaeus) Behavioral Science, 17, 490, 1972.

On style in college textbooks. Educational Researcher, 1, 13-14, 1972.

Two additions to hierarchical cluster analysis. (with G. Gruvaeus) The British Journal of Mathematical and Statistical Psychology, 25, 200-206, 1972.

1971

A 360/65 computer program for stem-and-leaf displays and third generation statistics. (with G. Bond) Behavioral Science, 16, 422-423, 1971.

A CDC 6400 program for the clustering of distances from Eckhart-Young decomposition. Behavioral Science, 16, 415-416, 1971.

A multidimensional analysis of school satisfaction. (with U. Gluskinos) American Educational Research Journal, 8, 423-434, 1971.

Some methodological notes on Gluskinos and Wainer. American Educational Research Journal, 8, 567-571, 1971.

Piecewise regression: A simplified procedure. The British Journal of Mathematical and Statistical Psychology, 24, 83-92, 1971.

TREMOD: A computer program for three mode factor analysis. (with G. Gruvaeus & F. Snyder) Behavioral Science, 16, 421-422, 1971.

1970

A computer program for the principal components analysis of learning data. Behavioral Science, 15, 206-207, 1970.

Page - 26 !//#

Personality and group impression formation as a function of the amount of overlap in evaluative meaning of the stimulus elements. (with R. Arms & R. Rosnow) Sociometry, 33, 472-484, 1970.

1969

Anderson’s personality-trait words rated by men and women as a function of sex of stimulus. (with R. Arms & R. Rosnow) Psychological Reports, 24, 787-790, 1969.

Page - 27 !//#

INVITED TALKS

Using the SAT as an Educational Indicator: A Successful Application. Looking Back: A Conference in Honor of Paul W. Holland. Educational Testing Service, Princeton, NJ, September 19-20, 2008.

14 conversations about three things. Part of an invited symposium at the 2008 meeting of the National Council on Measurement in Education. New York, New York, March 25, 2008.

Schrodinger’s cat, Rasch’s P and the most dangerous equation. Invited address at the 2008 meeting of the National Council on Measurement in Education. New York, New York, March 26, 2008.

The most dangerous equation, GIS conference, Greenville, SC, October 17, 2007.

Value-added modeling. A conference at AAMC, June 25, 2007, Washington, D.C.

Value-added modeling. In an invited symposium entitled “Accountability, Measurement, and Value-Added Models,” at the 2007 meeting of the National Council on Measurement in Education. Chicago, Illinois, April 12, 2007.

Using testlet response theory to understand a survey of breast cancer patients. Department of Statistics, the University of Vermont. Burlington, VT, March 5, 2007.

The most dangerous equation. Educational Testing Service, Princeton, NJ, February 7, 2007.

The most dangerous equation. Senior Honors Psychology Seminar, University of Pennsylvania. Philadelphia, PA, January 29, 2007.

The most dangerous equation. Department of Statistics, Duke University, Durham, NC, December 1, 2006.

The most dangerous equation. Department of Statistics, Cornell University, Ithaca, NY, November 15, 2006.

Page - 28 !//#

Three challenges to the practicality of value-added models. The Curry School of Education,The University of Virginia. Charlottesville, VA, November 2, 2006.

The most dangerous equation. Department of Statistics ,The University of Virginia. Charlottesville, VA, November 2, 2006.

The most dangerous equation. Department of Psychology ,The University of Vermont. Burlington, VT, September 29, 2006.

Using testlet response theory to understand a survey of breast cancer patients. NIH PROMIS Conference, Gaithersburg, MD, September 11, 2006.

Three challenges to the practicality of value-added models. Department of Education, The University of Massachusetts. Amherst, MA, April 24, 2006.

Graphic Discovery: Sixteen short tales. Senior Honors Psychology Seminar, University of Pennsylvania. Philadelphia, PA, February 20,, 2006.

Logical and empirical evidence that smaller schools do not improve student achievement. The College Board, New York, February 1, 2006.

What happens if you don’t require the SAT? Bowdoin College as an example. The College Board, New York, February 1, 2006.

Three challenges to the practicality of value-added models. The College Board, New York, February 1, 2006.

Graphic Discovery: Sixteen short tales. The Germantown Society for Science and the Arts. Philadelphia, PA, January 23, 2006.

Three paradoxes in the interpretation of group differences. The Department of Psychology, The University of North Carolina, Chapel Hill, November 14, 2005.

Three challenges to the practicality of value-added models. University Lecture, The University of North Carolina, Chapel Hill, November 14, 2005.

Interviewed on Berkeley Groks. KALX 90.7 FM, Berkeley, CA, April 4, 2005

Three challenges to the practicality of value-added models. Talk to the Chicago Chapter of the American Statistical Association on May 6, 2005.

Page - 29 !//#

Visual Discovery: Data display whither and whence. A Workshop sponsored by the American Educational Research Association, Montreal Canada, April 10, 2005.

Three challenges to the practicality of value-added models. Talk in the Department of Statistics of the Wharton School of the University of Pennsylvania, Philadelphia, Pennsylvania. on April 6, 2005.

Three challenges to the practicality of value-added models. Talk as part of a panel discussion at Temple University, Philadelphia, Pennsylvania. on March 23, 2005.

Three challenges to the practicality of value-added models. Keynote address at the National Conference of the National Education Association, Austin, Texas, December 3, 2004.

Three challenges to the practicality of value-added models. Talk at National Board of Medical Examiners, Philadelphia, Pennsylvania. on November 16, 2004

:Chance Musings. Department of Psychology, the University of Pennnsylvania, Philadelphia, Pennsylvania. November 15, 2004.

Value-added assessment. South Eastern Regional Conference of the Pennsylvania State Education Association, Galloway, NJ, October 15, 2004.

How to display data badly. Department of Psychology, the University of Vermont, Burlington, Vermont. September 10, 2004.

Chance Musings. Educational Testing Service, Princeton, New Jersey. September 29, 2004.

Chance Musings. National Board of Medical Examiners, Philadelphia, Pennsylvania. October 18, 2004.

A graphical legacy of Charles Joseph Minard: Two jewels from the past. Annual meeting of the American Statistical Association, Toronto, Canada. August 11, 2004.

Freedle’s Folly. Annual meeting of the Statistical Society of Canada, Montreal, Canada. June 1, 2004.

Page - 30 !//#

How to display data badly. University of Texas at Austin. April 23, 2004.

Three statistical paradoxes. . University of Texas at Austin. April 23, 2004.

A workshop on the effective display of NAEP data. Westat. San Francisco, California. January 27, 2004.

Graphical Discovery – a series of lectures at Wabash College, Crawfordsville, Indiana. October 20-22, 2003.

Three paradoxes in the interpretation of group differences: Illustrated with data on medical school admissions and licensing. The Department of Economics, the University of Pennsylvania. October 6, 2003, Philadelphia, PA.

How to display data badly. American Association of Advertising Agencies. Boca Raton, Florida. September 8, 2003.

A workshop on effective display. American Association of Public Opinion Research. Nashville, TN. May 15, 2003.

Three paradoxes in the interpretation of group differences: Illustrated with data on medical school admissions and licensing. Educational Testing Service. Princeton, NJ. January 24, 2003.

How to display data badly. Princeton University, School of Engineering. Princeton, NJ. November 20, 2002.

Three paradoxes in the interpretation of group differences: Illustrated with data on medical school admissions and licensing. The Graduate School of Education, the University of Pennsylvania. November 6, 2002, Philadelphia, PA.

A trout in the milk. A workshop on graphical display sponsored by the Washington Statistical Society. October 23, 2002. Washington, D.C.

On examinee choice in educational testing. The Department of Statistics atThe Wharton School, The University of Pennsylvania, PA, March 27, 2002.

EDA whither and whence: A personal journey. Department of Statistics, University of Colorado-Denver and the Denver Area Chapter of the American Statistical Association. Denver Colorado, October 27, 2001

Page - 31 !//#

Testlet Response Theory. Annual Meeting of the Dutch Research Group on Item Response Theory, Enschede, The Netherlands. October 1-4, 2001.

John Wilder Tukey (1915-2000). Annual Meeting of the American Statistical Association, Atlanta, GA. August 6, 2001.

How to display data badly. National Board of Medical Examiners. Philadelphia, PA. August 3, 2001.

Testlet Response Theory. Annual Meeting of the Psychometric Society, Valley Forge, PA. June 23, 2001.

Cholera, Rocket Ships and Tom's Veggies: Contemporary and historical ideas toward the effective communication of educational phenomena. Graduate School of Education, Teachers College, Columbia University, New York, NY, March 28, 2001.

Cholera, Rocket Ships and Tom's Veggies: Contemporary and historical ideas toward the effective communication of educational phenomena. Graduate School of Education, Rutgers University, New Brunswick, NJ, January 22, 2001.

EDA whither and whence: A personal journey. Department of Statistics, Rutgers University, New Brunswick, NJ, November 8, 2000.

Cholera, Rocket Ships and Tom's Veggies: Contemporary and historical ideas toward the effective communication of educational phenomena. Graduate School of Education, Harvard University, Cambridge, MA, November 4, 2000.

How to display data badly. Graduate School of Education, Harvard University, Cambridge, MA, November 4, 2000.

John Wilder Tukey and EDA: Its past and future. Department of Statistics, The Johns Hopkins University, Baltimore, MD, October 25, 2000.

EDA whither and whence: A personal journey. Keynote address at the Chicago Chapter of the American Statistical Association’s special conference on exploratory data analysis. Chicago, Illinois, May 5, 2000.

Lines in time: From The Creation to Tom’s Veggies. Department of Statistics, Columbia University, November 15, 1999.

Cholera, Rocket Ships and Tom's Veggies: Contemporary and historical ideas toward the effective communication of quantitative phenomena. Keynote address at the Second International Conference on Evidence-Based Policies & Indicator Systems. University of Durham, England, July 13, 1999.

Cholera, Rocket Ships and Tom's Veggies: Contemporary and historical ideas toward the effective communication of quantitative phenomena. Keynote address at the 14th Annual Conference on Making Statistics More Effective in Schools of Business at Babson College on June 11, 1999.

Lines in time: From The Creation to Tom’s Veggies. Department of Atomic Physics, Yale University, October 9, 1998.

Page - 32 !//#

How to display data badly. Case Western Reserve University , Cleveland, OH, October 2, 1998.

Rescuing Computerized Testing by Breaking Zipf's Law. Case Western Reserve University , Cleveland, OH, October 2, 1998.

How to display data badly. CHANCE Conference, Dartmouth College , Hanover, NH, July 10, 1998.

Lines in time: From The Creation to Tom’s Veggies. School of Communication, Cornell University , Ithaca, N.Y., April 10, 1998.

How to display data badly. School of Communication, Cornell University , Ithaca, N.Y., April 9, 1998.

How to display data badly. Rutgers University , New Brunswick, NJ, February 23, 1998.

Comparing the Incomparable: On the Importance of Big Assumptions and Scant Evidence. American Association for the Advancement of Science. Philadelphia, PA, February 17, 1998.

How to display data badly. The Princeton Chapter of the American Statistical Association , Princeton, NJ, February 10, 1998.

Cholera, Rocket Ships and Tom's Veggies: Contemporary and historical ideas toward the effective communication of school performance.The Peg Jones Memorial Lecture given at the annual meeting of State Researchers of the National Education Association. Washington, DC, December 4, 1997.

Visual Revelations. Law School Admissions Council. Newtown Pennsylvania, September 23, 1997.

Visual Revelations. Hawaii State Department of Education. Honolulu, Hawaii, August 20, 1997.

How to display data badly. The Bureau of Labor Statistics, Washington, D.C., July 14, 1997.

Rescuing Computerized Testing by Breaking Zipf's Law. Department of Education, University of Massachusetts, Amherst, MA, May 5, 1997.

Rescuing Computerized Testing by Breaking Zipf's Law. Department of Statistics, Cornell University, Ithaca, NY, April 4, 1997.

Graphical Disasters: How to Construct or Avoid Them. The W. Edwards Deming Lecture at the 1996 Conference on Applied Statistics of the American Society for Quality Control. Atlantic City, NJ, December 11, 1996

How to display data badly. The Wharton School, The University of Pennsylvania, PA, December 4, 1996 and again April 21, 1997.

On Examinee Choice. Department of Statistics, Carnegie Mellon University, Pittsburgh, PA, May 17, 1996.

How to display data badly. Pittsburgh Chapter of the American Statistical Association, Pittsburgh, PA, May 16, 1996.

How to display data badly. Syracuse Chapter of the American Statistical Association, Syracuse, NY, March 29, 1996.

Page - 33 !//#

Data presentation. Keynote speaker at Conference on Indicators of Children's Well-Being, Washington, D. C. , November 17, 1994.

How to display data badly. SIAM Annual Teachers' Day Workshop, Philadelphia, PA, July 9, 1994.

NAEP and Hawaii. Invited address to the Hawai'ian State Department of Education. Honolulu, Hawai'i, February 17, 1994.

Understanding graphs and tables. . Annual Malcolm James Ree invited lecture at the Air Force's Armstrong Laboratories in San Antonio, Texas, August 18, 1993.

Understanding graphs and tables. Annual Meeting of the Statistical Society of Canada. Nova Scotia, Canada, June 5, 1993

Understanding graphs and tables. Statistics and Operations Research Seminar, Department of Civil Engineering and Operations Research, Princeton University. Princeton, NJ, November 17, 1992.

Understanding graphs and tables. Hawaii State Department of Education, Honolulu, HI, February 10, 1992.

Measurement problems. Department of Educational Psychology, University of Hawaii, Honolulu, HI, February 10, 1992.

Understanding graphs and tables. Department of Psychology, Villanova University, December 6, 1991.

Graphical visions. Keynote address for Division D of the American Educational Research Association Meeting, Chicago, IL, April 4, 1991.

Eelworms, bulletholes & Geraldine Ferraro. Department of Ecology, Rutgers University, March 4, 1991.

Test results, self-selection and public policy. Keynote Speaker at Hawaiian Educational Association Meeting, Honolulu, HI, January 19, 1991.

At the Hebrew University in Jerusalem, under the sponsorship of Israel's National Institute for Testing & Evaluation - February 1990.

"How to display data badly"

"Effective display: 1. Tables"

"Effective display: 2. Graphs"

"Effective display: 3. Multivariate data"

"Eelworms, bulletholes & Geraldine Ferraro: Drawing inferences from self- selected samples"

"Testlets: An idea whose time has come"

"Four potholes on the road to a CAT version"

Page - 34 !//#

"DIF & DAF: A review of statistically optimal model-based methods for the study of differential item and alternative functioning"

"The first four millennia of mental testing"

"The future of item analysis"

"The Isthmus of acceptance: A new tool for test construction"

How to display data badly. Featured speaker at National Education Association Workshop for Researchers, San Antonio, TX, November 29, 1989.

How to display data badly. Featured speaker at National Education Association Summer Workshop for State Association Leaders, Sun Valley, ID, July 13, 1989.

Workshop on "Effective display of information," Office of Energy Information, Washington, DC, September 22-23, 1988.

How to display data effectively. American Demographics Institute, Washington, DC, September 15, 1988. (This was videotaped by PBS and broadcast in May 1989. )

Workshop on effective data display. Conference on Human Factors in Computing Systems. Washington, DC, May 15-16, 1988.

Workshop on effective data display. Ralston Purina Company, St. Louis, MO, May 5-6, 1988.

How to display data badly. The United Way, Los Angeles, CA, February 23, 1988.

Eelworms, bulletholes and Geraldine Ferraro: Some problems in adjusting for survey nonresponse. The East-West Demographic Center, Honolulu, HI, February 2, 1988.

Workshop on effective data display. University of North Carolina, Greensboro, NC, November 12, 1987.

Workshop on effective data display. Berlex Laboratories, Cedar Knolls, NJ: October 29-30, 1987.

How to display data badly. The Wharton School of the University of Pennsylvania, Philadelphia, PA, October 8, 1987.

Some problems in adjusting for survey non-response. Joint ETS-DOD Conference on job per- formance assessment. San Diego, CA, March 12, 1987.

Workshop on effective data display. The American Demographic Institute, Fort Lauderdale, Florida, February 11, 1987.

How to display data badly. Ontario Institute for Studies in Education. Toronto, Canada, November 21, 1986.

How to display data badly. The R. J. Reynolds Tobacco Company, Greensboro, NC, October 20, 1986.

Eelworms, bulletholes and Geraldine Ferraro: Some problems in adjusting for survey nonresponse. The Pennsylvania State University, State College, PA, October 10, 1986.

Page - 35 !//#

Promises and pitfalls of graduate admissions testing in the 21st century. GRE Board Retreat, Boston, MA, June 1986.

The SAT as an educational indicator. National Public Radio interview, March 1986.

Multivariate displays. Northern New Jersey Chapter of the American Statistical Association, Somerville, NJ, March 11, 1986.

Multivariate displays for exploratory analysis. Canadian Statistical Association Meeting, Banff, Alberta, Canada, May 7, 1986.

Eelworms, bullet holes and Geraldine Ferraro: Some problems in statistically adjusting for survey nonresponse. American Demographics Conference, Hollywood, FL, February 13, 1986.

The use of graphics in court: A workshop. Sponsored by the Hawaiian Association of Legal Assistants, Honolulu, HI, January 18, 1986.

How to display data badly. Statistics Canada, Ottawa, Canada, May 2, 1986.

How to display data badly. Department of Psychology, The Johns Hopkins University, Baltimore, MD, March 5, 1986.

How to display data badly. The East-West Demographic Center, Honolulu, HI, January 17, 1986.

Detecting differential item performance with IRT. Joint ETS-DOD Conference on Testing, Princeton, NJ, December 3, 1985.

Multivariate displays from Quipus to Faces. Philadelphia Chapter of the American Statistical Association, Temple University, Philadelphia, PA, November 12, 1985.

Multivariate displays from Quipus to Faces. American Mathematical Association, Rochester, NY, November 8, 1985.

The SAT as a social indicator. A pretty bad idea. University of Chicago, Chicago, IL, October 27, 1985.

Effective communication of quantitative information. Maryland State Test Directors, Ocean City, MD, October 4, 1985.

Some ways of looking at multivariate data (and some ways that they can look back). Annual meeting of the American Statistical Association, Las Vegas, August 1985.

How to display data badly. 31st Conference on the Design of Experiments in Army Research, Madison, WI, October 17-18, 1985.

How to display data badly. Cornell University, Department of Statistics, Ithaca, NY, September 25, 1985.

How to display data badly. NBC, Research Division, New York, NY, June 4, 1985.

How to display data badly. Bell Atlantic, Washington, DC, March 26, 1985.

How to display data badly. Department of Mathematics, Rochester Institute of Technology, Rochester, NY, November 14, 1984.

Page - 36 !//#

How to display data badly. General Foods, Cranbury, NJ, November 8, 1984.

How to display data badly. University of Manitoba, Department of Psychology, Winnipeg, Canada, November 29, 1984.

How to display data badly. Princeton University, Center for Energy and Environmental Studies, October 2, 1984.

How to display data badly. General Foods, Cranbury, NJ, November 29, 1984.

On multivariate display. General Foods, Cranbury, NJ, November 29, 1984.

Dynamic displays. General Foods, November 8, 1984.

The SAT as a social indicator. Interagency Conference on Child and Family Statistics, April 1984.

How to display data badly. AT&T, Philadelphia, PA, 1984.

How to display data badly. RCA, Hightstown, NJ, 1984.

Multivariate display. Yale University, New Haven, CT, March 1983.

An exploratory analysis of performance on the SAT. National Science Foundation, Washington, DC, October 1983.

How to display data badly. National Education Association, Washington, DC, October 1983.

How to display data badly. Bureau of the Census, Washington, DC, October 1983.

How to display data badly. Bureau of the Census, Washington, DC, December 1983.

How to display data badly. Bureau of Justice Statistics, Washington, DC, December 1983.

How to display data badly. AT&T, Washington, DC, December 1983.

How to display data badly. RCA, Princeton, NJ, December 1983.

How to display data badly. Department of Statistics, University of Wisconsin, November 1983.

How to display data badly. Department of Statistics, Princeton University, December 1983.

How to display data badly. Graduate School of Business, The University of Chicago, October 1983.

How to display data badly. American Educational Research Association, Annual Convention, Montreal, Canada, April 1983.

How to display data badly. McGill University, April 1983.

How to display data badly. Statistics Day, University of Delaware, April 1983.

Multivariate data display. Abt Associates, Cambridge, MA, March 1981.

How to display data badly. University of Pennsylvania, Philadelphia, PA, January 1983.

How to display data badly. Arizona State University, Tempe, AZ, November 1982.

How to display data badly. Military Testing Association, San Antonio, TX, November 1982.

Page - 37 !//#

How to display data badly. The College of William and Mary, Williamsburg, VA, October 1982.

How to display data badly. The National Center for State Courts, Williamsburg, VA, October 1982.

How to display data badly. American Statistical Association, Cincinnati, OH, August 1982.

How to display data badly. Sieman's Corporation, Princeton, NJ, August 1982.

How to display data badly. Stanford University, Stanford, CA, July 1982.

How to display data badly. Bell Telephone Laboratories, Murray Hill, NJ, July 1982.

How to display data badly. International Business Machines Corporation, New York, July 1982.

Dynamic data display: An exhibition of pictures. A videotape and talk presented at: The National Science Foundation, September 1981; Princeton University, October 1981; Educational Testing Service Technology Fair, November 1981; and the National Institute of Justice, February 1982.

Are newspaper graphs getting fitter to print? Society of Newspaper Designers, Miami, November 1981.

Pyramid power: Searching for an error in test scoring with 830,000 helpers. The University of Chicago, October 1981.

Are we correcting for guessing in the wrong direction? The Military Testing Association, Washington, DC, October 1981.

Graphical data analysis. The Université de Montreal, April 1981.

Robust estimation in test models: Some epistemological questions. The Université de Montreal, April 1981.

Testing and test theory: Whither and whence. Educational Testing Service, Washington, DC, January 9, 1981.

The role of computers in the future of testing. National Public Radio interview, December 1980.

Multivariate data display: The "worst American state" as an example. European Meeting of the Psychometric Society, Groningen, The Netherlands, June 1980.

Robust estimation in latent trait models. Department of Psychology and the Institute for Human Development, University of California, Berkeley, January 8, 1980.

Multivariate data display. Department of Psychology and the Institute for Human Development, University of California, Berkeley, January 7, 1980.

Making newspaper graphics fit to print. Annual meeting of the American Association for the Advancement of Science, San Francisco, January 8, 1980.

Multivariate displays: Some methods and some examples. Department of Psychology, McGill University, November 5, 1979.

Making newspaper graphics fit to print. Montreal Chapter of the American Statistical Association, November 6, 1979.

Page - 38 !//#

Robust estimation of ability in the Rasch model. The Psychometric Society Meetings, Monterey, CA, June 8, 1979.

Robust estimation of ability in the Rasch model. The 1979 Computerized Adaptive Testing Conference, Minneapolis, MN, June 27-30, 1979.

Making newspaper graphs fit to print. Processing of Visible Language II, Niagara-on-the-Lake, September 3-7, 1979.

Graphical display. The University of Kansas, Department of Psychology, December 1978.

Graphical display. The University of Colorado, Institute of Behavioral Science, December 1978.

Graphical display. European Mathematical Psychology Association, Uppsala, Sweden, June 12, 1978.

Graphics, graphicacy and graphitti. Department of Psychology, University of Maryland, October 25, 1977.

Graphics, graphicacy and graphitti. Department of Psychology, Johns Hopkins University, October 21, 1977.

Graphics and graphicacy: Whither and whence. Department of Psychology, McGill University October 14, 1977.

Robust statistics: A survey and some prescriptions. Fourth Delaware Symposium on Curriculum, Learning and Instruction, June 10, 1977.

Graphical and tabular display: How and why. The Board of Directors of The National Assessment Centers for Crime and Delinquency, May 9, 1977.

One dimensional clustering. Citadel Invitational Conference on Clustering, March 25, 1977.

Graphics and graphicacy: Whither and whence. Educational Testing Service, March 30, 1977.

Graphics, graphicacy: Whither and whence. National Institute of Education, January 24, 1977.

Robust statistics: An introduction. Annual meeting of the Mathematical Psychology Group, New York, September 1, 1976.

Assessing the efficacy of visual displays. Symposium on Visual Displays for Social Science Data, Annual Meeting of the American Statistical Association, Boston, August 24, 1976.

Rorschach revisited: A new look at an old test. Symposium on Psychiatric Classification, joint meeting of the Psychometric Society and Classification Society, Iowa City, April 25, 1974.

Predicting individual voting behavior in the U. S. Senate. Seminar on Mathematical Models of Congress, Aspen, CO, June 16-23, 1974.

Foretelling the future: The use of multivariate statistics for the prediction of upcoming events. Summer Seminar in Multivariate Statistics, Jarvsø, Sweden, June 10, 1974.

Discussant in a symposium on exploratory data analysis. American Association for the Advancement of Science Convention, Washington, DC, December 27, 1972.

Page - 39 !//#

Senatorial decision making. University of Chicago School of Business-Research Colloquium, November 10, 1972.

Page - 40 !//#

HOWARD WAINER

Dr. Wainer received his Ph. D. from Princeton University in 1968. After serving on the faculty of the University of Chicago, a period at the Bureau of Social Science Research during the Carter Administration, and 21 years as Principal Research Scientist in the Research Statistics Group at Educational Testing Service, he is now Distinguished Research Scientist at the National Board of Medical Examiners and Professor (adjunct) of Statistics at the Wharton School of the University of Pennsylvania..

Dr. Wainer has a long-standing interest in the use of graphical methods for data analysis and communication, robust statistical methodology, and the development and application of generalizations of item response theory. His work on testlet response theory has combined all three. His latest book , The second watch: Navigating an uncertain world. (Princeton University Press) is scheduled to be published at the beginning of 2009.

Dr. Wainer was elected a Fellow in the American Statistical Association in 1985 and a Fellow of the American Educational Research Association in 2009. He was awarded the Educational Testing Service's Senior Scientist Award in 1990 and selected for the Lady Davis Prize and was named the Schonbrun Visiting Professor at the Hebrew University in 1992. He received the 2006 National Council on Measurement in Education Award for Scientific Contribution to a Field of Educational Measurement for his development of Testlet Response Theory and given NCME’s career achievement award in 2007, and he received the Samuel J. Messick Award for Distinguished Scientific Contributions Award from Division 5 of the American Psychological Association in 2009 as well as being named a Fellow in the American Educational Research Association and was included in Who’s Who in America, 2009.

He was on the editorial board of Psychological Methods and the editor of the Journal of Educational and Behavioral Statistics from 2002 until 2004 and is a former Associate Editor of the Journal of the American Statistical Association, and Applied Psychological Measurement as well as a former Treasurer of the Psychometric Society. Since 1990 he has written a popular column on data visualization in the statistics magazine Chance; he also swam the English Channel.

Among the books he has published are:

Picturing the Uncertain World: How to Understand, Communicate and Control Uncertainty through Graphical Display . Princeton, NJ: Princeton University Press, 2009.

Testlet Response Theory: Theory and Applications (with E. Bradlow & X. Wang). New York: Cambridge University Press, 2007

Graphic Discovery: A Trout in the Milk and Other Visual Adventures. Princeton, N.J.: Princeton University Press, 2005.

The Commercial and Political Atlas, Representing, by means of Stained Copper-Plate Charts, The Progress of the Commerce, Revenues, Expenditure, and Debts of England, during the whole of the Eighteenth Century, by William Playfair. Edited and introduced by Howard Wainer and Ian Spence. New York: Cambridge University Press, 2005.

Page - 41 !//#

The Statistical Breviary; Shewing on a Principle entirely new, the resources of every state and kingdom in Europe; illustrated with Stained Copper-Plate Charts, representing the physical powers of each distinct nation with ease and perspicuity by William Playfair. Edited and introduced by Howard Wainer and Ian Spence. New York: Cambridge University Press, 2005.

Test Scoring. (with D. Thissen) . Hillsdale, NJ: Lawrence Erlbaum Associates, 2001.

Computerized Adaptive Testing: A Primer, 2nd edition (with N. Dorans, D. Eignor, R. Flaugher, B. Green, R. Mislevy, L. Steinberg & D. Thissen) Hillsdale, N. J. : Lawrence Erlbaum Associates, 2000.

Visual Revelations: Graphical Tales of Fate and Deception from Napoleon Bonaparte to Ross Perot. New York: Copernicus Books, 1997. Reprinted in 2000 by Lawrence Erlbaum Associates: Hillsdale, NJ.

Differential Item Functioning (with P. W. Holland). Hillsdale, NJ: Lawrence Erlbaum Associates, 1993.

Computerized adaptive testing: A primer. Hillsdale, NJ: Lawrence Erlbaum Associates, 1990.

Test Validity. (with H. Braun) Hillsdale, NJ: Lawrence Erlbaum Associates, 1988.

Drawing inferences from self-selected samples. New York: Springer-Verlag, 1986. Reprinted in 2000 by Lawrence Erlbaum Associates: Hillsdale, NJ.

Principals of modern psychological measurement. (with S. Messick) Hillsdale, NJ: Lawrence Erlbaum Associates, 1983.

Predicting adult stature for individuals. (with A. F. Roche & D. Thissen) Basel: Karger 1975.

Skeletal maturity. (with A. F. Roche & D. Thissen) New York: Plenum, 1975.

Some selected other publications are:

14 conversations about 3 things. Journal of Educational and Behavioral Statistics, 33, xxx-xxx, 2008.

Until Proven Guilty: False Positives and the War on Terror . (With S. Savage), Chance, 21(1), xx-xx, 2008.

A Psychometric Cicada: Educational Measurement returns. Educational Researcher, 36(8), 485-486.

A Bayesian method for studying DIF: A cautionary tale filled with surprises and delights (with E. Bradlow, X. Wang, & E. Muller). Journal of Educational and Behavioral Statistics, 32, xxx-xxx, 2007.

A Catch-22 in assigning primary delegates (With A. Gelman), Chance, 20(4), 6-7, 2007

Improving data displays: ours and the media’s, Chance, 20(3), 8-16, 2007

The most dangerous equation. American Scientist, 95(3), 249-256, 2007.

Galton’s normal is too platykurtic. Chance, 20(2), 57-58, 2007

Page - 42 !//#

Insignificant is not zero: Rescoring the SAT as an example. Chance, 20(1), 55-58, 2007.

Value-Added Assessment (with Henry Braun). In Handbook of Statistics (Volume 27) Psychometrics (Eds C. R. Rao and S. Sinharay). Elsevier Science, Amsterdam. 2007, pages 867-892.

Three statistical paradoxes in the interpretation of group differences: Illustrated with medical school admission and licensing data (with Lisa Brown). Chapter 26 in the Handbook of Statistics (Volume 27) Psychometrics (Eds C. R. Rao and S. Sinharay). Elsevier Science, Amsterdam. 2007, pages 893-918.

William Playfair and his graphical inventions (with I. Spence). The American Statistician, 59(3), 224-229, 2005.

Old Mother Hubbard and the United Nations: An adventure in exploratory data analysis.. (with discussion) (with D. Vasilescu). Chance,18(3), 38-45, 2005.

Truth is slower than fiction: Francis Galton as an illustration (with B. Clauser). Chance,18(4), 52-54, 2005.

Shopping for colleges when what we know ain’t. Journal of Consumer Research, 32(3), 337-342, 2005.

Two statistical paradoxes in the interpretation of group differences: Illustrated with medical school admission and licensing data (with L. Brown). The American Statistician, 58, 117-123, 2004

A general Bayesian model for testlets: Theory and applications (with X. Wang & E. Bradlow). Applied Psychological Measurement, 26(1), 109-128, 2002.

Statistical Graphics: Mapping the Pathways of Science (with P. Velleman). The Annual Review of Psychology, 52, 305-335, 2001.

Using a New Statistical Model for Testlets to Score TOEFL. (with X. Wang). Journal of Educational Measurement, 37, 203-220, 2000.

Testing the disabled: Using statistics to navigate between the Scylla of standards and the Charybdis of court decisions. Chance, 13(2), 42-44, 2000.

Cholera, Rocket Ships and Tom's Veggies: Contemporary and historical ideas toward the effective communication of school performance. Evaluation and Research in Education, 14, 148-180, 2000.

A Bayesian random effects model for testlets (with E. T. Bradlow and X. Wang). Psychometrika, 64, 153-168, 1999.

Depicting error. The American Statistician, 50(2) , 101-111, 1996.

On examinee choice in educational testing. (with D. Thissen). Review of Educational Research, 64, 159-195, 1994.

Page - 43 !//#

Measurement problems. Journal of Educational Measurement, 30, 1-21, 1993. Reprinted in D. Laveault, B. D. Zumbo, M. E. Gessaroli, & M. W. Boss (Eds. ) Modern theories in measurement: Problems and issues. Ottawa: University of Ottawa Press. pps. 375-407, 1995; and in translation as Problèmes de mesure. Mesure et évaluation en éducation, 17(2), 115-146, 1994.

The future of item analysis. Journal of Educational Measurement, 26(2), 191-208, 1989.

Eelworms, bulletholes & Geraldine Ferraro: Some problems with statistical adjustment and some solutions. (with discussions) Journal of Educational Statistics, 14, 121-140, 1989. Reprinted in J. P. Shaffer (Ed.), The role of models in nonexperimental social science, pp. 129-148. Washington, DC: American Educational Research Association & American Statistical Association, 1992.

Item clusters and computerized adaptive testing: A case for testlets. (with G. Kiely) Journal of Educational Measurement, 24, 185-202, 1987.

XTREE: A multivariate graphical icon applicable in the evaluation of statistical estimators. (with D. Thissen) The American Statistician, 40, 149-153, 1986.

How to display data badly. The American Statistician, 38, 137-147, 1984.

Pyramid power: Searching for an error in test scoring with 830,000 helpers. The American Statistician, 37, 87-91, 1983.

An empirical inquiry into human understanding of “Two Variable Color Maps. ” (with C. Francolini), The American Statistician, 34, 81-93, 1980.

The suspended rootogram and other visual displays: An empirical validation. The American Statistician, 28, 143-145, 1974.

Graphical data analysis. (with D. Thissen) In M. R. Rosenzweig & L. W. Porter (Eds. ), Annual review of psychology (pp. 191-241). Palo Alto, CA: Annual Reviews, 1981.

Robust estimation of ability in the Rasch model. (with B. D. Wright) Psychometrika, 45, 373-391, 1980.

Estimating coefficients in linear models: It don't make no nevermind. Psychological Bulletin, 83, 213-217, 1976.

Three steps toward robust regression. (with D. Thissen) Psychometrika, 41, 9-34, 1976.

Multivariate semi-metric smoothing in multiple prediction. (with D. Thissen). Journal of the American Statistical Association, 70, 568-573, 1975.

(and about 300 others)

Also see http://www.statlit.org/Wainer.htm

Page - 44 !//#

Recommended publications