2016 Training Sessions April 7-8 2016 Annual Meeting April 9-11 2016 PROGRAM
Total Page:16
File Type:pdf, Size:1020Kb
2016 Training Sessions April 7-8 2016 Annual Meeting April 9-11 Renaissance Washington, DC Downtown Hotel Washington, DC ©Thinkstock 2016 PROGRAM National Council on Measurement in Education Foundations and Frontiers: Advancing Educational Measurement for Research, Policy, and Practice 2016 Training Sessions April 7-8 2016 Annual Meeting April 9-11 Renaissance Washington, DC Downtown Hotel Washington, DC #NCME16 Washington, DC, USA Table of Contents NCME Board of Directors . 4 Proposal Reviewers . 6 Future Meetings . 7 Renaissance Washington, DC Downtown Hotel Meeting Room Floor Plans . 8 Training Sessions Thursday, April 7 . 13 Friday, April 8 . 23 Program Saturday, April 9 . 37 Sunday, April 10 . 95 Monday, April 11 . 139 Index . 185 Contact Information . 197 Schedule-at-a-Glance . 215 Foundations and Frontiers: Advancing Educational Measurement for Research, Policy, and Practice 3 2016 Annual Meeting & Training Sessions NCME Officers President Richard J . Patz ACT, Iowa City, IA Vice President Mark Wilson UC Berkeley, Berkeley, CA Past President Lauress Wise HUMRRO, Seaside, CA NCME Directors Amy Hendrickson The College Board, Newtown, PA Kristen Huff ACT, Iowa City, IA Luz Bay The College Board, Dover, NH Won-Chan Lee University of Iowa, Iowa City, IA Cindy Walker University of Wisconsin-Milwaukee, Milwaukee, WI C Dale Whittington Shaker Heights (OH) Public Schools, Shaker Heights, OH 4 Washington, DC, USA Editors Journal of Educational Jimmy de la Torre Measurement Rutgers, The State University of NJ, New Brunswick, NJ Educational Measurement Dr . Howard Everson Issues and Practice SRI International, Menlo Park, CA NCME Newsletter Heather M . Buzick Educational Testing Service, Princeton, NJ Website Content Editor Brett Foley Alpine Testing Solutions, Denton, NE 2016 Annual Meeting Chairs Annual Meeting Program Chairs Andrew Ho Harvard Graduate School of Education, Cambridge, MA Matthew Johnson Columbia University, New York, NY Graduate Student Issues Brian Leventhal Committee Chair University of Pittsburgh, Pittsburgh, PA Training and Development Xin Li Committee Chair ACT, Iowa City, IA Fitness Run/Walk Directors Katherine Furgol Castellano ETS, San Francisco, CA Jill R . van den Heuvel Alpine Testing Solutions, Hatfield, PA NCME Information Desk The NCME Information Desk is located on the Meeting Room Level in the Renaissance Washington, DC Downtown Hotel . Stop by to pick up a ribbon and obtain your bib number and tee-shirt for the fun run and walk . It will be open at the following times: Thursday, April 7 . 7:30 AM-4:30 PM Friday, April 8 . 8:00 AM-4:30 PM Saturday, April 9 . .10:00 . AM-4:30 PM Sunday, April 10 . 8:00 . AM-1:00 PM Monday, April 11 . 8:00 AM-1:00 PM 5 2016 Annual Meeting & Training Sessions Proposal Reviewers Terry Ackerman Steve Culpepper Won-Chan Lee* Michael Rodriguez Benjamin Andrews Mark Davison Dongmei Li Sandip Sinharay Robert Ankenmann Jimmy de la Torre Jinghua Liu Steve Sireci Karen Barton John Donoghue Skip Livingston Dubravka Svetina Kirk Becker Jeff Douglas JR Lockwood* Ye Tong* Anton Beguin Michael Edwards Susan Loomis Anna Topczewski Dmitry Belov Karla Egan* Krista Mattern Peter van Rijn Tasha Beretvas Kadriye Ercickan Andy Maul* Jay Verkuilen Jonas Bertling Steve Ferrara Dan McCaffrey Alina von Davier Damian Betebenner Holmes Finch* Katie McClarty Matthias von Davier Dan Bolt Mark Gierl Catherine McClellan Michael Walker Laine Bradshaw Brian Habing Patrick Meyer Chun Wang Henry Braun Chris Han Paul Nichols Jonathan Weeks Robert Brennan Mark Hansen Maria Oliveri Cathy Wendler Brent Bridgeman Deborah Harris Andreas Oranje Andrew Wiley Derek Briggs* Kristen Huff* Thanos Patelis Steve Wise Chad Buckendahl Minjeong Jeon Susan Philips Duanli Yan Li Cai* Hong Jiao Mary Pitoniak John Young Wayne Camara Matt Johnson John Poggio April Zenisky* Katherine Furgol Daniel Jurich Sophia Rabe- Castellano Seock-Ho Kim Hesketh Ying Cheng Jennifer Kobrin Mark Reckase Chia-Yi Chiu Suzanne Lane Frank Rijmen * Indicates Expert Panel Chairperson 6 Washington, DC, USA Graduate Student Abstract Reviewers Lokman Akbay Emily Ho Mary Norris Min Wang Beyza Aksu Landon Hurley Nese Ozturk Ting Wang Abeer Alamri Charlie Iaconangelo Robyn Pitts Xiaolin Wang Bruce Austin Andrew Iverson Ray Reichenberg Diah Wihardini Elizabeth Barker Kyle Jennings Sumeyra Sahbaaz Elizabeth Williams Diego Luna Bazaldua HeaWon Jun Tyler Sandersfeld Immanuel Williams Masha Bertling Susan Kahn Can Shao Dawn Woods Lisa Beymer Jaclyn Kelly Benjamin Shear Kuan Xing Mark Bond Brian Leventhal Jordan Sparks Jing-Ru Xu Nuliyana Bukhari Isaac Li Rose Stafford Menglin Xu Jie Chen Dandan Liao Latisha Sternod Sujin Yang Michelle Chen Fu Liu Myrah Stockdale Ai Ye Yi-Chen Chiang David Martinez- Meghan Sulivan Nedim Yel Shenghai Dai Alpizar Ragip Terzi Hulya Yurekli Tianna Floyd Namita Mehta Stephanie Underhill Oscar Gonzalez Rich Nieto Keyin Wang Future Annual Meeting 2017 Annual Meeting April 26-30 San Antonio, TX 2018 Annual Meeting April 12-16 New York, NY, USA 2019 Annual Meeting April 4-8 Toronto, Ontario, Canada 7 2016 Annual Meeting & Training Sessions Hotel Floor Plans – Renaissance Washington, DC Downtown 8 Washington, DC, USA 9 2016 Annual Meeting & Training Sessions 10 Washington, DC, USA A Message from Your Program Chairs 2016 NCME Program Highlights: Foundations and Frontiers: Advancing Educational Measurement for Research, Policy, and Practice We are pleased to highlight a few of the many excellent sessions that our members have contributed, as well as congratulate our partners at AERA on their centennial celebration . From the very first conference session, at 8:15AM on Saturday, April 9, we’re kicking it off with big-picture topics (Henry Braun leading an invited session for the recent NCME volume: Challenges to Measurement in an Era of Accountability) alongside technical advances (Derek Briggs leading off a session on Learning Progressions for Measuring Growth) . The momentum continues through our last session, at 4:05 on Monday, April 11, where we tackle buzz phrases (Thanos Patelis convening a session on Fairness Issues and Validation of Noncognitive Skills) and settle scores (The Great Subscore Debate, with Emily Bo, Howard Wainer, Sandip Sinharay, and many others facing off to surely resolve the issue once and for all) . We are taking full advantage of our location in Washington, DC, with an invited session on the recently passed Every Students Succeeds Act over lunchtime on Monday . Peter Oppenheim and Sarah Bolton, Education Policy Directors (majority and minority, respectively) for the US Senate HELP Committee will discuss key provisions and spark a discussion among researchers about ESSA’s Implications and Opportunities for Measurement Research and Practice . Earlier that Monday morning, Kristen Huff will convene reporters and scholars in a session with the lively title: Hold the Presses! How Measurement Professionals can Speak More Effectively with the Press and the Public . Consistent with our theme, our many sessions highlight both foundations (Isaac Bejar coordinates a session on Item Response Modeling: From Theory to Practice, while Karla Egan convenes a session on Standard Setting: Beyond Process) and frontiers (Tracy Sweet will lead a session on Recent Advances in Social Network Analysis, and Will Lorie takes on Big Data in Education: From Items to Policies) . Stay up to date at the Twitter hashtag #NCME16 and our new NCME Facebook group . We are confident that you will enjoy the program that you have helped to create here at the 2016 NCME Annual Meeting . Andrew Ho and Matt Johnson 2016 NCME Annual Meeting Co-Chairs 11 2016 Annual Meeting & Training Sessions Pre-Conference Training Sessions The 2016 NCME Pre-Conference Training Sessions will be held at the Renaissance Washington, DC Downtown Hotel on Thursday, April 7 and Friday, April 8 . All full-day sessions will be held from 8:00 AM to 5:00 PM . All half-day morning sessions will be held from 8:00 AM to 12:00 noon . All half-day afternoon sessions will run from 1:00 PM to 5:00 PM . On-site registration for the Pre-Conference Training Sessions will be available at the NCME Information Desk at the Renaissance Washington, DC Downtown Hotel for those workshops that still have availability . Please note that internet connectivity will not be available for most training sessions and, where applicable, participants should download the software required prior to the training sessions . Internet connectivity will be available for a few selected training sessions that have pre-paid an additional fee . 12 Washington, DC, USA Pre-Conference Training Sessions - Thursday, April 7, 2016 13 2016 Annual Meeting & Training Sessions 14 Washington, DC, USA Thursday, April 7, 2016 8:00 AM - 12:00 PM, Meeting Room 6, Meeting Room Level, Training Session, AA Quality Control Tools in Support of Reporting Accurate and Valid Test Scores Aster Tessema, American Institute of Certified Public Accountants; Oliver Zhang, The College Board; Alina VonDavier, Educational Testing Service All testing companies focus on ensuring that the test scores are valid, reliable, and fair . Significant resources are allocated to meet the guidelines of well-known organizations, such as AERA/NCME, and/or The international Test Commission Guidelines (Allalouf, 2007; ITC, 2011) . In this workshop we will discuss traditional QC methods, the operational testing process, and new QC tools for monitoring the stability of scores over time . We will provide participants a practical understanding of: 1 . The importance