Sunday, March 30, 2014 NARST 2014 Annual International Conference Abstracts Sunday, March 30, 2014 Pre-Conference Workshop—Equity and Ethics Committee Sponsored (Free – 60 participants max) Awakening Dialogues: Advancing Science Education, Research, Practices and Policies as Equity Researchers 8:00am – 12:00pm, King’s Garden 4 Organizers: Felicia Moore Mensah, Teachers College, Columbia University Jerome Shaw, University of California, Santa Cruz Deborah Roberts-Harris, University of New Mexico Deborah Morrison, University of Colorado at Boulder Leon Walls, University of Vermont ABSTRACT: The Equity and Ethics Committee sponsors this annual pre-conference workshop for scholars of color and individuals interested in scholarship involving equity and social justice in science education. This year participants will engage in critical dialogue about advancing science education research, practices, and policies that affect the work of equity-minded scholars in science education. Workshop participants will network with facilitators representing the spectrum of various career stages and research interests. Along with eminent scholars in the field, participants will have the opportunity to dialogue and learn how to promote equity research within an ever-changing political arena that impacts our work as equity scholars. Pre-Conference Workshop—Publications Advisory Committee (Free – 50 participants max) Developing High Quality Reviews for the Journal of Research in Science Teaching 8:00am – 12:00pm, Commonwealth 2 Presenters: Joseph S. Krajcik, Michigan State University Angela M. Calabrese Barton, Michigan State University ABSTRACT: The purpose of this preconference workshop is to provide professional development for JRST reviewers. It will also provide valuable information to new researchers on what reviewers look for in a manuscript and how to prepare a manuscript for publication. During this 4-hour workshop we will work with reviewers to develop knowledge and skills for preparing high quality reviews for JRST, foster conversation on expectations for and purposes of reviews, and discuss how to handle common reviewer problems and questions. This session welcomes returning reviewers as well as those who are new to academia and are interested in submitting to and getting published in JRST or anyone who would like to become a reviewer for the Journal. JRST Editors and Associate Editors will facilitate the session. Pre-Conference Workshop—Research Committee (Free – 50 participants max) Writing Competitive Proposals for Programs in NSR’s Division on Research on Learning in Formal and Informal Settings 8:00am – 12:00pm, Rivers Presenters: David L. Haury, National Science Foundation Celestine H. Pea, National Science Foundation Ellen McCallie, National Science Foundation ABSTRACT: Through DRL’s programs, the National Science Foundation supports innovative research, development, and evaluation of learning and teaching across all STEM disciplines. This workshop will help participants understand the missions and priorities of DRL’s programs and provide guidance in writing competitive, high quality proposals. The workshop is structured to include opportunities for collaborative work, discussion, and questions. The content of the workshop includes: 1) the contexts of STEM educational research in DRL; 2) characteristics of and significant changes in DRL’s major programs, including Research on Education and Learning (REAL; formerly REESE), Advancing Informal Science Learning (AISL; formerly ISE); Discovery Research K-12 (DRK-12), Promoting Research and Innovation in 1 | NARST ABSTRACTS Sunday, March 30, 2014 NARST 2014 Annual International Conference Abstracts Methodologies for Evaluation (PRIME), Innovative Technology Experiences for Students and Teachers (ITEST) and Faculty Early Career Development (CAREER); 3) NSF’s proposal review process and merit review criteria; 4) hands-on experience refining proposal concepts; (5) characteristics of competitive proposals; and 6) common weaknesses in poorly- rated proposals. Both novice and experienced researchers are encouraged to attend and join in the discussions. Participants are also encouraged to bring proposal concepts and letters of interest for discussion. Pre-Conference Workshop—Research Committee (Free – 50 participants max) Developing and Validating Learning-Progression-Based Written Assessments 8:00am – 12:00pm, King’s Garden 3 Presenters: Karen Draney, University of California, Berkeley Jenniger H. Doherty, Michigan State University Charles W. Anderson, Michigan State University ABSTRACT: Participants will practice strategies for developing learning progression-based written assessment systems with attention to reliability, validity, and efficiency. Activities in the workshop will include all stages in a design, development, and evaluation cycle. Specific goals include: 1. Participants will evaluate constructed response items according to Learning Progression Item Design Criteria. 2. Participants will evaluate item scoring guides according to Learning Progression Scoring Guide Design Criteria. 3. Participants will discuss strategies for training coders and scoring assessments in reliable and efficient ways. 4. Participants will use response data to evaluate items with respect to different types of validity evidence, including difficulty, discrimination, fit to model, and match to other evidence about students’ reasoning (clinical interview transcripts). 5. Participants will evaluate revisions in learning progression frameworks for qualities that support reliable, valid, and efficient written assessments. Pre-Conference Workshop—Research Committee (Free – 50 participants max) Toward Coherence in Quantitative Research Practices in Science Education 8:00am – 12:00pm, King’s Garden 1 Presenters: Joesph Taylor, BSCS Susan Kowalski, BSCS Molly Stuhlsatz, BSCS Christopher Wilson, BSCS ABSTRACT: This workshop will explore current statistical and psychometric practices in science education research and how themes in these practices may facilitate or inhibit knowledge growth in the field. Workshop facilitators will draw on their own meta-analytic research as well as the synthetic work of other science education researchers. In this interactive workshop, participants will learn about and apply recommended statistical and psychometric tests and reporting practices by working with real data and interpreting real output from statistical analyses. Pre-Conference Workshop—Research Committee ($50 – 30 participants max) Building Knowledge Base for NGSS by Fostering Partnerships between Research and Practice 8:00am – 12:00pm, King’s Garden 2 Presenters: Bill Penuel, University of Colorado Boulder Ted Willard, National Science Teachers Association Dan Gallagher, Seattle Public Schools Kevin Crowley, University of Pittsburgh Jennifer Russell, University of Pittsburgh Tana J. B. Peterman, University of Washington 2 | NARST ABSTRACTS Sunday, March 30, 2014 NARST 2014 Annual International Conference Abstracts Philip Bell, University of Washington Deborah L. Hanuscin, University of Missouri-Columbia Seattle Area Teachers and Pittsburgh Area Practitioners Spanning Formal and Informal Sectors ABSTRACT: This workshop, co-facilitated by science education researchers, a NSTA program director, and a district science coordinator, will provide guidance to researchers and practitioners about how to develop joint projects to fill gaps in knowledge needed to implement the Next Generation Science Standards successfully. The workshop will provide participants with concrete strategies for: (1) identifying persistent problems of practice from both practitioners’ and stakeholders’ perspectives, (2) developing a collaborative design process that leverages the expertise of practitioners, researchers, subject matter experts in science, and other stakeholders, and (3) formulating design goals that foreground supports for implementation, equity, and diversity. Pre-Conference Workshop—NSTA and NARST (Free – 40 participants max) Communicating Research to Teachers, Administrators, and Policy Makers 8:00am – 12:00pm, King’s Garden 2 Presenters: Deborah L. Hanuscin, University of Missouri-Columbia Kate Scantlebury, University of Delaware David Beacom, National Science Teachers Association Al Byers, National Science Teachers Association ABSTRACT: This workshop focuses on providing NARST members writing strategies to publish their research in NSTA journals, newspaper and other forms of communication. 3 | NARST ABSTRACTS Sunday, March 30, 2014 NARST 2014 Annual International Conference Abstracts Concurrent Session #1 1:00pm – 2:30pm External Policy and Relations Committee Sponsored Session Symposium – Bridging the Policy-Research Divide: Practical Strategies for Science Education Researchers 1:00pm-2:30pm, Commonwealth 2 Presider: Todd Hutner Discussants: John Settlage, University of Connecticut, [email protected] Darleen Opfer, RAND Education Karen Lionberger, The College Board Michelle D. Young, University of Virginia ABSTRACT: Many science educators are frustrated by educational policy that ignores research findings. Perhaps the frustration is evidence of a general failure to make research accessible and informative. This session will address mechanisms by which educational policy is developed. Experts from various organizations will describe their work and the potential for contributions by science education researchers. Central to this discussion will be examining ways in which information can be packaged. A better understanding