The Library Assessment Cookbook edited by Aaron W. Dobbs Association of College and Research Libraries A division of the American Library Association Chicago • 2017 The paper used in this publication meets the minimum requirements of American National Standard for Information Sciences-Permanence of Paper for Printed Library Materials, ANSI Z39.48-1992. ∞ The ACRL Cookbook series was conceived of and designed by Ryan Sittler and Doug Cook. Other books in this series: The Embedded Librarian’s Cookbook edited by Kaijsa Calkins and Cassandra Kvenild The Discovery Tool Cookbook: Recipes for Successful Lesson Plans edited by Nancy Fawley and Nikki Krysak The First-Year Experience Cookbook edited by Raymond Pun and Meggan Houlihan Cataloging-in-Publication data is on file with the Library of Congress. Copyright 2017 by the Association of College and Research Libraries, a division of the American Library Association. All rights reserved except those which may be granted by Sections 107 and 108 of the Copyright Revision Act of 1976. Printed in the United States of America. 21 20 19 18 17 5 4 3 2 1 TABLE OF CONTENTS vii Acknowledgements 24 Potluck Surprise: Assessing Donated Materials xi Preface Jeannine Berroteran 1 Section 1. Data Preparation for Assessment 26 Using Required Readings from Course Syllabi to Show Library Value 1 Kitchen Prep: Getting Ready for Library Assessment and Assess the Collection Emily Guhde Eric Hartnett and Simona Tabacaru 3 Creating a Statistics Report Using Ingredients Already in the Library 28 MAPing Collection Use: Using Massive Analysis Projects for Judy Geczi Collections Analysis Galadriel Chilton, Joelle Thomas, Alice Fairfield, Arta Dobbs, Elisabeth 5 Using Student GPA to Show the “Nutritional Value” of a Library Service Umpleby, and Dawn Cadogan Mitchell Scott 31 Using Baskets and a Rubric to Assess Online Resources in the “Messy 7 Boiling Down Qualitative Data to Build Personas that Inform Spaces, Middle” Services, and Technologies Kathleen Reed, Jean Blackburn, and Dana McFarland Monena Hall and Maurini Strub 33 Annual Database (or General Resource) Evaluation 9 “Stocking the Larder”: Recruiting for Focus Groups and Other Small Ashley Zmau Group Assessments Carol Mollman 35 Harvested IR Metadata Gumbo Courtenay McLeland and Alice Eng 11 Making Project Management Planning and Assessment Planning a Piece of Cake 37 Fad Food or Family Tradition?: Assessing Digital Projects for Long- Susan Payne Term Value Allison Ringness 12 Professional Development Assessment Paella Catherine Sassen, Karen Harker, and Erin O’Toole 39 Rendering Repositories: Taking out the Fat and Getting to the Impact Sian Brannon and Laura Waugh 15 Section 2. Traditional and Online Collections Assessment 41 Flavoring Your E-Resources Collection: The Spice Rack Assessment 17 Creating a Framework for Comprehensive Collection Assessment Amanda Binder and Elizabeth Siler Galadriel Chilton 43 Open Access Citation Analysis 19 Exploratory Collection Assessment: The Subject Snapshot Emily Raymond and Heather Scalf Madeline Kelly 45 Tower Cakes for Ranking Subscription Resources 22 Recipe for Collection Assessment: Mixing Together Key Ingredients to Karen Harker, Todd Enoch, and Laurel Crawford Make a Roux Paula Barnett-Ellis and Charlcie Pettway Vann iii Table of Contents 47 Section 3. Instruction Programs Assessment 74 Word Soup: Using Word Clouds to Assess the One-Minute Paper Maria Barefoot 49 Measuring the Ingredients of a Good Bibliography: A Recipe for Citation Analysis 76 Creating Connoisseurs: Assessing Students’ Ability to Evaluate Karen Kohn and Larissa Gordon Websites Mandi Smith, Jason Smith, Cathy Blackman, and Wensheng Wang 51 Open-Faced Formative Assessment Gina Calia-Lotz 78 Assessment Layer Cake Patricia J. Mileham and Kimberly J. Whalen 53 Cooking with Information Resources in the Online Kitchen Beate Gersch and Joseph A. Salem, Jr. 81 Section 4. Outreach and Programming Assessment 55 Lazy Susan: A Continuous Improvement Cycle of Learning and 83 Shopping for Kitchen Implements? How to Decide If a Library Assessment Program is Useful, Usable, and Desirable Joy Oehlers Joy Oehlers and Joyce Tokuda 57 Information Literacy Assessment Entrée: Using a Reflective Essay to 85 Assessing an Event: Mixin’ It Up with the Long Night Against Assess Course Learning Outcomes Procrastination Stephanie Alexander, Tom Bickley, Gr Keer, Aline Soules, and Diana K. Katherine Penner and Sarah Clark Wakimoto 87 Measuring the Success of Library Outreach to First-Year Student 59 PROTEIN (Peer Review of Teaching: Evaluative Instruction Networks) Athletes Supplements for Librarians Beth Hendrix Jason Vance 89 Planning the Perfect Party: Data for Dessert! 61 The Library Rally Katy Mathuews and Zachary Lewis Michelle J. Gibeault 63 Rubrics as a Method for Assessing & Improving Library Instruction 91 Section 5. Assessments Assessment Megan Hodge, Laura Gariepy, and Jenny Stout 93 Rubrics and Rutabagas: Only One is Useful for Assessing Staff During 65 Slow-Cooked Rubric: Designing and Using a Rubric to Assess Evaluations Undergraduate Final Papers Sian Brannon and Julie Leuzinger Eleanor Johnson and Katie Bishop 95 Cooking Times May Vary: Assessing Student Workflows in the Stacks 67 Cooking up Rubrics to Assess Student Learning Joyce Douglas and Katy Mathuews Marjorie Leta 97 Stop Folding the Dough: Intervening to Decide Whether or Not to 70 How Much Do Good Cooking Methods Affect the Quality of the Assess Again Meal? Sian Brannon Christy Fic and Kirk Moll 99 Recipe for Success: Add a Personal SWOT Analysis to Any Assessment 72 Library Tour Taste Test Project Nancy Noe Faithe Ruiz iv Table of Contents 101 Section 6. Strategic Planning Assessment 131 The Secret Ingredient: Mystery Shopping Your Service Points Candice Benjes-Small and Elizabeth Kocevar-Weidinger 103 Two Birds with One Stone: Using a Survey to Get Employee Feedback and to Educate in the Strategic Planning Process 133 The Missing Piece: Assessing Implementation Fidelity Regina Mays and Peter Fernandez Megan Hodge and Laura Gariepy 105 Strategic Stress Test: Aligning Programs and Services with a Strategic 135 Patron for a Day (PFAD): A Space Assessment Plan Stephanie Hartman and Lisa R. Horowitz Strategic Initiatives Department 137 An Assessment Rubric Inspired by The Four Seasons® 107 Chicken Soup for Digital Scholarship: Assessing Your Next Steps Nathaniel King and Kelly Lutz A. Miller 139 Section 8. Equipment, Building, and Space Assessment 109 Section 7. Service Points and Services Assessment 141 Learning Space Ethnography Study: Observe Students in the Library 111 Service Desk Activity Burrito to Inform Service and Resource Design Heather Scalf and Ali Adil Victoria Raish 113 Who’s at Your Table? Planning for Success through Community 143 Ethnography Study Recipe A: Seating Sweeps Engagement 144 Ethnography Study Recipe B: Field Observations Stefanie Metko 146 Ethnography Study Recipe C: Interviews 148 Ethnography Study Recipe D: Computer-Use Reports 115 Survey System for Measuring Library Outcomes 149 Ethnography Study Recipe E: User Survey Rebecca Bayrer, Dawn Melberg, and Eve Melton 150 Ethnography Study Recipe F: Questions Addressed to Reference Desks 117 Academic Libraries: The Breakfast of Student Champions 151 Ethnography Study Recipe G: Google Analytics Katy Mathuews 119 If We Prepare It, Will They Come Back for More? 152 Interview to the Double: Uncovering Student Motivations in the Adriana Gonzalez and Jason B. Reed Library Kathleen Reed, Cameron Hoffman, and Meg Ecclestone 121 Methods Mash Jennifer Jones 154 Flipchart Surveys Laura Newton Miller 123 Service Assessment with a Side of Secret Shoppers Jennifer Jones 156 Space Invaders: Measuring Use and Satisfaction Through Mixed Methods 125 Healthy Chat Reference Assessment with a Side of Zesty Infographs Susan Gardner Archambault Natalie Haber 158 Assessing Student Learning Behaviors in Informal Learning Spaces 127 Reference Referral Training Stew: The Perfect Assessment Mix Susan Beatty Lisa Vassady and Alyssa Archer 160 Culinary Snapshots: Assessing International Student Needs Through 129 Deconstructing Reference Statistics Photographs Jen-chien Yu Alyssa Berger, Ana Villar, and Danielle Rowland v Table of Contents 162 Don’t Just Count ‘em, Sweep ‘em! 188 Simple Usability Stir Fry Gricel Dominguez Tim Broadwater and Jessica Tapia 164 Library Space Cake Jenny Horton 191 Standards Referenced 166 Decorating the Library Cake: A Space Utilization Study Kellie Meehlhause 169 Section 9. Website and Web Services Assessment 171 Add WebAIM and Stir: Assessing Web Accessibility for Users with Disabilities Laura DeLancey 173 Easy (No-Bake) Online Card Sorting Samantha Rich 175 But This is for the Library: Best Practices for Usability Testing and Library Website Design Sojourna Cunningham, Regina Mays, and Holly Mercer 177 Hear the People Sing: Communicating Usability Results to a Large Library Audience Sojourna Cunningham, Regina Mays, and Holly Mercer 179 Farm to Table: A Recipe for Website Usability Testing on a Budget Tiffany Davis, Jen Park, and Derek Sanderson 181 Assessing Your Library Website with Usability Testing Brighid M. Gonzales 183 Order Takeout: Virtual Usability Testing to Meet Your Users Where They Are Jennifer C. Hill and Anita Norton 186 Lean Usability Testing for Healthy Website Assessment Alex Sundt vi Acknowledgements Acknowledgements Chef Aaron would like to thank this cookbook’s 122 recipe chefs I would also like to thank my wife, Julie, and daughters, Natasha for their eighty assessment recipes. Without these