Improving Pre-Major Orientation With Canvas Alexander Deeke Digital Learning Librarian [email protected] Diana Perpich Educational Technologies Librarian [email protected] Outline 1. Background, Stakeholders & Timeline 2. Pilot & Lessons Learned 3. Fall 2017 Launch 4. Benefits, Canvas Features & Analytics 5. Next Steps 6. Questions Follow the presentation at tinyurl.com/CanvasPreMajor Background ● Heavy teaching load for Psychology Librarian ● U-M student library experience ○ No required research or library course ○ Different experiences from high schools ● Consistent and scaffold approach to library instruction ○ Every psychology major familiar with library before upper level classes A Partners & Stakeholders ● Students ● Librarians ● Psychology Faculty ● Psychology Advising ● Information Technology Services (ITS) A Project Timeline SEPT 2015 JAN 2016 JAN 2017 MAY 2017 SEPT 2017 JAN 2018 Begin Content Content Pilot Launch as Mid-year conversation development validation PSYCH 112 requirement review Identify Review of f2f Multiple Modules imported Embed in Students served, challenges and materials and iterations and into course site, pre-major question explore lesson plans sign-offs. students expected orientation analysis. to complete opportunities for workflow, Technical review. collaboration. Early iterations Student UX and students accessibility. self-enroll A Lessons Learned (Pilot) Question Types ● Zero point short answer questions require instructor “score” ● Can’t retake until graded Course Gradebook ● Practice quizzes are private, must award credit to see scores Student Management ● Student data spread across multiple course section/sites ● Some psych majors don’t take intro class (e.g. AP credit) ● Some intro students aren’t psych majors (or decide later) D Easy Fixes Question Types ● Multiple choice only; complex prompts and options Course Gradebook ● Graded quizzes, low stakes, no retake Student Management ● Single Canvas site ● Self-enroll, with required progression through modules D The Bigger Picture Wasn’t Pretty D Re-aligning the Partnership Engage dept office staff, IT support, and advising in proposal ● goal to improve student experience, reduce admin load ● by consolidating activities in one Canvas site Deliver QUICK, clean, complete solution (4 hours) ● cede edit permissions and final design decisions to dept staff ● big picture reset Dept staff take ownership of project D Launch - Fall 2017 D Launch - Fall 2017 D Psychology Stakeholder Benefits Students ○ Anticipated: better prepared for upper-level psych research assignments ○ Long-term access to resources Advising & Office Staff ○ fewer systems to learn and use; fewer data sources Instructors & Curriculum Coordinators ○ Course gradebook not affected by quizzes ○ Reliable, easy to locate resource for review and reference A Stakeholder Benefits Librarians ● Centralized data and version control for intro modules ● Psychology librarian can scaffold library instruction ● Model to partner with other departments UM-ITS (Information & Technology Services) ● Model Implementation : Departmental Sites ● Proof of concept : Advanced Analytics A Mid Year Review ● 211 students enrolled Fall 2017 ○ 86% completion rate - final quiz ● Quiz statistics difficult to use to measure learning ● Question analysis ● No technical issues reported A Analytics Questions we hope(d) analytics could help us answer : ● Can students demonstrate knowledge and application of library skills in psychology research? ● How much time are they putting in learning the material? ● What time of the term is best to offer certain kinds of instructional opportunities and/or support? D Viewing Progress in Canvas D Viewing Progress via Data Warehouse Tableau workbook table displaying Psych modules data queried from the UNIZIN Data Warehouse. UM-ITS Teaching and Learning, J. Ziegler and J. Love. D Time Spent & Progress Dates in Canvas “If the time between a new activity and the last completed activity is under ten minutes, all time between these two events will also be included.” D Progress Dates via Data Warehouse Tableau workbook table displaying Psych modules data queried from the UNIZIN Data Warehouse. UM-ITS Teaching and Learning, J. Ziegler and J. Love. D Proof of Concept SQL select mpd.canvas_id, md.name, ud.name, mpd.workflow_state, md.require_sequential_progress as requires_sequential_progress, mpd.current_position, mpd.lock_version, mpd.completed_at from module_progression_dim mpd inner join user_dim ud on ud.id = mpd.user_id inner join module_dim md on md.id = mpd.module_id where mpd.module_id in (17700000000053832, 17700000000053831, 17700000000054406, 17700000000054407, 17700000000054408, 17700000000054409, 17700000000054410, 17700000000054411) /* Specify the modules on the course */ and ud.name not in ('Test Student', 'Kaydee Fry', 'Alex Deeke', 'Naomi Marie Binnie', 'Saroya Cicero', 'Diana Perpich’) /* Remove instructors and test users */ order by md.name, mpd.completed_at, ud.name ; D Next Steps ● Pre/Post tests and Master Paths ● Question Pools ● Kaltura and quiz for departmental video ● Measure learning and retention ○ Learning boosters, analytics on return visits ○ PSYCH 303 follow-up A Questions? Contact Us Alexander Deeke Digital Learning Librarian [email protected] Diana Perpich Educational Technologies Librarian [email protected].