Tracking and Assessing Practical Chemistry Skills Development: Practical Skills Portfolios
Total Page:16
File Type:pdf, Size:1020Kb
This is a repository copy of Tracking and assessing practical chemistry skills development: practical skills portfolios. White Rose Research Online URL for this paper: http://eprints.whiterose.ac.uk/139848/ Version: Published Version Article: Wright, J.S., Read, D., Hughes, O. et al. (1 more author) (2018) Tracking and assessing practical chemistry skills development: practical skills portfolios. New Directions in the Teaching of Physical Sciences, 13 (1). ISSN 1740-9888 10.29311/ndtps.v0i13.2905 © 2018 The Authors. This work is licensed under a Creative Commons Attribution 4.0 International License (https://creativecommons.org/licenses/by/4.0/). Reuse This article is distributed under the terms of the Creative Commons Attribution (CC BY) licence. This licence allows you to distribute, remix, tweak, and build upon the work, even commercially, as long as you credit the authors for the original work. More information and the full terms of the licence here: https://creativecommons.org/licenses/ Takedown If you consider content in White Rose Research Online to be in breach of UK law, please notify us by emailing [email protected] including the URL of the record and the reason for the withdrawal request. [email protected] https://eprints.whiterose.ac.uk/ 1 COMMUNITY DIRECTIONS Tracking and assessing practical chemistry skills development: practical skills portfolios 1,2 ,3 3 ,1 James S. Wright, David Read* , Oliver Hughes and Julie Hyde* 1Department of Chemistry, University of Sheffield, Brook Hill, Sheffield S3 7HF (UK). 2Guangdong Technion Israel Institute of Technology, Shantou, Guangdong 515063 (PR China) 3School of Chemistry and Centre for Higher Education Practice, University of Southampton, Highfield, Southampton SO17 1BJ (UK) Corresponding Authors: [email protected] & [email protected] Keywords: China; Chemistry; Laboratory; Assessment; Reflection Abstract integral part of this process, given the role of We present the evaluation of the student such skills development in enhancing the response to a novel form of practical employability of science graduates. assessment: the Practical Skills Portfolio (PSP). The PSP is a concise record of a Perhaps the most widely used form of practical activity for the purposes of assessment in practical Chemistry courses is assessment, which prompts students to the post-laboratory write-up, where a script or engage in reflective practice on laboratory scientific report is completed by the student. skills, and provides opportunities for This is, of course, important. Students need to enhanced feedback delivered in a timely write scientific reports to develop their manner. Key goals of this new approach are scientific language skill, and directly to assist students in assimilating the practical assessing their work during a large laboratory skills they are developing during their studies class is logistically difficult. While post- and to support them in developing their ability laboratory reports can, if carefully designed to write the different components of a full (‘constructively aligned’, Biggs (2003)), test laboratory report. the students’ understanding of in-laboratory tasks (Johnstone et. al. 1998, Reid & Shah Introduction 2006), they do not necessarily assess the development of practical skill, even though the The development of skills and attributes in development of practical skills is arguably one chemistry has received increasing attention in of the main aims of such courses. How can recent years (Overton & Garvey, 2017). With we track or assess the practical skills regard to practical skills development, this is development of Chemistry students on a large reflected in recent changes to the “A” Level scale, in a logistically feasible manner? This structure (Read & Barnes 2015; Barnes, issue is being addressed at “A” Level through Laham & Read 2017), the requirements for the introduction of the new ‘practical RSC accreditation of degree programmes (to endorsement’ (OFQUAL, 2016), and a complete a certain amount of practical work), number of universities are currently updating and the demonstration of skills competence in their practical courses in a similar way (Brazil vocational qualifications. Explicitly assessing 2017). and acknowledging the development of students’ practical skills should form an New Directions in the Teaching of Physical Sciences, Volume 13, Issue 1 (2018) https://doi.org/10.29311/ndtps.v0i13.2905 2 Tracking and assessing practical chemistry skills development: practical skills portfolios Formative assessment of skills development Chemistry course for their first three years, in practical Chemistry has been previously taught by “flying faculty” UK staff travelling out described by Towns et. al. (2015) (see also to Nanjing. This course consists of 17 Hensiek et. al. 2016), and later Seery (2017), experiments, designed and selected to through digital badging. Students are video- develop a practical skill set from a roughly UK recorded performing a key task, and are “A” level equivalent (in year 1), up to a UK awarded a badge via the virtual learning second-year degree equivalent level (in years environment (VLE) to certify their 2 and 3). competence. In Seery’s modification, students are also exposed to pre-lab videos, which These are all English as Second Language they peer-review, as well as answering a (ESL) students; who in some cases do not number of questions about the work they are have any significant practical Chemistry doing in the video. This formative assessment experience from High School. (Not all was shown to quantitatively improve students’ students had the opportunity to study confidence and experience in selected Chemistry in their final years of High School, practical skills. and indeed those that did, may have had limited practical Chemistry experience.) The applications of digital badging described Therefore, a particular emphasis on building by Seery, Towns, and Hensiek thus far have practical skills will be important for any been limited to a limited range of techniques: university level course they take. Reflection pipetting; preparation of standard solutions; after the initial delivery of the course titration and distillation. To assess the skills suggested that further formative assessment developed over an entire introductory practical tools to gauge students’ development in Chemistry course would necessitate scientific writing and practical skills significant post-laboratory review on the part development, beyond the post-laboratory of the instructor watching the students’ report, were necessary in this abridged recorded video, which may prove challenging course. in terms of workload. Links with the University of Southampton, and Context discussions in 2014 about the Southampton skills assessments led to the PSP model University of Southampton being adapted for use in this unique setting in The Science Foundation Year at the China. In particular, such a portfolio would be University of Southampton provides an entry useful for Chinese students in not only route onto science degree programmes for developing practical skills but also their students who do not have the required chemical language. qualifications for direct entry. Students complete 10 chemistry practicals over the Format, delivery and assessment course of the year, introducing all of the skills of PSPs commonly encountered by “A” Level PSPs were first implemented at Southampton chemistry students. during the 2013/14 academic year and on Sheffield’s course in China in 2014/15, with University of Sheffield (Nanjing Tech small modifications to templates being University (NJTech) Joint Degree) – implemented each year to enhance the impact Practical Skills Portfolio (PSP) on learning. A pro-forma is provided to The University of Sheffield-Nanjing Tech students which they populate with University Degree is a [3+1] joint programme, photographs, reflections and other text or which began in 2011. It is delivered in English diagrams as required by the tasks set. The only and is RSC accredited. Students study PSP pro-formas are generally divided into for three years in Nanjing, China, followed by sections based on ‘technique’, ‘observation’ a year spent in Sheffield, totally integrated and ‘apparatus’. They contain: prompts for with the final-year BSc cohort (Hyde 2014a;b, students to photograph apparatus and key Hyde et. al. 2016). These students take an changes; simple yes/no questions to check abridged, specially designed practical understanding; 5-point ‘confidence’ scales to New Directions in the Teaching of Physical Sciences, Volume 13, Issue 1 (2018) https://doi.org/10.29311/ndtps.v0i13.2905 3 Tracking and assessing practical chemistry skills development: practical skills portfolios gauge experience; and free-text questions evidencing the acquisition of new skills and based on common difficulties encountered covering all the practical requirements for with new techniques. students to join and be fully integrated in the Level 3 course in Sheffield. However, At Southampton, students submit PSPs online discussion with students about this approach via Turnitin to be marked electronically, with at NJTech suggested that, although they the aim of returning marks and feedback to understood the purpose of the paper-based students within one week of submission i.e. Practical Skills Portfolio, students would prefer before the following chemistry practical. An to submit portfolios online. Therefore, from example of a student’s submission, with 2016-17 the Practical