ERIC Number: EJ1447298
Record Type: Journal
Publication Date: 2023
Pages: 39
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: EISSN-1759-667X
Available Date: N/A
Should Open-Book, Open-Web Exams Replace Traditional Closed-Book Exams in Science in Higher Education? An Evaluation of Their Effectiveness in Different Disciplines
Laura Roberts; Joanne Berry
Journal of Learning Development in Higher Education, n28 2023
The mass shift to Open-Book, Open-Web (OBOW) assessments during the pandemic highlighted new opportunities in Higher Education for developing accessible, authentic assessments that can reduce administrative load. Despite a plethora of research emerging on the effectiveness of OBOW assessments within disciplines, few currently evaluate their effectiveness across disciplines where the assessment instrument can vary significantly. This paper aims to evaluate the experience students across STEM subjects had of OBOW exams to contribute to an evidence-base for emerging post-pandemic assessment policies and strategies. In April 2021, following two cycles of OBOW exams, we surveyed STEM students across a range of subjects to determine their preparation strategy, experiences during the exam, perception of development of higher order cognitive skills, test anxiety, and how they thought these assessments might enhance employability. Overall, students from subjects that use assessment instruments requiring analytical, quantitative-based answers (Maths, Physics, Computer Science and Chemistry) adapted their existing study skills less effectively, felt less prepared and experienced higher levels of stress compared to students of subjects using more qualitative discursive based answers (Biosciences and Geography). We conclude with recommendations on how to enhance the use of OBOW exams: these include supporting and developing more effective study skills, ensuring assessments align with intended learning outcomes, addressing the issue of academic integrity, promoting inclusivity, and encouraging authentic assessment. Based on the outcomes of this study, we strongly advise that assessment policies that foster the whole-scale roll-out of OBOW assessment consider the inter-disciplinary impacts on learner development, staff training and workload resources.
Descriptors: Test Format, Science Tests, College Science, Student Evaluation, College Students, Instructional Effectiveness, Intellectual Disciplines, Differences, Student Experience, Study Habits, Learning Strategies, Student Attitudes, Cognitive Processes, Test Anxiety, Employment Potential, Physics, Computer Science Education, Mathematics Education, Chemistry, Stress Variables, Biological Sciences, Geography, Foreign Countries, COVID-19, Pandemics, Educational Change
Association for Learning Development in Higher Education. 33 Lower Road, Salisbury, Wiltshire, SP2 9NB, UK. e-mail: admin@aldinhe.ac.uk; Web site: https://jldhe.aldinhe.ac.uk/
Publication Type: Journal Articles; Reports - Research; Tests/Questionnaires
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: United Kingdom
Grant or Contract Numbers: N/A
Author Affiliations: N/A