The exposure of scientific scandals and the increase of dubious research practices have generated a stream of studies on Questionable Research Practices (QRPs), such as failure to acknowledge co-authors, selective presentation of findings, or removal of data not supporting desired outcomes. In contrast to high-profile fraud cases, QRPs can be…

In spring 2020, the chemical education community faced an abrupt transition from in-person to online classes, which also necessitated online assessments. Building upon an existing three-semester study (F17, S19, and F19) using Rasch modeling and classical testing theory to improve in-person multiple choice exams, this study investigates the impact…

Test-taking experience is a consequence of the interaction between students and assessment properties. We define a new notion, rapid-pacing behavior, to reflect two types of test-taking experience -- disengagement and speededness. To identify rapid-pacing behavior, we extend existing methods to develop response-time thresholds for individual items…

The purpose of this study is to introduce a method for converting scored 4-option multiple-choice (MC) items into scored 3-option MC items without re-pretesting the 3-option MC items. This study describes a six-step process for achieving this goal. Data from a professional credentialing exam was used in this study and the method was applied to 24…

Background: The use of e-exams in higher education is increasing. However, the role of student diversity in the acceptance of e-exams is an under-researched topic. In the current study, we considered student diversity in terms of three sociodemographic characteristics (age, gender, and second language) and three dispositional student…

Computer-aided assessment is an important tool that reduces the workload of teachers and increases the efficiency of their work. The multiple-choice test is considered to be one of the most common forms of computer-aided testing and its application for mid-term has indisputable advantages. For the purposes of a high-quality and responsible…

This thesis explores two case studies into the use of short answers and self-explanation to improve student learning in physics. The first set of experiments focuses on the role of short answer questions in the context of computer-based instruction. Through a series of six experiments, we compare and evaluate the performance of computer-assessed…

The present trend in developing and using semi-direct speaking tests has been supported by test developers and researchers' claim of their increased practicality, higher reliability and concurrent validity with test scores in direct oral proficiency interviews. However, it is universally agreed within the language testing and assessment community…

In response to the call for improving teacher candidates' familiarity with the assessment tasks and format of the edTPA (Hildebrandt & Swanson, 2014), this single case study investigated the reflective writing development of Jena, a K-12 Spanish teacher candidate, and her evolution in a pedagogy that focused on the development of writing two…

Using a case-study approach, interviews with four final-year psychology students showed different approaches to learning and varying experiences of teaching in courses assessed through open-book exams. Analysis of their experiences, supported by previous research findings, provided insights into the reasons for the contrasting approaches being…

This article considers the design process for new formative history assessments. Over the course of 3 years, my colleagues from the Stanford History Education Group and I designed, piloted, and revised dozens of "History Assessments of Thinking" (HATs). As we created HATs, we sought to gather information about their cognitive validity,…

Background/Context: The nature of the impact of state-mandated accountability testing on teachers' classroom practices remains contested. While many researchers argue that teachers change their teaching in response to mandated testing, others contend that the nature and degree of the impact of testing on teaching remains unclear. The research on…

Involving students in peer review has many pedagogical benefits, but few studies have explicitly investigated relationships between the content of peer reviews, student perceptions and assessment outcomes. We conducted a case study of peer review within a third-year undergraduate subject at a research-intensive Australian university, in which we…

The measurement of higher-order competencies within a tertiary education system across countries presents methodological challenges due to differences in educational systems, socio-economic factors, and perceptions as to which constructs should be assessed (Blömeke, Zlatkin-Troitschanskaia, Kuhn, & Fege, 2013). According to Hart Research…

This paper reviews the literature on comparing online and paper course evaluations in higher education and provides a case study of a very large randomised trial on the topic. It presents a mixed but generally optimistic picture of online course evaluations with respect to response rates, what they indicate, and how to increase them. The paper…