Response times (RTs) facilitate the quantification of underlying cognitive processes in problem-solving behavior. To provide more comprehensive diagnostic feedback on strategy selection and attribute profiles with multistrategy cognitive diagnosis model (CDM) and utilize additional information for item RTs, this study develops a multistrategy…

Studies have indicated that pictures in test items can impact item-solving performance, information processing (e.g., time on task) and metacognition as well as test-taking affect and motivation. The present review aims to better organize the existing and somewhat scattered research on multimedia effects in testing and problem solving while…

As the use of process data in large-scale educational assessments is becoming more common, it is clear that data on examinees' test-taking behaviors can illuminate their performance, and can have crucial ramifications concerning assessments' validity. A thorough review of the literature in the field may inform researchers and practitioners of…

The response process of problem-solving items contains rich information about respondents' behaviours and cognitive process in the digital tasks, while the information extraction is a big challenge. The aim of the study is to use a data-driven approach to explore the latent states and state transitions underlying problem-solving process to reflect…

Although student academic support programs have dated back to Early Colleges in America, the way we service our students' populations has had to evolve. Various student support programs have been utilized over the years, and while at that current time may have indicated benefits, are now outdated. One service that is demonstrating success is…

How is it possible to create and continuously improve a quality learning environment for our students? We present our one-year course on engineering thermodynamics as a case study in which we investigate the learning environment based on a competency model from the students' perspective. Based on the analysis of our course structure and exam…

In previous studies, problem solving appraisal has been identified as playing a key role in promoting positive psychological well-being. The Problem Solving Inventory is the most widely used measure of problem solving appraisal and consists of 32 items. The length of the instrument, however, may limit its applicability to large-scale surveys…

Process data are becoming more and more popular in education research. In the field of computer-based assessments of collaborative problem solving (ColPS), process data have been used to identify students' test-taking strategies while working on the assessment, and such data can be used to complement data collected on accuracy and overall…

Exams constitute the predominant form of summative assessment in undergraduate biology education, with the assumption that exam performance should reflect student conceptual understanding. Previous work highlights multiple examples in which students can answer exam problems correctly without the corresponding conceptual understanding. This…

The term speed-accuracy tradeoff is used when an increase in response speed comes at the expense of response accuracy. Although originally a concept from experimental psychology, the speed-accuracy tradeoff has been a topic in psychological assessment, too. In the first part of the manuscript, we discuss motivational factors that may be…

Background: The International Performance Assessments of Learning (iPAL) project developed a framework for the construction of performance assessments for testing critical thinking, which proposes structuring them around a problem situation that sets an authentic (i.e., real-life-like) problem-solving task for the test-taker. Its critical thinking…

Changes in the national examination structures have renewed interest in the development of test-taking strategies for professional students in the health sciences. It is often assumed that these high-achieving students have developed proficient test-taking skills and abilities before admittance. However, the assessments in these programs and for…

Flexibility is an important element in learning mathematics. The purpose of this study was to investigate whether flexibility in linear equation solving predicts future academic achievement in mathematics and other subjects. Participants were 149 Finnish high-school students. Results show that flexibility was related to grades in both tracks of…

The current study investigated how item formats and their inherent affordances influence test-takers' cognition under uncertainty. Adult participants solved content-equivalent math items in multiple-selection multiple-choice and four alternative grid formats. The results indicated that participants' affirmative response tendency (i.e., judge the…

On the basis of the results of two prior studies at the US Naval Academy (USNA), which described the choice of study resources and the self-reported learning approaches of students of differing achievement levels, the current investigation examines how students of differing achievement levels in general chemistry actually solve multiple-choice…