Many low-stakes assessments, such as international large-scale surveys, are administered during time-limited testing sessions and some test-takers are not able to endorse the last items of the test, resulting in not-reached (NR) items. However, because the test has no consequence for the respondents, these NR items can also stem from quitting the…

This study examines potential assessment bias based on students' primary language status in PISA 2018. Specifically, multilingual (MLs) and nonmultilingual (non-MLs) students in the United States are compared with regard to their response time as well as scored responses across three cognitive domains (reading, mathematics, and science).…

Part-time work is a form of career development that can be expected to provide students with resources of value to their transitions into work. International research shows that teenagers who work part-time alongside their full-time studies can expect to do better when they entered the labour force as young adults. Studies suggest strongly that…

Common response-time-based approaches for non-effortful response behavior (NRB) in educational achievement tests filter responses that are associated with response times below some threshold. These approaches are, however, limited in that they require a binary decision on whether a response is classified as stemming from NRB; thus ignoring…

The use of multistage adaptive testing (MST) has gradually increased in large-scale testing programs as MST achieves a balanced compromise between linear test design and item-level adaptive testing. MST works on the premise that each examinee gives their best effort when attempting the items, and their responses truly reflect what they know or can…

Multistage adaptive testing (MST) has been recently adopted for international large-scale assessments such as Programme for International Student Assessment (PISA). MST offers improved measurement efficiency over traditional nonadaptive tests and improved practical convenience over single-item-adaptive computerized adaptive testing (CAT). As a…

Digital administration of assessments allows for the collection of process data indices, such as response time, which can serve as indicators of rapid-guessing and examinee test-taking effort. Setting a time threshold is essential to distinguish effortful from effortless behavior using item response times. Threshold identification methods may…

The increasing use of low-stakes international assessments highlights the importance of test-taking efforts. Previous studies have used self-reported and response time-based measures to examine this effort. Although differences between these measures have been suggested, their association with performances and potential gender gaps remains…

Research on methods for measuring examinee engagement with constructed-response items is limited. The present study used data from the PISA 2018 Reading domain to construct and compare indicators of test-taking effort on constructed-response items: response time, number of actions, the union (combining effortless responses detected by either…

Achievement tests are commonly used in education to evaluate students' academic performance and proficiency in specific subject areas. However, there is a major problem that threatens the validity of achievement test scores which is test-taking disengagement. Respondents provide answers that are inconsistent with their true ability level and can…

Several studies have been published on disengaged test respondents, and others have analyzed disengaged survey respondents separately. For many large-scale assessments, students answer questionnaire and test items in succession. This study examines the percentage of students who continuously engage in disengaged responding behaviors across…

Effective career guidance systems provide students with the opportunity to gain first hand experiences of what it is like to be in work. Through voluntary work in the community, schools can give students opportunity to undertake tasks under the supervision of a professional who is not a teacher in a workplace often in fields of strong career…

Exploring the relationship between student ability and test-taking effort is an important area of study, offering insights into their approach to educational assessments. Previous research shows this relationship, yet there is a scarcity of research comparing the test-taking effort of students. In addition, researchers have frequently employed…

This study aims to assess student motivation to provide valid responses to the PISA student questionnaire. This was done by modeling response times using a three-component finite mixture model, comprising two satisficing response styles (rapid and idle) and one optimizing response style. Each participant's motivation was operationalized as their…

This study uses a newly compiled data set of instructional time and student performance by subject across German federal states for student cohorts enrolled at the primary level in the 1990s and tested at the secondary level in the 2000s. It finds evidence for the school inputs-student achievement relationship, taking nonlinearity,…