Common indicator-based approaches to identifying careless and insufficient effort responding (C/IER) in survey data scan response vectors or timing data for aberrances, such as patterns signaling straight lining, multivariate outliers, or signals that respondents rushed through the administered items. Each of these approaches is susceptible to…

Digital administration of assessments allows for the collection of process data indices, such as response time, which can serve as indicators of rapid-guessing and examinee test-taking effort. Setting a time threshold is essential to distinguish effortful from effortless behavior using item response times. Threshold identification methods may…

The increasing use of low-stakes international assessments highlights the importance of test-taking efforts. Previous studies have used self-reported and response time-based measures to examine this effort. Although differences between these measures have been suggested, their association with performances and potential gender gaps remains…

Although self-report surveys are widely used for data collection, data quality can vary across populations because certain groups are more likely to engage in insufficient effort responding (IER). Our study examined how different levels of the educational system--student groups, schools, and cultural contexts--affect data quality due to IER, using…

Questionnaires are by far the most common tool for measuring noncognitive constructs in psychology and educational sciences. Response bias may pose an additional source of variation between respondents that threatens validity of conclusions drawn from questionnaire data. We present a mixture modeling approach that leverages response time data from…

Positive teacher feedback plays a crucial role in student learning. While previous studies on positive teacher feedback have primarily focused on its relationship with student achievement, much less attention has been given to how such feedback associates with student self-efficacy, particularly reading self-efficacy--a key predictor of both…

Learning strategies have been recognized as important predictors of mathematical achievement. In recent studies, it has been found that Asian students use combined learning strategies, primarily including metacognitive strategies, rather than rote memorization. To the best of the authors' knowledge, there is only one prior study including South…

This issue of Snapshots explores how student effort may vary depending on the perceived stakes of the assessment. We revisit the self-reported levels of effort that students invested in the PISA test and compare them with the effort they indicated they would have made if the results counted towards their school marks. Australia's results are…

Collecting process data in computer-based assessments provides opportunities to describe examinee behaviour during a test-taking session. The number of actions taken by students while interacting with an item is in this context a variable that has been gaining attention. The present study aims to investigate how the number of actions performed on…

Teacher feedback has been acknowledged as an important facilitator for students' learning performance. However, teachers' feedback efforts are not always found to pay off, especially in the context of Confucian-heritage countries. Scholars are seeking answers from student agencies during feedback-taking. The current study aimed to examine the role…

Teacher feedback in reading class is closely associated with students' reading achievement. However, the underlying mechanisms of their relationship has been underexplored, especially in cross-cultural contexts. Using Control Value Theory of Achievement Emotions (CVTAE), this study tested the cross-cultural generalizability of reading enjoyment as…

Profile analysis is one of the main tools for studying whether differential item functioning can be related to specific features of test items. While relevant, profile analysis in its current form has two restrictions that limit its usefulness in practice: It assumes that all test items have equal discrimination parameters, and it does not test…

Evaluating scale comparability in international large-scale assessments depends on measurement invariance (MI). The root mean square deviation (RMSD) is a standard method for establishing MI in several programs, such as the Programme for International Student Assessment and the Programme for the International Assessment of Adult Competencies.…

This study aimed to evaluate the item model fit by equating the forms of the PISA 2018 mathematics subtest with concurrent common items equating in samples from Türkiye, the UK, and Italy. The answers given in mathematics subtest Forms 2, 8, and 12 were used in this context. Analyzes were performed using the Dichotomous Rasch Model in the WINSTEPS…

This study explored the mediating roles of interest in broad science topics (IBST) on the effects of students' perceptions of teachers' formative assessment on science achievement, using data from PISA 2015. We focused on 9,841 15-year-old students from Mainland (B-S-J-G) China. The results revealed that: (1) a classical suppression effect, where…