The increasing use of low-stakes international assessments highlights the importance of test-taking efforts. Previous studies have used self-reported and response time-based measures to examine this effort. Although differences between these measures have been suggested, their association with performances and potential gender gaps remains…

Several studies have been published on disengaged test respondents, and others have analyzed disengaged survey respondents separately. For many large-scale assessments, students answer questionnaire and test items in succession. This study examines the percentage of students who continuously engage in disengaged responding behaviors across…

Formative assessment has been long emphasised as a powerful means for enhancing science learning. However, there is still a lack of research to investigate the impacts of formative assessment on both students' motivational beliefs and behaviours in science learning. This study examined such impacts using data from six Western and six East Asian…

This comparative study investigated the associations between instructional practices and students' reading performance among 10 top performing regions that participated in the Program for International Student Assessment (PISA) 2018. A nationally representative sample consisting of 80,016 15-year-old students from 5 Asian regions (B-S-J-Z [China],…

In large-scale low-stake assessment such as the Programme for International Student Assessment (PISA), students may skip items (missingness) which are within their ability to complete. The detection and taking care of these noneffortful responses, as a measure of test-taking motivation, is an important issue in modern psychometric models.…

Covariates have been used in mixture IRT models to help explain why examinees are classed into different latent classes. Previous research has considered manifest variables as covariates in a mixture Rasch analysis for prediction of group membership. Latent covariates, however, are more likely to have higher correlations with the latent class…

Rapid response behaviour, a type of test disengagement, cannot be interpreted as a true indicator of the targeted constructs and may compromise score accuracy as well as score validity for interpretation. Rapid responding may be due to multiple factors for diverse populations. In this study, using Programme for International Student Assessment…

Comparing group is one of the key uses of large-scale assessment results, which are used to gain insights to inform policy and practice and to examine the comparability of scores and score meaning. Such comparisons typically focus on examinees' final answers and responses to test questions, ignoring response process differences groups may engage…

This article examines whether the way that PISA models item outcomes in mathematics affects the validity of its country rankings. As an alternative to PISA methodology a two-parameter model is applied to PISA mathematics item data from Canada and Finland for the year 2012. In the estimation procedure item difficulty and dispersion parameters are…

This study explored the extent to which teachers' instrumental (i.e., tangible aid to promote learning) and appraisal support (i.e., teacher feedback) enhanced students' achievement in mathematics. Participants included 13,950 fifteen-year-old Canadian students who participated in the 2012 Programme for International Student Assessment. Based on…

This study analysed 10 top-performing regions in PISA 2015 on their science performances and instructional practices. The regions include Singapore, Japan, Estonia, Taipei, Finland, Macao, Canada, Hong Kong, China and Korea. The science performances of the 10 regions and their teaching practices are described and compared. The construct of…

Romania's education system has made impressive strides over the past two decades, with an increasing share of students mastering the basic competencies that they need for life and work. But these average improvements mask significant disparities in learning outcomes and attainment, with an increasing share of students leaving education early…

This paper focuses "interest in science" as one of the attitudinal aspects of scientific literacy. Large-scale data from the Programme for International Student Assessment (PISA) 2006 are analysed in order to describe student interest more precisely. So far the analyses have provided a general indicator of interest, aggregated over all…