Considerable research has examined the use of rapid guessing measures to identify disengaged item responses. However, little is known about students who rapidly guess over the course of several tests. In this study, we use achievement test data from six administrations over three years to investigate whether rapid guessing is a stable trait-like…

In this digital ITEMS module, Dr. Robert [Bob] Mislevy and Dr. Maria Elena Oliveri introduce and illustrate a sociocognitive perspective on educational measurement, which focuses on a variety of design and implementation considerations for creating fair and valid assessments for learners from diverse populations with diverse sociocultural…

The discovery and characterisation of planets orbiting distant stars has shed light on the origin of our own Solar System. It is important that college-level introductory astronomy students have a general understanding of the planet formation process before they are able to draw parallels between extrasolar systems and our own Solar System. In…

Accurately diagnosing autism spectrum disorders in adulthood can be challenging. Structured questionnaires and diagnostic measures are frequently used to assist case recognition and diagnosis. This study reviewed research evidence on structured questionnaires and diagnostic measures published since the National Institute for Health and Care…

This paper describes and evaluates a multistage adaptive testing (MSAT) design that was implemented for the Programme for International Student Assessment (PISA) 2018 main survey for the major domain of Reading. Through a simulation study, recovery of item response theory model parameters and measurement precision were examined. The PISA 2018 MSAT…

The present study is the first to examine empirically whether required fields in online surveys impair reliability and response pattern, as participants forced to respond to all items may provide arbitrary answers. Two hundred and thirteen participants completed a survey consisting of six questionnaires testing personal and social issues and…

In assembling testlets (i.e., test forms) with a pool of new and used item blocks, test security is one of the main issues of concern. Strict constraints are often imposed on repeated usage of the same item blocks. Nevertheless, for an assessment administering multiple testlets, a goal is to select as large a sample of testlets as possible. In…

Teacher working conditions (TWCs) have been linked to teacher retention and student learning. These connections make TWCs important to understand. However, the literature on TWCs lacks cohesiveness, with widely varying definitions, conceptualizations, and measures of TWCs. Contributing to this lack of cohesion is that there is no accepted…

Purpose: We aimed to develop and validate the Musicians' Hearing Handicap Index (MHHI), a new self-evaluation tool for quantifying occupation-related auditory difficulties in music professionals. Although pure-tone audiometry is often considered the "gold standard" and is usually employed as the main instrument for hearing assessment, it…

The purpose of the present study was to design and validate a scale for measuring the sources of English as a foreign language (EFL) teachers' apprehension (STAS). To design the scale, the data generated from a triangulated qualitative research (Goldast and Ghanizadeh forthcoming) was employed. The model incorporated four factors, including…

The Boxall Profile is one of the most frequently used tools to measure the social, emotional, behavioural and/or mental health difficulties (SEMH) of children and young people in schools across the UK. However, limited evidence exists regarding the norms and psychometric properties of the tool. The current study used data from 487 primary…

The present study used process data from a computer-based problem-solving task as indications of behavioural level of test-taking effort, and explored how behavioural item-level effort related to overall test performance and self-reported effort. Variables were extracted from raw process data and clustered. Four distinct clusters were obtained and…

The quality of multiple-choice questions (MCQs) as well as the student's solve behavior in MCQs are educational concerns. MCQs cover wide educational content and can be immediately and accurately scored. However, many studies have found some flawed items in this exam type, thereby possibly resulting in misleading insights into students'…

The Mineralogy Concept Inventory (MCI) is a statistically validated 18-question assessment that can be used to measure learning gains in introductory mineralogy courses. Development of the MCI was an iterative process involving expert consultation, student interviews, assessment deployment, and statistical analysis. Experts at the two universities…

Two widely studied language skills in relation to reading comprehension are listening comprehension skill and academic language proficiency. Although their constituent skills and theoretical accounts of how they are related to reading comprehension share a large overlap, they have been studied in separate lines of work. In this study, we…