This study compares the psychometric properties of reliability in Classical Test Theory (CTT), item information in Item Response Theory (IRT), and validation from the perspective of modern validity theory for the purpose of bringing attention to potential issues that might exist when testing organizations use both test theories in the same testing…

Multiple-choice questions (MCQ) are commonly used on histology examinations. There are many guidelines for how to properly write MCQ and many of them recommend avoiding negatively worded stems. The current study aims to investigate differences between positively and negatively worded stems in a medical histology course by comparing the item…

The Youth Anxiety Measure for the "DSM"-5 (YAM-5) is a self-report and/or parent-report measure that was created to assess the full spectrum of anxiety disorder symptoms in children and adolescents aged 8 through 18. The scale consists of two related sections. The first section (YAM-5-I) evaluates the major anxiety disorders; the second…

The present investigation explores Cognitive Test Anxiety (CTA) in a high-stake oral examination, taking into consideration how face-to-face and computer-based examination formats affect test-takers' anxiety and consequently language performance. Two speaking tests -- face-to-face and computer-based -- were developed for a Spanish university's…

The current study aims to explore the cognitive validity of the iBT TOEFL reading test by investigating test takers' eye movements on individual items. It is assumed that successful test takers would adopt the intended reading processes, the same types and levels of cognitive processes that they would use for real-world reading tasks. Forty-seven…

We describe the conceptualization, design, development, validation, and testing of a summative instrument that measures high school students' ability to analyze and evaluate data, construct scientific explanations, and formulate scientific arguments in biology and chemistry disciplinary contexts. Data from 1,405 students were analyzed to evaluate…

The Hierarchical Diagnostic Classification Model (HDCM) reflects on the sequences of the presentation of the essential materials and attributes to answer the items of a test correctly. In this study, a foreign language reading comprehension test was analyzed employing HDCM and the generalized deterministic-input, noisy and gate (G-DINA) model to…

Assessing language skills in an integrative form has drawn the attention of assessment experts in recent years. While some research data exists on integrative listening/reading-to-write assessment, there is comparatively little research literature on listening-to-speak integrated assessment. Also, little attention has been devoted to the role of…

Volume 1 of the "TIMSS 2023 National Report for England" analysed the TIMSS 2023 performance of a sample of year 5 and year 9 pupils in mathematics and science in England. This second volume of the "TIMSS 2023 National Report for England" focuses on performance in England analysed by pupil characteristics and participating…

From a sociocognitive perspective, item parameters in a test represent regularities in examinees' item responses. These regularities are originated from shared experiences among individuals in interacting with their environment. Theories explaining the relationship between culture and cognition also acknowledge these shared experiences as the…

In this study, I investigate whether three A2 Key for Schools practice tests from Cambridge Assessment English for 6th-graders (11-12 years old) in Argentina measure growth and produce scores that are meaningful. Drawing data from three consecutive years, I analyze the scores of 80 children over a school year and consider whether the tests are…

International large-scale assessments (ILSAs) have become an important part of the Swedish evaluation system. It is therefore of crucial importance to validate national measures of Swedish students' achievement with their ILSA test scores. Here, we offer results from such a validation study based on Swedish students' test scores in IEA's Trends in…

Rearranging response options in different versions of a test of multiple-choice items can be an effective strategy against cheating on the test. This study investigated if rearranging response options would affect item performance and test score comparability. A study test was assembled as the base version from which 3 variant versions were…

Test items must often be broad in scope to be ecologically valid. It is therefore almost inevitable that secondary dimensions are introduced into a test during test development. A cognitive test may require one or more abilities besides the primary ability to correctly respond to an item, in which case a unidimensional test score overestimates the…

Purpose: The purpose of this study was to determine if group differences exist in spelling accuracy or spelling errors between kindergarten children with hearing loss and children with normal hearing loss. Method: Participants included 23 kindergarten children with hearing loss and 21 children with normal hearing. All children used spoken English…