In this study, I investigate whether three A2 Key for Schools practice tests from Cambridge Assessment English for 6th-graders (11-12 years old) in Argentina measure growth and produce scores that are meaningful. Drawing data from three consecutive years, I analyze the scores of 80 children over a school year and consider whether the tests are…

International large-scale assessments (ILSAs) have become an important part of the Swedish evaluation system. It is therefore of crucial importance to validate national measures of Swedish students' achievement with their ILSA test scores. Here, we offer results from such a validation study based on Swedish students' test scores in IEA's Trends in…

Rearranging response options in different versions of a test of multiple-choice items can be an effective strategy against cheating on the test. This study investigated if rearranging response options would affect item performance and test score comparability. A study test was assembled as the base version from which 3 variant versions were…

Test items must often be broad in scope to be ecologically valid. It is therefore almost inevitable that secondary dimensions are introduced into a test during test development. A cognitive test may require one or more abilities besides the primary ability to correctly respond to an item, in which case a unidimensional test score overestimates the…

Purpose: The purpose of this study was to determine if group differences exist in spelling accuracy or spelling errors between kindergarten children with hearing loss and children with normal hearing loss. Method: Participants included 23 kindergarten children with hearing loss and 21 children with normal hearing. All children used spoken English…

Metabolic systems form the very foundation of life and as such are broadly taught in the molecular life sciences. Here, we describe the biochemistry educator community-based development and use of an assessment instrument designed to evaluate students' ideas about metabolic pathway dynamics and regulation in undergraduate biochemistry courses.…

Expert judgement has been frequently employed with reading assessments to gauge the skills potentially measured by test tasks, for purposes such as construct validation or producing diagnostic information. Despite the critical role it plays in such endeavours, few studies have triangulated its results with other types of data such as reported…

In this study, we evaluate the validity of question 29 (Q.29) in the Force Concept Inventory (FCI), which requires an understanding of atmospheric pressure. At least in some Japanese physics classes, the rate of the correct answer to Q.29 is reduced between the pretest and post-test. To examine this deterioration of a student's response, we…

This study examined the test-retest reliability of the standing long jump (SLJ) and the countermovement jump (CMJ) following consistent and non-consistent attentional focus cuing instructions in physically active young adults (n = 30). The systematic error (as standardize change in mean), random error (as typical error), the Bland and Altman…

Purpose: The purpose of this study was to explore whether evidence for a bimodal distribution of tense marking, previously documented in clinically referred samples, exists in a population-based sample of kindergarten children from a rural county in Tennessee. Method: A measure of tense marking, the Test of Early Grammatical Impairment (TEGI)…

Comparative accuracy studies evaluate the relative performance of two or more diagnostic tests. As any other form of research, such studies should be reported in an informative manner, to allow replication and to be useful for decision-making. In this study we aimed to assess whether and how components of test comparisons were reported in…

Writing rubrics have been used in doctoral dissertations in Turkey to assess student writing for nearly twenty years. This study aims to determine which features are assessed in the rubrics used in doctoral dissertations. Twenty-five rubrics were selected to determine the analysis of validity and reliability, rubric dimensions, features of…

Background: Reading and listening comprehension are essential for accessing the school curriculum. Inference-making is integral to successful comprehension and involves integrating information between clauses (local coherence) and integrating information with background knowledge (global coherence). We require appropriate methods to assess…

This article presents the results of our analysis of a sample of 254 Calculus I final exams (collectively containing 4,167 individual items) administered at U.S. colleges and universities. We characterize the specific meanings of foundational concepts the exams assessed, identify features of exam items that assess productive meanings, distinguish…

A basic mental model (BMM--in German 'Grundvorstellung') of a mathematical concept is a content-related interpretation that gives meaning to this concept. This paper defines normative and individual BMMs and concretizes them using the integral as an example. Four BMMs are developed about the concept of definite integral, sometimes used in specific…