When cognitive and educational tests are administered under time limits, tests may become speeded and this may affect the reliability and validity of the resulting test scores. Prior research has shown that time limits may create or enlarge gender gaps in cognitive and academic testing. On average, women complete fewer items than men when a test…

Researchers design diagnostic assessments to measure students' knowledge structures and processing skills to provide information about their cognitive attribute. The purpose of this study is to determine the instrument's validity and score reliability, as well as to investigate the use of classical test theory to identify item characteristics. The…

This manuscript presents the results from a study to investigate the technical characteristics of two versions of a number line assessment (NLA 0-20 and NLA 0-100). The sample consisted of 60 kindergarten and 46 first grade students. Both number line versions had sufficient alternate form and test-retest reliability. The NLA 0-20 had low and the…

The capacity to recognise, represent, and reason about relationships between different quantities, that is, to think multiplicatively, has long been recognised as critical to success in school mathematics in the middle years and beyond. Building on recent research that found a strong link between multiplicative thinking and algebraic, geometrical,…

The purpose of this study was to compare students' results in mathematics from a large-scale standardized assessment, the National Assessment Program: Literacy and Numeracy (NAPLAN), with a set of teacher-developed, school-based assessments. A case study of an all-boys secondary school in Sydney, New South Wales, Australia, was conducted over…

Multiplicative reasoning is a key concept in elementary school mathematics. Item statistics reported by the National Assessment of Educational Progress (NAEP) assessment provide the best current indicator for how well elementary students across the U.S. understand this, and other concepts. However, beyond expert reviews and statistical analysis,…

This study assessed the psychometric properties of a digital early mathematics assessment, the Ani Banani Math Test (ABMT) in three samples (N[subscript 1] = 243, N[subscript 2] = 691, N[subscript 3] = 1282) in kindergarten and first grade (age range 4.67-7.30). Confirmatory factor analyses showed that the ABMT appears to measure one general…

The aim of this study was to examine whether there is a relationship between the spatial reasoning skills and mathematical thinking profiles of elementary school students. The quantitative method of descriptive survey model was used in the study. The sample of the study comprised 103 fourth grade elementary school students in Turkey. The…

In the present study we aimed to develop a multidimensional test assessing high school students' knowledge about triangles, and then to determine the validity evidence for it based on the internal structure and relations to another variable and its reliability. The test developed was administered to 557 tenth grade students. To assess the validity…

Admission into university in Turkey is very competitive and features a number of practical problems regarding not only the test administration process itself, but also concerning the psychometric properties of test scores. Computerized adaptive testing (CAT) is seen as a possible alternative approach to solve these problems. In the first phase of…

The purpose of this research is to first estimate the item and ability parameters and the standard error values related to those parameters obtained from Unidimensional Item Response Theory (UIRT), bifactor (BIF) and Testlet Response Theory models (TRT) in the tests including testlets, when the number of testlets, number of independent items, and…

Scholastic tests regard cognitive abilities to be domain-specific competences. However, high correlations between competences indicate either high task similarity or a dependence on common factors. The present rating study examined the validity of 12 Programme for International Student Assessment (PISA) and Third or Trends in International…

As state tests of student achievement are used for an increasingly wide array of high- and low-stakes purposes, evaluating their instructional sensitivity is essential. This article uses data from the Bill and Melinda Gates Foundation's Measures of Effective Project to examine the instructional sensitivity of 4 states' mathematics and English…

The subject of this report is a pair of written, group-administered tests designed to measure the performance of grade 1 and grade 2 students at the beginning of the school year in the domain of number and operations. These tests build on previous versions field-tested in fall 2013 (Schoen, LaVenia, Bauduin, & Farina, 2016). Because the tests…

The purpose of the study was to measure students' reported test-taking effort and the relationship between reported effort and performance on the Trends in International Mathematics and Science Study (TIMSS) Advanced mathematics test. This was done in three countries participating in TIMSS Advanced 2008 (Sweden, Norway, and Slovenia), and the…