Researchers design diagnostic assessments to measure students' knowledge structures and processing skills to provide information about their cognitive attribute. The purpose of this study is to determine the instrument's validity and score reliability, as well as to investigate the use of classical test theory to identify item characteristics. The…

Achievement tests are commonly used in education to evaluate students' academic performance and proficiency in specific subject areas. However, there is a major problem that threatens the validity of achievement test scores which is test-taking disengagement. Respondents provide answers that are inconsistent with their true ability level and can…

When cognitive and educational tests are administered under time limits, tests may become speeded and this may affect the reliability and validity of the resulting test scores. Prior research has shown that time limits may create or enlarge gender gaps in cognitive and academic testing. On average, women complete fewer items than men when a test…

This paper demonstrated how to apply Machine Learning (ML) techniques to analyze student interaction data collected in an online mathematics game. Using a data-driven approach, we examined 1) how different ML algorithms influenced the precision of middle-school students' (N = 359) performance (i.e. posttest math knowledge scores) prediction and 2)…

Predictive validity considerations in selection dictate choice of the predictor with the highest predictive validity. Implementation of this principle in any specific selection process inevitably entails choice between imperfectly correlated alternative predictors, real or hypothetical, which are equivalent in terms of predictive validity. We show…

As part of efforts to improve the quality of mathematics' teaching and evaluation, we examined the focus of math teachers' considerations in evaluating students' achievements, as well as the links between these focuses, regarding differences between students and the validity and reliability of assessment methods and examinations. Based on the…

This paper demonstrated how to apply Machine Learning (ML) techniques to analyze student interaction data collected in an online mathematics game. Using a data-driven approach, we examined: (1) how different ML algorithms influenced the precision of middle-school students' (N = 359) performance (i.e. posttest math knowledge scores) prediction; and…

This manuscript presents the results from a study to investigate the technical characteristics of two versions of a number line assessment (NLA 0-20 and NLA 0-100). The sample consisted of 60 kindergarten and 46 first grade students. Both number line versions had sufficient alternate form and test-retest reliability. The NLA 0-20 had low and the…

To measure the procedural and conceptual knowledge of functions and to clarify the relationship between them in the context of mathematics education in Morocco, a structural equation modeling (SEM) analysis was used. In addition, correlation tests between students' grades at their Mathematical Analysis Assessments and their procedural and…

A theoretical model describing young students' (Grades 1-3) functional-thinking modes was formulated and validated empirically (n = 345), hypothesizing that young students' functional-thinking modes consist of recursive patterning, covariational thinking, correspondence-particular, and correspondence-general factors. Data analysis suggested that…

This paper demonstrates how to apply Machine Learning (ML) techniques to analyze student interaction data collected in an online mathematics game. We examined: (1) how different ML algorithms influenced the precision of middle-school students' (N = 359) performance prediction; and (2) what types of in-game features were associated with student…

The capacity to recognise, represent, and reason about relationships between different quantities, that is, to think multiplicatively, has long been recognised as critical to success in school mathematics in the middle years and beyond. Building on recent research that found a strong link between multiplicative thinking and algebraic, geometrical,…

The purpose of this study was to compare students' results in mathematics from a large-scale standardized assessment, the National Assessment Program: Literacy and Numeracy (NAPLAN), with a set of teacher-developed, school-based assessments. A case study of an all-boys secondary school in Sydney, New South Wales, Australia, was conducted over…

Ensuring that students are ready for college when they graduate from high school has important implications for students, educators, education policymakers, and other stakeholders. This study focuses on an examination of the relationship between the National Assessment of Educational Progress (NAEP) grade 12 mathematics assessment and college…

Multiplicative reasoning is a key concept in elementary school mathematics. Item statistics reported by the National Assessment of Educational Progress (NAEP) assessment provide the best current indicator for how well elementary students across the U.S. understand this, and other concepts. However, beyond expert reviews and statistical analysis,…