This Brief Report presents an example of assessment validation using an argument-based approach. The instrument we developed is a Brief Assessment of Students' Mature Number Sense, which measures a central goal in mathematics education. We chose to develop this assessment to provide an efficient way to measure the effect of instructional practices…

By design, randomized experiments (XPs) rule out bias from confounded selection of participants into conditions. Quasi-experiments (QEs) are often considered second-best because they do not share this benefit. However, when results from XPs are used to generalize causal impacts, the benefit from unconfounded selection into conditions may be offset…

Most biology undergraduates learn about mutations in multiple classrooms throughout their college career. Understanding personalised genome test results, genome editing controversies, and the appearance of new variants of viruses or antibiotic resistant bacteria all require foundational knowledge about mutations. However, the abstract nature of…

We investigated environmental supports, an understudied aspect of Social Cognitive Career Theory (SCCT), with rural Appalachian youth, an understudied population. We developed a new measure of proximal influences that bolster the pursuit of postsecondary education, the Assessment of Postsecondary Supports (APSS). Across 3 studies, we develop and…

Rasch and classification analyses on a field-test version of the third edition of the Assessment, Evaluation, and Programming System (AEPS-3), a curriculum-based assessment used to assess young children birth to age 6 years, were conducted. First, an evaluation of the psychometric properties of data from each developmental area of an AEPS-3…

This study provides preliminary evidence for reliability and validity of the Hawaii Early Learning Profile Strands 0-3 (HELP Strands 0-3), an assessment instrument for young children. First, the degree of interobserver agreement for a sample of representative HELP items was examined; results indicated that HELP scoring was dependable and…

The psychometric integrity of a curriculum-based measure to screen for academic giftedness (Monitoring Instructional Responsiveness: Reading [MIR:R]) was evaluated by examining its ceiling, item gradient, and predictive capacity using 460 fourth grade students. Eighty fourth graders (17.39%) scored one standard deviation above the MIR:R mean. Ten…

To better understand Tennessee's new standardized science assessments, this quantitative study utilized a nonexperimental, descriptive-comparative design to compare the readability of the long-used science TCAP assessment with the newly created science TNReady assessment in grades three, four, and five. As new standards in the state boast higher…

The purpose of this article is to provide evidence of the technical adequacy of the Assessment, Evaluation, and Programming System--Third Edition (AEPS-3). The AEPS has long been identified as one of the most psychometrically sound early childhood curriculum-based assessments. In this article, results of three studies of technical adequacy are…

Peer-mediated interventions (PMIs) offer substantial benefits to middle school, high school, and post-secondary students with intellectual and developmental disabilities (IDD). However, with no valid and reliable measure to capture the ways in which the peers without disabilities are impacted, far less is known about the outcomes for these…

Numerous well-validated academic progress monitoring tools are used in schools, but there are fewer behavioral progress monitoring measures available. Some brief behavior rating scales have been shown to be effective in monitoring students' progress, but most focus only on students' social skills and do not address critical academic-related…

Numerous well validated academic progress monitoring tools are used in schools, but there are fewer behavioral progress monitoring measures available. Some brief behavior rating scales have been shown to be effective in monitoring students' progress, but most focus only on students' social skills and do not address critical academic-related…

Objective: Neurocognitive evaluations are commonly integrated with clinical assessment to evaluate adult Attention Deficit Hyperactivity Disorder (ADHD). Study goal is to identify measures most strongly related to ADHD diagnosis and to determine their utility in screening processes. Participants: 230 students who were evaluated at the Vanderbilt…

Despite growing calls for more accountability of teacher education programs (TEPs), there is little consensus about how to evaluate them. This study investigates the potential for using observational ratings of program completers to evaluate TEPs. Drawing on statewide data on almost 9,500 program completers, representing 44 providers (183…

Fidelity assessment has received renewed attention in recent years, particularly as distinctions have been made in implementation science between intervention fidelity and implementation fidelity. Considering both types of fidelity has been recommended when developing fidelity instruments. In the present article, we describe development of the…