This paper reports an investigation into the psychometric properties of the COR-Advantage1.5 (COR-Adv1.5) assessment tool, a criterion-referenced observation-based instrument designed to assess the developmental abilities of children from birth through kindergarten. Using data from 8534 children participating in a state-funded preschool program…

Curriculum-based measures (CBMs) such as Word Identification Fluency promote student achievement, but because they are timed and administered frequently, they are prone to variation in student response styles. To study the impact of WIF response styles, we created and examined the validity of a novel response style measure and examined the degree…

Ethical capability is one of a suite of broad competencies that are recent inclusions in national and state curricula in Australia. Problems arise in how to support teachers to assess student progress in complex skill areas. Using methodology derived from the work of Griffin, this study investigated whether a criterion-referenced assessment…

The purpose of this article is to provide evidence of the technical adequacy of the Assessment, Evaluation, and Programming System--Third Edition (AEPS-3). The AEPS has long been identified as one of the most psychometrically sound early childhood curriculum-based assessments. In this article, results of three studies of technical adequacy are…

This paper reports an empirical study which investigates a disparity between student-teacher rated scores in a criterion-referenced assessment (CRA) of a critical thinking and writing module for engineering undergraduates. Using the rubric as a self-assessment tool, students rated their self-confidence level and performance in terms of the…

The objective structured practical examination (OSPE) is a reliable assessment of practical skills in anatomy teaching. It is often administered as low-stake assessments to track progress at multiple time points in anatomy curricula. Standard-setting OSPEs to derive a pass mark and to ensure assessment quality and rigor is a complex task. This…

The testing effect is one of the strongest learning techniques documented to date. Although the effects of testing on high-level learning are promising, fewer studies on this have been done. In this classroom application of the testing effect, we aimed to (1) determine whether a testing effect exists on high-level testing; (2) determine whether…

This study examined the utility of using cost-effectiveness analysis to select universal mathematics screening measures in middle school. Participants (n=1586) were students in Grades 6, 7, and 8 at two suburban middle schools in Wisconsin. Screening data, including previous year criterion-measure (Wisconsin Forward Exam) scores, fall Measures of…

Procedures for identifying the gifted often make use of tests of general intelligence, among other assessments. Robert J. Sternberg recently suggested that identification of the gifted should further involve assessment of what he refers to as adaptive intelligence--the ability to adapt to real-world environments. Such a conception of intelligence…

Assessment and evaluation at all levels of educational systems have become policy priorities for many countries. Two common reasons for this are student learning expectations and accountability. Although much effort has been put into the creation and refinement of content standards, standardized tests, and methods for using testing results, there…

This study intends to describe assessment strategies for young students' online learning. The participants in this descriptive qualitative study were 15 primary school principals and 35 teachers teaching Years 4 and 5 in urban and rural schools on the island of Lombok, West Nusa Tenggara Province, who volunteered their participation after…

Vocabulary skills are important for overall reading competence, but vocabulary assessment approaches that inform instructional decision-making and are sensitive to improvement are limited. This article describes a process for developing vocabulary measures designed to facilitate data-driven decision-making for kindergarten and first-grade students…

We investigated students' knowledge and beliefs about the impact of using three-dimensional (3D) multimedia presentations. Students listened to a lecture about the ventricular system, which was presented alone (Experiment 1 only) or with a 3D or a 2D video illustrating the system. Afterwards, students judged how well they would perform on a…

Recent advances have enabled diagnostic classification models (DCMs) to accommodate longitudinal data. These longitudinal DCMs were developed to study how examinees change, or transition, between different attribute mastery statuses over time. This study examines using longitudinal DCMs as an approach to assessing growth and serves three purposes:…

Whenever classification decisions are made on educational tests, such as pass/fail, or basic, proficient, or advanced, the consistency and accuracy of those decisions should be estimated and reported. Methods for estimating the reliability of classification decisions made on the basis of educational tests are well-established (e.g., Rudner, 2001;…