The Motor-Free Visual Perception Test: Third edition (MVPT-3; Colarusso & Hammill, 2003) purports to measure overall visual perceptual ability. Task responses require no motor ability, eliminating the effect of motor performance on the overall visual perception score. The test authors suggested that this MVPT-3 characteristic allows for its…

Technical characteristics of the Reading Essential Skill Screener--Preschool Version (RESS-P) were studied using four independent samples of boys and girls aged 3-5 years. A decision efficiency study (N = 91) resulted in a total predictive value (TPV) of .85 when compared with the criterion of teacher report/judgment of emerging literacy at-risk…

In this article, the authors describe the refinement and preliminary evaluation of the Dimensions of Change in Therapeutic Community Treatment Instrument (DCI), a measure of treatment process. In Study 1, a 99-item DCI, administered to a cross-sectional sample of substance abuse clients (N = 990), was shortened to 54 items on the basis of results…

This article uses the work of two students to illustrate the need to consider changing the format of test items or making language adjustments to increase the validity of the test items as measures of the mathematics that students know.

The present studies were undertaken to examine the effects of manipulating delay-interval task (Study 1) and timing of feedback (Study 2) on acquisition and retention. Participants completed a 100-item cumulative final examination, which included 50 items from each laboratory examination, plus 50 entirely new items. Acquisition and retention were…

Technical characteristics of the Reading Essential Skills Screener-Elementary Version (RESS-E; B. T. Erford, G. Vitali, R. Haas, & R. R. Boykin, 1995) were studied using 4 independent samples of boys and girls between the ages of 6 and 8 years. Evidence of internal consistency, test-retest reliability, decision efficiency, factorial validity,…

Despite the prevalence of multiple choice items in educational testing, there is a dearth of empirical evidence for multiple choice item writing rules. The purpose of this study was to expand the base of empirical evidence by examining the use of the "all-of-the-above" option in a multiple choice examination in order to assess how…

This policy research document is intended for Louisiana policymakers to use when examining possible changes to the state assessment's alignment with the National Assessment of Educational Progress (NAEP). The 2009 NAEP test is not yet in existence, so the purpose of this report is to give policymakers a head start in determining where they might,…

The purpose of this study was to develop and gather validity evidence for silent reading fluency passages. A number of passages were written following a traditional story grammar structure (character, setting, events) and placed on a computer for students to read silently. We describe in detail, the manner in which content-related evidence was…

The purpose of this study was to document the instrument development of maze measures for grades 3-8. Each maze passage contained twelve omitted words that students filled in by choosing the best-fit word from among the provided options. In this technical report, we describe the process of creating, reviewing, and pilot testing the maze measures.…

The purpose of this Item Response Theory study was to investigate how the expected reduction in item information, due to the collapsing of response categories in performance assessment data, was affected by varying testing conditions: item difficulty, item discrimination, inter-rater reliability, and direction of collapsing. The investigation used…

The main goal of this study was to assess how sensitive unidimensional parameter estimates derived from BILOG were when the unidimensionality assumption was violated and the underlying ability distribution was not multivariate normal. A multidimensional three-parameter logistic distribution that was a straightforward generalization of the…

Differential item functioning (DIF) assessment attempts to identify items or item types for which subpopulations of examinees exhibit performance differentials that are not consistent with the performance differentials typically seen for those subpopulations on collections of items that purport to measure a common construct. DIF assessment…

The Test of Spoken English (TSE) is an internationally administered instrument for assessing nonnative speakers' proficiency in speaking English. The research foundation of the TSE examination described in its manual refers to two sources of variation other than the achievement being measured: interrater reliability and internal consistency.…

Three papers describe the three stages of developing the National Teacher Examination (NTE) School Psychologist Specialty Area Test. The first stage is described in the paper entitled "Knowledge Areas Important to School Psychology." A survey of the membership of the National Association of School Psychologists helped determine knowledge…