Setting cutoff scores is one of the most common practices when using scales to aid in classification purposes. This process is usually done univariately where each optimal cutoff value is decided sequentially, subscale by subscale. While it is widely known that this process necessarily reduces the probability of "passing" such a test,…

This note confronts the common use of a single coefficient alpha as an index informing about reliability of a multicomponent measurement instrument in a heterogeneous population. Two or more alpha coefficients could instead be meaningfully associated with a given instrument in finite mixture settings, and this may be increasingly more likely the…

As the use of diagnostic assessment systems transitions from research applications to large-scale assessments for accountability purposes, reliability methods that provide evidence at each level of reporting are needed. The purpose of this paper is to summarize one simulation-based method for estimating and reporting reliability for an…

The State of Washington requires school districts to file court petitions on students with excessive unexcused absences. The "Washington Assessment of Risks and Needs of Students" (WARNS), a self-report screening instrument developed for use by high school and juvenile court personnel in such situations, purports to measure six facets of…

PISA is an extremely influential large-scale assessment, and its "policy lessons" are being incorporated in a range of nations all over the world. In this paper I argue that not only is PISA influencing policies and practices, but also that "seeing like PISA" is becoming a widespread phenomenon. Globally, education…

This review examined a range of approaches internationally to the reporting of assessment results for individual students, with a particular focus on how results are represented, the level of detail reported and the steps taken to quantify, report and explain error and uncertainty in the results' reports or certificates given to students in a…

The accuracy of the results of the national tests in English, mathematics and science taken by 11-year olds in England has been a matter of much debate since their introduction in 1994, with estimates of the proportion of students incorrectly classified varying from 10 to 30%. Using live data from the 2009 and 2010 administration of the national…

The Kaufman Test of Educational Achievement, Third Edition (KTEA-3) is a revised and updated comprehensive academic achievement test (Kaufman & Kaufman, 2014). Authored by Drs. Alan and Nadeen Kaufman and published by Pearson, the KTEA-3 remains an individual achievement test normed for individuals of ages 4 through 25 years, or for those in…

Students with internalizing behavior patterns are often overlooked and underserved in schools, which is problematic in that they are at risk for a host of negative outcomes. As a result, there is a need for universal screening procedures to proactively detect students with these behavior patterns and to provide them with early, ongoing supports.…

Aim: This systematic review compares the validity, reliability, and clinical use of habitual physical activity (HPA) performance measures in adolescents with cerebral palsy (CP). Method: Measures of HPA across Gross Motor Function Classification System (GMFCS) levels I-V for adolescents (10-18y) with CP were included if at least 60% of items…

Introduction: While there is a general agreement on the theoretical importance of epistemological beliefs, the research area is struggling with the measurement of these beliefs. In this contribution, the use of drawings to ascertain epistemological beliefs is explored. Method: Three studies are described. In Study 1, we asked participants to draw…

Both California state law and the federal No Child Left Behind Act (NCLB) require that all schools assess the English language proficiency of newly enrolled students who speak a language other than English at home and, annually, all English learners (ELs) already enrolled. California meets this requirement by administering the California English…

This study examined the psychometric properties of the Revised Edition of the School Observation Coding System (REDSOCS). Participants were 68 children ages 3 to 6 who completed parent-child interaction therapy for Oppositional Defiant Disorder as part of a larger efficacy trial. Interobserver reliability on REDSOCS categories was moderate to…

Reliability and validity for three autism instruments were compared for 190 children with low functioning autism (LFA), 190 children with high functioning autism or Asperger's disorder (HFA), 76 children with attention deficit hyperactivity disorder (ADHD), and 64 typical children. The instruments were the Checklist for Autism Spectrum Disorder…

The No Child Left Behind Act and the accountability movement in public education caused many states to develop criterion-referenced academic achievement tests. Scores from these tests are often used to make high stakes decisions. Even so, these tests typically do not receive independent psychometric scrutiny. We evaluated the 2005 Arkansas…