Diagnostic classification models (DCMs) have grown in popularity as stakeholders increasingly desire actionable information related to students' skill competencies. Longitudinal DCMs offer a psychometric framework for providing estimates of students' proficiency status transitions over time. For both cross-sectional and longitudinal DCMs, it is…

Diagnostic classification models (DCMs) classify examinees based on the skills they have mastered given their test performance. This classification enables targeted feedback that can inform remedial instruction. Unfortunately, applications of DCMs have been criticized (e.g., no validity support). Generally, these evaluations have been brief and…

A key question facing teacher evaluation systems is how to combine multiple measures of complex constructs into composite indicators of performance. We use data from the Measures of Effective Teaching (MET) study to investigate the measurement properties of composite indicators obtained under various conjunctive, disjunctive (or complementary),…

In Gargani and Strong (2014), we describe The Rapid Assessment of Teacher Effectiveness (RATE), a new teacher evaluation instrument. Our account of the validation research associated with RATE inspired a review by Good and Lavigne (2015). Here, we reply to the main points of their review. We elaborate on the validity, reliability, theoretical…

Background: Since the discontinuation of Standard Attainment Tests (SATs) in science at age 11 in England, pupil performance data in science reported to the UK government by each primary school has relied largely on teacher assessment undertaken in the classroom. Purpose: The process by which teachers are making these judgements has been unclear,…

Background: The purpose of this study is to describe feasibility and test-retest reliability of the six-minute walking distance test (6MWD) and an adapted shuttle run test (aSRT) in persons with severe intellectual and sensory (multiple) disabilities. Materials and Methods: Forty-seven persons with severe multiple disabilities, with Gross Motor…

Aim: This systematic review compares the validity, reliability, and clinical use of habitual physical activity (HPA) performance measures in adolescents with cerebral palsy (CP). Method: Measures of HPA across Gross Motor Function Classification System (GMFCS) levels I-V for adolescents (10-18y) with CP were included if at least 60% of items…

Real-life, complex problems often require that decisions are made despite limited information or insufficient time to explore all relevant aspects. Incorporating authentic uncertainties into an assessment, however, poses problems in establishing results and analysing their methodological qualities. This study aims at developing a test on clinical…

This report describes three extensions to a classification system for paediatric speech sound disorders termed the Speech Disorders Classification System (SDCS). Part I describes a classification extension to the SDCS to differentiate motor speech disorders from speech delay and to differentiate among three sub-types of motor speech disorders.…

Objectives: Establish metric properties of the Neighborhood Inventory for Environmental Typology (NIfETy). Method: A total of 919 residential block faces were assessed by paired raters using the NIfETy. Reliability was evaluated via interrater and internal consistency reliability; validity by comparing NIfETy data with youth self-reported…

Multiple and specific learning criteria were used to examine the predictive validity of the Learning Style Questionnaire (LSQ). Ninety-nine students in a college of higher learning in The Netherlands participated in a naturally occurring field study. The students were categorized into one of four LSQ dimensions, namely, Activists, Theorists,…

Psychometric data are presented for 223 children and adults with autism, pervasive developmental disorder not otherwise specified (PDDNOS), or nonspectrum diagnoses who took the Autism Diagnostic Observation Schedule-Generic. Within each module, diagnostic groups were equivalent on expressive language levels. Results indicate substantial…

A dozen different approaches that yield 13 reliability indices for criterion-referenced tests were identified and grouped into three categories: threshold loss function, squared-error loss function, and domain score estimation. Indices were evaluated within each category. (Author/RL)

The taxonomy developed by J. Klecan-Aker et al. to investigate the use of various speech acts in response to questions during a structured picture-description task was evaluated. Results indicated that the taxonomy was sufficient to handle the responses of a group of 12 language-impaired children, aged 7-11. (JDD)

This study attempted (1) to test the efficiency, simplicity, and experimental power of Paul Diederich's Method for measuring growth in writing ability, a method which allows for the cooperative evaluation of student writing using local criteria, and (2) to use this Method to measure both writing ability and grading consistency in a specific…