A decision consistency (DC) index is an estimate of the consistency of a classification decision on an exam. More specifically, DC estimates the percentage of examinees that would have the same classification decision on an exam if they were to retake the same or a parallel form of the exam again without memory of taking the exam the first time.…

Diagnostic classification models (DCMs) are psychometric models that yield probabilistic classifications of respondents according to a set of discrete latent variables. The current study examines the recently introduced one-parameter log-linear cognitive diagnosis model (1-PLCDM), which has increased interpretability compared with general DCMs due…

Diagnostic classification models (DCMs) have grown in popularity as stakeholders increasingly desire actionable information related to students' skill competencies. Longitudinal DCMs offer a psychometric framework for providing estimates of students' proficiency status transitions over time. For both cross-sectional and longitudinal DCMs, it is…

Setting cutoff scores is one of the most common practices when using scales to aid in classification purposes. This process is usually done univariately where each optimal cutoff value is decided sequentially, subscale by subscale. While it is widely known that this process necessarily reduces the probability of "passing" such a test,…

This research study holds practical significance for educators, school administrators, and mental health professionals. The study utilized structural equation modeling on two samples of elementary school students in grades three to five to create and validate condensed versions of the Social-Emotional Health Survey-Primary and the Me and My School…

As part of a validation study of the Exercise Planning and Scheduling (EPS), and Goal-Setting (EGS) Scales, which were translated from English to Brazilian Portuguese, we aim to: present evidence of reliability and validity for the translated scale; and, explore the effects of non-labeled response categories of rating scales. The sample comprised…

The study aimed to explore the Chinese version of the Frost Multidimensional Perfectionism Scale suitable for gifted junior high school students and to classify the types of perfectionism. The Frost Multidimensional Perfectionism Scale was translated into Chinese to evaluate the factor structure and typology of academically gifted students in…

The study aimed to verify the psychometric properties of the emotional-style scale and explore different clusters of emotional styles. An emotional style scale was completed in three districts of western Taiwan using stratified random sampling. The study confirmed the reliability and convergent validity of each subscale in a sample of 712…

This brief report summarizes the development and psychometric properties of German reading fluency passages as compared to English reading fluency passages for immersion language learners. Results indicated that scores from German language reading fluency passages alone were (a) somewhat less reliable than scores from English publisher-developed…

This study reviewed conceptualizations and operationalizations of second language (L2) listening constructs. A total of 157 peer-reviewed papers published in 19 journals in applied linguistics were coded for (1) publication year, author, source title, location, language, and reliability and (2) listening subskills, cognitive processes, attributes,…

This study aimed to address the need for a comprehensive assessment tool to evaluate the mathematical abilities of first-grade students through cognitive diagnostic assessment (CDA). The primary challenge involved in this endeavor was to delineate the specific cognitive skills and sub-skills pertinent to first-grade mathematics (FG-M) and to…

This note confronts the common use of a single coefficient alpha as an index informing about reliability of a multicomponent measurement instrument in a heterogeneous population. Two or more alpha coefficients could instead be meaningfully associated with a given instrument in finite mixture settings, and this may be increasingly more likely the…

Rasch and classification analyses on a field-test version of the third edition of the Assessment, Evaluation, and Programming System (AEPS-3), a curriculum-based assessment used to assess young children birth to age 6 years, were conducted. First, an evaluation of the psychometric properties of data from each developmental area of an AEPS-3…

The multiple-choice (MC) item format has been widely used in educational assessments across diverse content domains. MC items purportedly allow for collecting richer diagnostic information. The effectiveness and economy of administering MC items may have further contributed to their popularity not just in educational assessment. The MC item format…

For investigating a comprehensive PLC framework, instruments are needed that capture the multi-layered PLC characteristics and that take into account the complex influencing educational context. Such instruments are currently lacking. This study aims at describing the development and validation of two qualitative classification instruments usable…