This study employed a mixed-design approach and the Many-Facet Rasch Measurement (MFRM) framework to investigate whether rater bias occurred between the onscreen scoring (OSS) mode and the paper-based scoring (PBS) mode. Nine human raters analytically marked scanned scripts and paper scripts using a six-category (i.e., six-criterion) rating…

In writing assessment, finding a valid, reliable, and efficient scale is critical. Appropriate scales, increase rater reliability, and can also save time and money. This exploratory study compared the effects of a binary scale and an analytic scale across teacher raters and expert raters. The purpose of the study is to find out how different scale…

There is some evidence that reading and spelling are complementary processes. The purpose of this study was to investigate the extent to which contextualized spelling (i.e., spelling activities within the context of reading instruction) is used to support reading in first-grade core reading programs. Analysis of 75 lessons across five programs…

To be familiar with micro and symbolic performances, students could work out more effective approaches of innovated techniques known as five hierarchical designs in chemistry equilibrium. However, the most frequently reported problem in students' assessment of chemistry study is attributed to their poor skill recognizing basic concepts. The aim of…

Rater subjectivity has long been an intriguing topic. The use of discussion as a resolution method is a practical way to reduce this subjectivity. However, the efficacy of discussion depends on whether different raters get equally engaged in it or one rater tends to dominate others. This study investigated whether and how rater dominance occurs in…

Classroom observations increasingly inform high-stakes decisions and research in education, including the allocation of school funding and the evaluation of school-based interventions. However, trends in rater scoring tendencies over time may undermine the reliability of classroom observations. Accordingly, the present investigations, grounded in…

This article offers a way to measure agreement in participatory mapping. We asked subject matter experts (SMEs) to draw where Sudanese ethnic groups were located on a map. We then used an eigenanalysis approach to determine whether SMEs agreed on the location of ethnic groups. We used minimum residual factor analysis to assess the extent of…

Automated scoring systems are typically evaluated by comparing the performance of a single automated rater item-by-item to human raters. This presents a challenge when the performance of multiple raters needs to be compared across multiple items. Rankings could depend on specifics of the ranking procedure; observed differences could be due to…

Despite the expansion of early intervention approaches for young children with ASD, investigators have struggled to identify measures capable of assessing social communication change in response to these interventions. Addressing recent calls for efficient, sensitive, and reliable social communication measures, the current paper outlines the…

Progressing through schools may be challenging for some students, especially those with learning disabilities (LD). In social studies, for example, students grapple with increasingly complex texts, independent work, direct instruction, critical thinking, analysis, and other learning demands. As students transition from elementary schools where…

Promoting creativity is considered an important goal of education, but creativity is notoriously hard to define and measure. In this paper, we make the journey from defining a formal creativity and applying the measure in a practical domain. The measure relies on core theoretical concepts in creativity theory, namely fluency, flexibility, and…

The aim of this study was to clarify the intra- and inter-rater reliability of the rate of force development in hip abductor muscle force measurements using a hand-held dynamometer. Thirty healthy adults were separately assessed by two independent raters on two separate days. Rate of force development was calculated from the slope of the…

We developed a brief, informant-report interview for assessing autism spectrum conditions (ASC) in adults, called the Developmental, Dimensional and Diagnostic Interview-Adult Version (3Di-Adult); and completed a preliminary evaluation. Informant reports were collected for participants with ASC (n = 39), a non-clinical comparison group (n = 29)…

It is general practice to use rater judgments in speaking proficiency testing. However, it has been shown that raters' knowledge and experience may influence their ratings, both in terms of leniency and varied focus on different aspects of speech. The purpose of this study is to identify raters' relative responsiveness to fluency and linguistic…

Background: Posterior nasal fricatives are a learned compensatory articulation error and commonly substituted for oral fricatives. Treatment of such articulation errors requires the modification or teaching of skilled movements. A motor-based approach is designed to teach the complex motor skill movement sequences required in the production of…