Reliability is usually estimated for a total score, but it can also be estimated for item scores. Item-score reliability can be useful to assess the repeatability of an individual item score in a group. Three methods to estimate item-score reliability are discussed, known as method MS, method [lambda][subscript 6], and method CA. The item-score…

A readily applicable procedure is discussed that allows evaluation of the discrepancy between the popular coefficient alpha and the reliability coefficient of a scale with second-order factorial structure that is frequently of relevance in empirical educational and psychological research. The approach is developed within the framework of the…

Argument-based validation requires test developers and researchers to specify what is entailed in test interpretation and use. Doing so has been shown to yield advantages (Chapelle, Enright, & Jamieson, 2010), but it also requires an analysis of how the concerns of language testers can be conceptualized in the terms used to construct a…

This article describes and reviews the "Test of Early Communication and Emerging Language" (TECEL; Huer & Miller, 2011). The test was constructed to assess infants' and toddlers' earliest communication and language abilities. The TECEL is a revision of the Nonspeech Test for Receptive/ Expressive Language (NST; Huer, 1983, 1988). The…

The engaging nature of video games has intrigued learning professionals attempting to capture and retain learners' attention. Designing learning interventions that not only capture the learner's attention, but also are designed around the natural cycle of attention will be vital for learning. This paper introduces the temporal attentive…

The purpose of this study was to examine the histopathologic reliability of embalmed cadaveric tissue taken from the gross anatomy laboratory. Tissue samples from hearts, livers, lungs, and kidneys were collected after the medical students' dissection course was completed. All of the cadavers were embalmed in a formalin-based fixative solution.…

Cronbach's alpha is a statistic commonly quoted by authors to demonstrate that tests and scales that have been constructed or adopted for research projects are fit for purpose. Cronbach's alpha is regularly adopted in studies in science education: it was referred to in 69 different papers published in 4 leading science education journals in a…

Response to intervention (RtI) models have increasingly been adopted to improve outcomes for all students through the delivery of a continuum of supports and making timely responsive instructional decisions based on data. With this increasing popularity, researchers and practitioners have developed several RtI-related assessments, many of which…

This real-data-guided simulation study systematically evaluated the decision accuracy of complex decision rules combining multiple tests within different realistic curricula. Specifically, complex decision rules combining conjunctive aspects and compensatory aspects were evaluated. A conjunctive aspect requires a minimum level of performance,…

During the development of large-scale curricular achievement tests, recruited panels of independent subject-matter experts use systematic judgmental methods--often collectively labeled "alignment" methods--to rate the correspondence between a given test's items and the objective statements in a particular curricular standards document.…

Background: A feasible and reliable instrument to measure strength in persons with severe intellectual and visual disabilities (SIVD) is lacking. The aim of our study was to determine feasibility, learning period and reliability of three strength tests. Methods: Twenty-nine participants with SIVD performed the Minimum Sit-to-Stand Height test…

In the shift to Emergency Remote Teaching and Learning (ERT&L) during the COVID-19 pandemic, remote assessment and feedback became a major source of discontent and challenge for students and staff. This paper is a reflection and analysis of assessment practices during ERT&L, and our theorisation of the possibilities for shifts towards…

Digital literacy is essential for scientific literacy in a digital world. Although the NGSS Practices include many activities that require digital literacy, most studies have examined digital literacy from a generic perspective rather than a curricular context. This study aimed to develop a self-report tool to measure elements of digital literacy…

Researchers have significantly explored language learners' attitudes toward ChatGPT through the lens of technology acceptance models, particularly with its development and integration into computer-assisted language learning (CALL). However, further research in this area is necessary to apply a theoretical framework with a pedagogical-oriented…

This study employed a meta-analytic approach to examine the effectiveness of graphic organizers (GOs) in improving academic and behavioral outcomes for K-12 students with disabilities, drawing from the single-case special education literature. Moderators at participant and study level were analyzed in addition to the main effects. A comprehensive…