There can be many reasons why students fail to answer correctly to summative tests in advanced computer science courses: often the cause is a lack of prerequisites or misconceptions about topics presented in previous courses. One of the ITiCSE 2020 working groups investigated the possibility of designing assessments suitable for differentiating…

Purpose: The purpose of this study was to develop and evaluate the initial reliability and validity evidence of the dynamic assessment (DA) of early reading and language as a second-stage screener in kindergarten, the first year of formal schooling. The DA comprises three subtests that capture students' ability to learn letter sounds and blending…

Although there exists an extensive amount of research on subscores and their properties, limited research has been conducted on categorical subscores and their interpretations. In this paper, we focus on the claim of Feinberg and von Davier that categorical subscores are useful for remediation and instructional purposes. We investigate this claim…

The DAATS (Dispositions Assessments Aligned with Teacher Standards) battery is a series of five instruments of different item types that measure teachers' consistency with the critical dispositions embedded in the InTASC Standards. The purpose of this study was to continue a 20-year research project on the development and implementation of…

Purpose: Anomia, or word-finding difficulty, is a prevalent and persistent feature of aphasia, a neurogenic language disorder affecting millions of people in the United States. Anomia assessments are essential for measuring performance and monitoring outcomes in clinical settings. This study aims to evaluate the reliability of response time (RT)…

Background: This paper develops a new method to estimate quasi-experimental evaluation models when it is necessary to control for measurement error in predictors and individual assignment to the treatment group is based on these same fallible variables. A major methodological finding of the study is that standard methods of estimating models that…

No Child Left Behind (NCLB) cemented a standardized testing assessment culture in the United States but research has highlighted the inequities (Au, 2020; Dixon, 1978; Grodsky et al., 2008; Khan, 2020; Moses & Nanna, 2007), unreliability (Hunt et al., 2010; Pizmony-Levy & Green Saraisky, 2016) and negative impacts (Berryhill et al., 2009;…

Educators and institutions have considered and continue to explore alternatives to measure students' learning and track their performance. An alternative that started to gain popularity due to its effectiveness in promoting learning engagement, equity, and inclusion, and helping mitigate concerns due to mental health was "ungrading."…

The Draw-A Scientist Test (DAST) has been used for many years as a data collection tool in studies where the image of the scientist is attempted to be determined. In this test, in which the image of scientist is attempted to be revealed with drawings, the drawings are analyzed using a coding ruler or checklist. However, the DAST has been…

Comprehensive quality assessment is an assessment system that identifies and explores students' strengths. By examining the developmental progress made in pilot provinces that have implemented comprehensive quality assessment, valuable insights and guidance can be derived for other provinces preparing to adopt this assessment approach. In this…

As an alternative to Cronbach's [alpha] for estimating scale reliability, McDonald's [omega] has attracted increased attention within the methodological community for its less stringent measurement assumptions. Notwithstanding, [omega] is still seldom used by practitioners, likely due to its unavailability in popular software packages (e.g., SPSS)…

At a time when institutions of higher education are exploring alternatives to traditional admissions testing, institutions are also seeking to better support students and prepare them for academic success. Under such an engaged model, one may seek to measure not just the accumulated knowledge and skills that students would bring to a new academic…

As the use of diagnostic assessment systems transitions from research applications to large-scale assessments for accountability purposes, reliability methods that provide evidence at each level of reporting are needed. The purpose of this paper is to summarize one simulation-based method for estimating and reporting reliability for an…

Journalism's societal role hinges on effective communication, demanding proficient language skills. This study assesses a South African University of Technology's Department of Journalism, probing existing selection methods' efficacy in predicting success in two English modules. Concerns persist about these methods accurately identifying students…

Magnet schools have been a main tool or innovation in urban education settings in the United States, originating in the early 1970's and expanding into most large urban districts today (Blank, 1989). While some magnet schools do not rely on a specific criterion to determine entry, many do. This study focuses on such a setting where students must…