This paper evaluates the multistage adaptive test (MST) design of a large-scale academic language assessment (ACCESS) for Grades 1-12, with an aim to simplify the current MST design, using both operational and simulated test data. Study 1 explored the operational population data (1,456,287 test-takers) of the listening and reading tests of MST…

Running Records provide a standardized method for recording and assessing students' oral reading behaviors and are excellent formative assessment tools to guide instructional decision-making. This study expands on prior Running Record reliability work by evaluating the extent to which external raters and teachers consistently assessed students'…

International large-scale assessments have gained much attention since the beginning of the twenty-first century, influencing education legislation in many countries. This includes Spain, where they have been used by successive governments to justify education policy change. Unfortunately, there was a problem with the PISA 2018 reading scores for…

Purpose: The purpose of this study was to develop and evaluate the initial reliability and validity evidence of the dynamic assessment (DA) of early reading and language as a second-stage screener in kindergarten, the first year of formal schooling. The DA comprises three subtests that capture students' ability to learn letter sounds and blending…

This study discusses the characteristics of test specifications (specs) and item writer guidelines (IWGs), their role in item development of English as a Second Language (ESL) reading tests, and the use of the CEFR for specs development. This mixed-method study analyzed specs, IWGs, tests, and the Pearson Test of English General test statistics.…

With an increasing number of U.S. states implementing multi-tiered systems of reading support in schools, educators require validated screening measures to identify students at risk for reading difficulties and inform reading instructional practices. This study evaluates the utility and validity of a new measure developed as part of the Dynamic…

The purpose of the present study was to examine the potential that parents could effectively administer an online dyslexia evaluation tool (ODET) to their children. To this end, four groups consisting of parents and trained staff were compared. Sixty-three children (36 females and 27 males) participated. The children in each group were assessed…

This study aims to evaluate the quality of English reading comprehension test instruments used in informal learning, especially as English literacy tests. With a quantitative approach, the analysis was carried out using the Rasch model through the Quest program on 30 multiple-choice questions given to 30 grade IX students from informal educational…

The ability to think critically and creatively is essential for students to help them thrive in the 21st century. Creative and critical thinking can be measured through problem solving because the assessment contains tasks that require students to find problems, analyze and evaluate problems, and work out the solutions. Therefore, this study was…

Background: Reading comprehension is frequently impaired in persons with aphasia (PWA). For goal-setting and outcome measurement, speech and language therapists (SLTs) need to determine an individual's perspective of their reading difficulties and everyday reading activities. The Comprehensive Assessment of Reading in Aphasia (CARA) reading…

Researchers in science education lacks valid and reliable instruments to assess students' "disciplinary" and "epistemic" reading of scientific texts. The main purpose of this study was to develop and validate a Reading in Science Holistic Assessment (RISHA) to assess students' holistic reading of scientific texts. RISHA…

Acadience Reading Diagnostic: Comprehension, Fluency, and Oral Language Assessment (CFOL) is an individually administered diagnostic assessment published by Acadience Learning for students in kindergarten through sixth grades. The measure purportedly provides diagnostic information in story coherence/text structure, listening and reading…

Inference is considered an important factor in comprehension models and has been described as a causal factor in predicting comprehension. To date, specific tests for inference are rare and often rely on specific thematic texts. This reliance on thematic inference may raise some concerns as inference is related to prior text-specific knowledge.…

An essential question when computing test--retest and alternate forms reliability coefficients is how many days there should be between tests. This article uses data from reading and math computerized adaptive tests to explore how the number of days between tests impacts alternate forms reliability coefficients. Results suggest that the highest…

This brief report summarizes the development and psychometric properties of German reading fluency passages as compared to English reading fluency passages for immersion language learners. Results indicated that scores from German language reading fluency passages alone were (a) somewhat less reliable than scores from English publisher-developed…