The Cross-Classified Mixed Effects Model (CCMEM) has been demonstrated to be a flexible framework for evaluating reliability by measurement specialists. Reliability can be estimated based on the variance components of the test scores. Built upon their accomplishment, this study extends the CCMEM to be used for evaluating validity evidence.…

Local item dependency (LID) occurs when test-takers' responses to one test item are affected by their responses to another. It can be problematic if it causes inflated reliability estimates or distorted person and item measures. The cued-recall reading comprehension test in Hu and Nation's (2000) well-known and influential coverage--comprehension…

Reading motivation is an important contributor to reading achievement. Students with higher levels of motivation tend to outperform those with lower levels. Reading motivation is a dynamic, situational, context-dependent trait that can vary in children over time and across tasks. Teachers have a valuable opportunity to support students' reading…

There is significant overlap between reading and writing, but no known standardized measure assesses these jointly. The goal of the present study is to evaluate the properties of a novel measure, the Assessment of Writing, Self-Monitoring, and Reading (AWSM Reader), that simultaneously evaluates both reading comprehension and writing. In doing so,…

Introduction: Reading comprehension is an important skill in the fast pace global society in which we now live. However, reading comprehension is a rather complex process that involves the dynamic interaction of cognitive and metacognitive skills. Method: In the present study, we investigated whether a newly-developed text inconsistency detection…

Computerized game-based assessment (GBA) system for screening reading difficulties may provide substantial time and cost benefits over traditional paper-and-pencil assessment while providing means also to individually adapt learning content in educational games. To study the reliability and validity of a GBA system to identify struggling readers…

In studies of educational achievement, students' self-reported number of books in the family home is a frequently used proxy for social, cultural, and economic background. Absent hard evidence about what this variable captures or how well, its use has been motivated by strong associations with student outcomes. I show that these associations rest…

Vocableveltest.org is a testing platform on which users can create on- line self-marking meaning-recall (reading or listening) and form-recall (typing) tests that address a number of limitations of the existing vocabulary level tests and vocabulary size tests. A major limitation of many existing vocabulary tests is the written receptive…

The main purpose of this quantitative-qualitative content analysis study was to compare IELTS and TOEFL listening and reading tests based on the representation of the learning objectives of Revised Bloom's taxonomy. To this end, 12 Academic IELTS listening and reading tests and 12 TOEFL iBT listening and reading tests were analyzed qualitatively…

Recent simulations suggest that trend line decision rules applied to curriculum-based measurement of reading progress monitoring data may lead to inaccurate interpretations unless data are collected for upward of 3 months. The authors of those studies did not manipulate goal line slope or account for a student's level of initial performance when…

The Phonics Screening Check (PSC) was introduced in England in 2012 for Year 1 children (aged 5 and 6). There have been criticisms of the check in relation to its reliability and appropriateness as an assessment for early reading, although advocates of the check see it as a valuable tool in securing progress in early reading. This mixed methods…

This study investigates consistent and inconsistent respondents to mixed-worded questionnaire scales in large-scale assessments. Mixed-worded scales contain both positively and negatively worded items and are universally applied in different survey and content areas. Due to the changing wording, these scales require a more careful reading and…

ACT reporting categories and ACT Readiness Ranges are new features added to the ACT score reports starting in fall 2016. For each reporting category, the number correct score, the maximum points possible, the percent correct, and the ACT Readiness Range, along with an indicator of whether the reporting category score falls within the Readiness…

MOCCA-C is an assessment of adult reading ability designed for early diagnosis of reading problems, for formative assessment in reading intervention planning, for assessment of reading improvement over time, and for assessment of reading intervention outcomes. It uses both narrative and expository reading passages and it currently has four forms.…

Curriculum Based Measurements (CBM) are a widely-used tool for Response to Intervention (RTI) progress monitoring. In addition, they can be used in the determination of learning disabilities and special education qualification. The most widely used type of CBM is a measure of oral reading fluency (ORF). This type involves having a student read out…